2021-02-13T17:44:37.642 INFO:root:teuthology version: 1.1.0-87d40f79 2021-02-13T17:44:37.643 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --owner scheduled_yuriw@teuthology --name yuriw-2021-02-12_17:45:41-rgw-wip-yuri3-testing-2021-02-12-0757-nautilus-distro-basic-gibba --description rgw/multisite/{clusters frontend/civetweb omap_limits overrides realms/three-zone-plus-pubsub tasks/test_multi valgrind} --archive /home/teuthworker/archive/yuriw-2021-02-12_17:45:41-rgw-wip-yuri3-testing-2021-02-12-0757-nautilus-distro-basic-gibba/5877924 -- /home/teuthworker/archive/yuriw-2021-02-12_17:45:41-rgw-wip-yuri3-testing-2021-02-12-0757-nautilus-distro-basic-gibba/5877924/orig.config.yaml 2021-02-13T17:44:37.699 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2021-02-13T17:44:37.766 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2021-02-12_17:45:41-rgw-wip-yuri3-testing-2021-02-12-0757-nautilus-distro-basic-gibba/5877924 branch: wip-yuri3-testing-2021-02-12-0757-nautilus description: rgw/multisite/{clusters frontend/civetweb omap_limits overrides realms/three-zone-plus-pubsub tasks/test_multi valgrind} email: ceph-qa@ceph.io first_in_suite: false job_id: '5877924' kernel: kdb: true sha1: distro last_in_suite: false machine_type: gibba name: yuriw-2021-02-12_17:45:41-rgw-wip-yuri3-testing-2021-02-12-0757-nautilus-distro-basic-gibba nuke-on-error: true os_type: ubuntu overrides: admin_socket: branch: wip-yuri3-testing-2021-02-12-0757-nautilus ceph: conf: client: debug rgw: 20 rgw crypt require ssl: false rgw crypt s3 kms encryption keys: testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= rgw curl low speed time: 300 rgw data log num shards: 4 rgw md log max shards: 4 rgw sync log trim interval: 0 rgw sync obj etag verify: true global: osd heartbeat grace: 40 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon osd crush smoke test: false osd: debug filestore: 20 debug journal: 20 debug ms: 20 debug osd: 25 osd fast shutdown: false osd.0: osd_max_omap_entries_per_request: 10 osd.1: osd_max_omap_entries_per_request: 1000 osd.2: osd_max_omap_entries_per_request: 10000 log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: 7194982cc16a1fd51df59ee58e1c54797c4465d1 wait-for-scrub: false ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 install: ceph: sha1: 7194982cc16a1fd51df59ee58e1c54797c4465d1 rgw: compression type: random frontend: civetweb rgw-multisite: realm: is default: true name: test-realm zonegroups: - endpoints: - c1.client.0 is_default: true is_master: true name: test-zonegroup zones: - endpoints: - c1.client.0 is_default: true is_master: true name: test-zone1 - endpoints: - c2.client.0 is_default: true name: test-zone2 - endpoints: - c1.client.1 name: test-zone3 - endpoints: - c2.client.1 is_pubsub: true name: test-zone4 workunit: branch: wip-yuri3-testing-2021-02-12-0757-nautilus sha1: 7194982cc16a1fd51df59ee58e1c54797c4465d1 owner: scheduled_yuriw@teuthology priority: 100 repo: https://github.com/ceph/ceph-ci.git roles: - - c1.mon.a - c1.mgr.x - c1.osd.0 - c1.osd.1 - c1.osd.2 - c1.client.0 - c1.client.1 - - c2.mon.a - c2.mgr.x - c2.osd.0 - c2.osd.1 - c2.osd.2 - c2.client.0 - c2.client.1 sha1: 7194982cc16a1fd51df59ee58e1c54797c4465d1 sleep_before_teardown: 0 suite: rgw suite_branch: wip-yuri3-testing-2021-02-12-0757-nautilus suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_7194982cc16a1fd51df59ee58e1c54797c4465d1/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 7194982cc16a1fd51df59ee58e1c54797c4465d1 targets: gibba025.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQct/yYRiVyP7xLyZhwP0bImuTNCZqteVFOIsXVClcIP1ZAC/HTIXhbXqwri+YfB05v85zmUldT9kbGVrzpkT7izrkERnEs70Y9+UACfYvKZXbdMdnZcNwpdyHqvXmt9NHcyt/DO7YWDN3WDCyNtsFLRFw1KJ8oeOMMAz0gNAJCrck2wuSsfV7iDofzXJOy+hZD7/NSkcBhCVJD1Ji0GogMlI2idePwXea5jx131oLUvcsP3wDus5XxhcCm4YBELqrrbkFX0Dn3mjazLczPpIqcj1eOmFSmJKKjPf/+wPaiUDREdxuFyM2pLNrX0vrH0GuLx5DraWWgByWEws0fSLP gibba036.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCzmzfuX9HS9ufXoRhqcszlNBlk6kQ7aINmyLfea6KbHvb1lKjgcpcHIRKOdcXWY7hu63FxR7DJYEu9X4+DID8OyrdE/i4C14CL2+MXJWMqMS9jHDtfcRUxqXrx4Tj3JQLQh5ybSltA3djSEkGKfhHHhV3CP/y7NiKqK6uxVGsm3tlpX/TjE1UBYdsR+99a353abLIIwU69bi4NoCFXDi9QiPhn2fDnT6prAur9nBkrWRwKI9KgxLN1TWp7/NrLerLriIShyc03pduExkbph6b5INTocgfKoqcn09wkrLIstLEaoSKOS6DJnY+NiMgPtD/aHjgCAQHsxDNnN1eVaeKP tasks: - install: null - ceph: cluster: c1 - ceph: cluster: c2 - rgw: c1.client.0: port: 8000 c1.client.1: port: 8001 c2.client.0: port: 8000 c2.client.1: port: 8001 - rgw-multisite: null - rgw-multisite-tests: config: reconfigure_delay: 60 teuthology_branch: master teuthology_sha1: 87d40f79d7da6caf6da06c190938773bf745140c timestamp: 2021-02-12_17:45:41 tube: gibba user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.gibba.29737 2021-02-13T17:44:37.766 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_7194982cc16a1fd51df59ee58e1c54797c4465d1/qa; will attempt to use it 2021-02-13T17:44:37.772 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_7194982cc16a1fd51df59ee58e1c54797c4465d1/qa/tasks 2021-02-13T17:44:37.772 INFO:teuthology.run_tasks:Running task internal.check_packages... 2021-02-13T17:44:37.774 INFO:teuthology.task.internal:Checking packages... 2021-02-13T17:44:37.834 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'basic' and ceph hash '7194982cc16a1fd51df59ee58e1c54797c4465d1' 2021-02-13T17:44:37.835 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2021-02-13T17:44:37.835 INFO:teuthology.packaging:ref: None 2021-02-13T17:44:37.835 INFO:teuthology.packaging:tag: None 2021-02-13T17:44:37.835 INFO:teuthology.packaging:branch: wip-yuri3-testing-2021-02-12-0757-nautilus 2021-02-13T17:44:37.835 INFO:teuthology.packaging:sha1: 7194982cc16a1fd51df59ee58e1c54797c4465d1 2021-02-13T17:44:37.836 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&ref=wip-yuri3-testing-2021-02-12-0757-nautilus 2021-02-13T17:44:38.021 INFO:teuthology.task.internal:Found packages for ceph version 14.2.16-285-g7194982c-1bionic 2021-02-13T17:44:38.022 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2021-02-13T17:44:38.031 INFO:teuthology.task.internal:no buildpackages task found 2021-02-13T17:44:38.032 INFO:teuthology.run_tasks:Running task internal.save_config... 2021-02-13T17:44:38.072 INFO:teuthology.task.internal:Saving configuration 2021-02-13T17:44:38.086 INFO:teuthology.run_tasks:Running task internal.check_lock... 2021-02-13T17:44:38.099 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-02-13T17:44:38.116 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2021-02-13 17:39:26.350305', 'description': '/home/teuthworker/archive/yuriw-2021-02-12_17:45:41-rgw-wip-yuri3-testing-2021-02-12-0757-nautilus-distro-basic-gibba/5877924', 'locked_by': 'scheduled_yuriw@teuthology', 'up': True, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIG4lQW+zvKTa7BY8dGHB/nEKZQF2ky2pg86bfjUOd5XE', 'os_version': '18.04', 'machine_type': 'gibba', 'vm_host': None, 'os_type': 'ubuntu', 'arch': 'x86_64', 'mac_address': None, 'name': 'gibba025.front.sepia.ceph.com'} 2021-02-13T17:44:38.133 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2021-02-13 17:39:26.350285', 'description': '/home/teuthworker/archive/yuriw-2021-02-12_17:45:41-rgw-wip-yuri3-testing-2021-02-12-0757-nautilus-distro-basic-gibba/5877924', 'locked_by': 'scheduled_yuriw@teuthology', 'up': True, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIPWJUpBV+F6+nel2WHGTX3Y89RWxkQPcm8WPuJZwBSDi', 'os_version': '18.04', 'machine_type': 'gibba', 'vm_host': None, 'os_type': 'ubuntu', 'arch': 'x86_64', 'mac_address': None, 'name': 'gibba036.front.sepia.ceph.com'} 2021-02-13T17:44:38.133 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2021-02-13T17:44:38.150 INFO:teuthology.task.internal:roles: ubuntu@gibba025.front.sepia.ceph.com - ['c1.mon.a', 'c1.mgr.x', 'c1.osd.0', 'c1.osd.1', 'c1.osd.2', 'c1.client.0', 'c1.client.1'] 2021-02-13T17:44:38.150 INFO:teuthology.task.internal:roles: ubuntu@gibba036.front.sepia.ceph.com - ['c2.mon.a', 'c2.mgr.x', 'c2.osd.0', 'c2.osd.1', 'c2.osd.2', 'c2.client.0', 'c2.client.1'] 2021-02-13T17:44:38.150 INFO:teuthology.run_tasks:Running task console_log... 2021-02-13T17:44:38.231 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ff17fbce0d0>, signals=[15]) 2021-02-13T17:44:38.231 INFO:teuthology.run_tasks:Running task internal.connect... 2021-02-13T17:44:38.240 INFO:teuthology.task.internal:Opening connections... 2021-02-13T17:44:38.240 DEBUG:teuthology.task.internal:connecting to ubuntu@gibba025.front.sepia.ceph.com 2021-02-13T17:44:38.242 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba025.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-02-13T17:44:38.350 DEBUG:teuthology.task.internal:connecting to ubuntu@gibba036.front.sepia.ceph.com 2021-02-13T17:44:38.351 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba036.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-02-13T17:44:38.450 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2021-02-13T17:44:38.460 DEBUG:teuthology.orchestra.run.gibba025:> uname -m 2021-02-13T17:44:38.465 INFO:teuthology.orchestra.run.gibba025.stdout:x86_64 2021-02-13T17:44:38.465 DEBUG:teuthology.orchestra.run.gibba025:> cat /etc/os-release 2021-02-13T17:44:38.509 INFO:teuthology.orchestra.run.gibba025.stdout:NAME="Ubuntu" 2021-02-13T17:44:38.509 INFO:teuthology.orchestra.run.gibba025.stdout:VERSION="18.04.5 LTS (Bionic Beaver)" 2021-02-13T17:44:38.509 INFO:teuthology.orchestra.run.gibba025.stdout:ID=ubuntu 2021-02-13T17:44:38.509 INFO:teuthology.orchestra.run.gibba025.stdout:ID_LIKE=debian 2021-02-13T17:44:38.509 INFO:teuthology.orchestra.run.gibba025.stdout:PRETTY_NAME="Ubuntu 18.04.5 LTS" 2021-02-13T17:44:38.509 INFO:teuthology.orchestra.run.gibba025.stdout:VERSION_ID="18.04" 2021-02-13T17:44:38.509 INFO:teuthology.orchestra.run.gibba025.stdout:HOME_URL="https://www.ubuntu.com/" 2021-02-13T17:44:38.509 INFO:teuthology.orchestra.run.gibba025.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-02-13T17:44:38.509 INFO:teuthology.orchestra.run.gibba025.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-02-13T17:44:38.510 INFO:teuthology.orchestra.run.gibba025.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-02-13T17:44:38.510 INFO:teuthology.orchestra.run.gibba025.stdout:VERSION_CODENAME=bionic 2021-02-13T17:44:38.510 INFO:teuthology.orchestra.run.gibba025.stdout:UBUNTU_CODENAME=bionic 2021-02-13T17:44:38.510 INFO:teuthology.lock.ops:Updating gibba025.front.sepia.ceph.com on lock server 2021-02-13T17:44:38.530 DEBUG:teuthology.orchestra.run.gibba036:> uname -m 2021-02-13T17:44:38.545 INFO:teuthology.orchestra.run.gibba036.stdout:x86_64 2021-02-13T17:44:38.546 DEBUG:teuthology.orchestra.run.gibba036:> cat /etc/os-release 2021-02-13T17:44:38.591 INFO:teuthology.orchestra.run.gibba036.stdout:NAME="Ubuntu" 2021-02-13T17:44:38.591 INFO:teuthology.orchestra.run.gibba036.stdout:VERSION="18.04.5 LTS (Bionic Beaver)" 2021-02-13T17:44:38.591 INFO:teuthology.orchestra.run.gibba036.stdout:ID=ubuntu 2021-02-13T17:44:38.591 INFO:teuthology.orchestra.run.gibba036.stdout:ID_LIKE=debian 2021-02-13T17:44:38.592 INFO:teuthology.orchestra.run.gibba036.stdout:PRETTY_NAME="Ubuntu 18.04.5 LTS" 2021-02-13T17:44:38.592 INFO:teuthology.orchestra.run.gibba036.stdout:VERSION_ID="18.04" 2021-02-13T17:44:38.592 INFO:teuthology.orchestra.run.gibba036.stdout:HOME_URL="https://www.ubuntu.com/" 2021-02-13T17:44:38.592 INFO:teuthology.orchestra.run.gibba036.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-02-13T17:44:38.592 INFO:teuthology.orchestra.run.gibba036.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-02-13T17:44:38.592 INFO:teuthology.orchestra.run.gibba036.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-02-13T17:44:38.592 INFO:teuthology.orchestra.run.gibba036.stdout:VERSION_CODENAME=bionic 2021-02-13T17:44:38.592 INFO:teuthology.orchestra.run.gibba036.stdout:UBUNTU_CODENAME=bionic 2021-02-13T17:44:38.593 INFO:teuthology.lock.ops:Updating gibba036.front.sepia.ceph.com on lock server 2021-02-13T17:44:38.608 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2021-02-13T17:44:38.621 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2021-02-13T17:44:38.655 INFO:teuthology.task.internal:Checking for old test directory... 2021-02-13T17:44:38.655 DEBUG:teuthology.orchestra.run.gibba025:> test '!' -e /home/ubuntu/cephtest 2021-02-13T17:44:38.658 DEBUG:teuthology.orchestra.run.gibba036:> test '!' -e /home/ubuntu/cephtest 2021-02-13T17:44:38.662 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2021-02-13T17:44:38.680 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2021-02-13T17:44:38.683 DEBUG:teuthology.orchestra.run.gibba025:> test -z $(ls -A /var/lib/ceph) 2021-02-13T17:44:38.706 DEBUG:teuthology.orchestra.run.gibba036:> test -z $(ls -A /var/lib/ceph) 2021-02-13T17:44:38.718 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2021-02-13T17:44:38.772 INFO:teuthology.run_tasks:Running task kernel... 2021-02-13T17:44:38.791 DEBUG:teuthology.task.kernel:normalized config {'c1.mon.a': {'kdb': True, 'sha1': 'distro'}, 'c1.mgr.x': {'kdb': True, 'sha1': 'distro'}, 'c1.osd.0': {'kdb': True, 'sha1': 'distro'}, 'c1.osd.1': {'kdb': True, 'sha1': 'distro'}, 'c1.osd.2': {'kdb': True, 'sha1': 'distro'}, 'c1.client.0': {'kdb': True, 'sha1': 'distro'}, 'c1.client.1': {'kdb': True, 'sha1': 'distro'}, 'c2.mon.a': {'kdb': True, 'sha1': 'distro'}, 'c2.mgr.x': {'kdb': True, 'sha1': 'distro'}, 'c2.osd.0': {'kdb': True, 'sha1': 'distro'}, 'c2.osd.1': {'kdb': True, 'sha1': 'distro'}, 'c2.osd.2': {'kdb': True, 'sha1': 'distro'}, 'c2.client.0': {'kdb': True, 'sha1': 'distro'}, 'c2.client.1': {'kdb': True, 'sha1': 'distro'}} 2021-02-13T17:44:38.791 INFO:teuthology.task.kernel:config {'c1.mon.a': {'kdb': True, 'sha1': 'distro'}, 'c2.mon.a': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2021-02-13T17:44:38.791 DEBUG:teuthology.orchestra.run.gibba025:> uname -r 2021-02-13T17:44:38.801 INFO:teuthology.orchestra.run.gibba025.stdout:4.15.0-122-generic 2021-02-13T17:44:38.805 INFO:teuthology.task.kernel:Running kernel on gibba025: 4.15.0-122-generic 2021-02-13T17:44:38.805 DEBUG:teuthology.orchestra.run.gibba025:> sudo apt-get clean 2021-02-13T17:44:38.878 DEBUG:teuthology.orchestra.run.gibba025:> sudo apt-get update 2021-02-13T17:44:39.026 INFO:teuthology.orchestra.run.gibba025.stdout:Get:1 http://security.ubuntu.com/ubuntu bionic-security InRelease [88.7 kB] 2021-02-13T17:44:39.145 INFO:teuthology.orchestra.run.gibba025.stdout:Hit:2 http://archive.ubuntu.com/ubuntu bionic InRelease 2021-02-13T17:44:39.191 INFO:teuthology.orchestra.run.gibba025.stdout:Get:3 http://security.ubuntu.com/ubuntu bionic-security/main i386 Packages [916 kB] 2021-02-13T17:44:39.225 INFO:teuthology.orchestra.run.gibba025.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic-updates InRelease [88.7 kB] 2021-02-13T17:44:39.294 INFO:teuthology.orchestra.run.gibba025.stdout:Get:5 http://security.ubuntu.com/ubuntu bionic-security/main amd64 Packages [1,544 kB] 2021-02-13T17:44:39.333 INFO:teuthology.orchestra.run.gibba025.stdout:Get:6 http://security.ubuntu.com/ubuntu bionic-security/main Translation-en [298 kB] 2021-02-13T17:44:39.337 INFO:teuthology.orchestra.run.gibba025.stdout:Get:7 http://security.ubuntu.com/ubuntu bionic-security/restricted amd64 Packages [226 kB] 2021-02-13T17:44:39.337 INFO:teuthology.orchestra.run.gibba025.stdout:Get:8 http://security.ubuntu.com/ubuntu bionic-security/restricted i386 Packages [13.5 kB] 2021-02-13T17:44:39.337 INFO:teuthology.orchestra.run.gibba025.stdout:Get:9 http://security.ubuntu.com/ubuntu bionic-security/restricted Translation-en [29.9 kB] 2021-02-13T17:44:39.338 INFO:teuthology.orchestra.run.gibba025.stdout:Get:10 http://security.ubuntu.com/ubuntu bionic-security/universe amd64 Packages [1,109 kB] 2021-02-13T17:44:39.345 INFO:teuthology.orchestra.run.gibba025.stdout:Get:11 http://security.ubuntu.com/ubuntu bionic-security/universe i386 Packages [975 kB] 2021-02-13T17:44:39.354 INFO:teuthology.orchestra.run.gibba025.stdout:Get:12 http://security.ubuntu.com/ubuntu bionic-security/universe Translation-en [248 kB] 2021-02-13T17:44:39.357 INFO:teuthology.orchestra.run.gibba025.stdout:Get:13 http://security.ubuntu.com/ubuntu bionic-security/multiverse amd64 Packages [26.0 kB] 2021-02-13T17:44:39.357 INFO:teuthology.orchestra.run.gibba025.stdout:Get:14 http://security.ubuntu.com/ubuntu bionic-security/multiverse i386 Packages [9,208 B] 2021-02-13T17:44:39.357 INFO:teuthology.orchestra.run.gibba025.stdout:Get:15 http://security.ubuntu.com/ubuntu bionic-security/multiverse Translation-en [5,272 B] 2021-02-13T17:44:39.501 INFO:teuthology.orchestra.run.gibba025.stdout:Get:16 http://archive.ubuntu.com/ubuntu bionic-backports InRelease [74.6 kB] 2021-02-13T17:44:39.592 INFO:teuthology.orchestra.run.gibba025.stdout:Get:17 http://archive.ubuntu.com/ubuntu bionic-updates/main i386 Packages [1,220 kB] 2021-02-13T17:44:39.856 INFO:teuthology.orchestra.run.gibba025.stdout:Get:18 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 Packages [1,884 kB] 2021-02-13T17:44:39.961 INFO:teuthology.orchestra.run.gibba025.stdout:Get:19 http://archive.ubuntu.com/ubuntu bionic-updates/main Translation-en [390 kB] 2021-02-13T17:44:39.977 INFO:teuthology.orchestra.run.gibba025.stdout:Get:20 http://archive.ubuntu.com/ubuntu bionic-updates/restricted i386 Packages [20.2 kB] 2021-02-13T17:44:39.977 INFO:teuthology.orchestra.run.gibba025.stdout:Get:21 http://archive.ubuntu.com/ubuntu bionic-updates/restricted amd64 Packages [247 kB] 2021-02-13T17:44:39.986 INFO:teuthology.orchestra.run.gibba025.stdout:Get:22 http://archive.ubuntu.com/ubuntu bionic-updates/restricted Translation-en [33.4 kB] 2021-02-13T17:44:39.987 INFO:teuthology.orchestra.run.gibba025.stdout:Get:23 http://archive.ubuntu.com/ubuntu bionic-updates/universe i386 Packages [1,560 kB] 2021-02-13T17:44:40.025 INFO:teuthology.orchestra.run.gibba025.stdout:Get:24 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 Packages [1,718 kB] 2021-02-13T17:44:40.082 INFO:teuthology.orchestra.run.gibba025.stdout:Get:25 http://archive.ubuntu.com/ubuntu bionic-updates/universe Translation-en [363 kB] 2021-02-13T17:44:40.087 INFO:teuthology.orchestra.run.gibba025.stdout:Get:26 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse i386 Packages [14.3 kB] 2021-02-13T17:44:40.087 INFO:teuthology.orchestra.run.gibba025.stdout:Get:27 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse amd64 Packages [31.8 kB] 2021-02-13T17:44:40.087 INFO:teuthology.orchestra.run.gibba025.stdout:Get:28 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse Translation-en [7,300 B] 2021-02-13T17:44:40.755 INFO:teuthology.orchestra.run.gibba025.stdout:Fetched 13.1 MB in 2s (7,876 kB/s) 2021-02-13T17:44:41.833 INFO:teuthology.orchestra.run.gibba025.stdout:Reading package lists... 2021-02-13T17:44:41.859 DEBUG:teuthology.orchestra.run.gibba025:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2021-02-13T17:44:41.909 INFO:teuthology.orchestra.run.gibba025.stdout:Reading package lists... 2021-02-13T17:44:42.104 INFO:teuthology.orchestra.run.gibba025.stdout:Building dependency tree... 2021-02-13T17:44:42.105 INFO:teuthology.orchestra.run.gibba025.stdout:Reading state information... 2021-02-13T17:44:42.163 INFO:teuthology.orchestra.run.gibba025.stderr:E: Unable to locate package linux-image-current-generic 2021-02-13T17:44:42.164 DEBUG:teuthology.orchestra.run:got remote process result: 100 2021-02-13T17:44:42.164 DEBUG:teuthology.orchestra.run.gibba025:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-02-13T17:44:42.249 INFO:teuthology.orchestra.run.gibba025.stdout:Reading package lists... 2021-02-13T17:44:42.415 INFO:teuthology.orchestra.run.gibba025.stdout:Building dependency tree... 2021-02-13T17:44:42.415 INFO:teuthology.orchestra.run.gibba025.stdout:Reading state information... 2021-02-13T17:44:42.517 INFO:teuthology.orchestra.run.gibba025.stdout:The following additional packages will be installed: 2021-02-13T17:44:42.517 INFO:teuthology.orchestra.run.gibba025.stdout: linux-generic linux-headers-4.15.0-135 linux-headers-4.15.0-135-generic 2021-02-13T17:44:42.517 INFO:teuthology.orchestra.run.gibba025.stdout: linux-headers-generic linux-image-4.15.0-135-generic 2021-02-13T17:44:42.517 INFO:teuthology.orchestra.run.gibba025.stdout: linux-modules-4.15.0-135-generic linux-modules-extra-4.15.0-135-generic 2021-02-13T17:44:42.517 INFO:teuthology.orchestra.run.gibba025.stdout:Suggested packages: 2021-02-13T17:44:42.517 INFO:teuthology.orchestra.run.gibba025.stdout: fdutils linux-doc-4.15.0 | linux-source-4.15.0 linux-tools 2021-02-13T17:44:42.518 INFO:teuthology.orchestra.run.gibba025.stdout:Recommended packages: 2021-02-13T17:44:42.518 INFO:teuthology.orchestra.run.gibba025.stdout: thermald 2021-02-13T17:44:42.533 INFO:teuthology.orchestra.run.gibba025.stdout:The following NEW packages will be installed: 2021-02-13T17:44:42.533 INFO:teuthology.orchestra.run.gibba025.stdout: linux-headers-4.15.0-135 linux-headers-4.15.0-135-generic 2021-02-13T17:44:42.533 INFO:teuthology.orchestra.run.gibba025.stdout: linux-image-4.15.0-135-generic linux-modules-4.15.0-135-generic 2021-02-13T17:44:42.533 INFO:teuthology.orchestra.run.gibba025.stdout: linux-modules-extra-4.15.0-135-generic 2021-02-13T17:44:42.534 INFO:teuthology.orchestra.run.gibba025.stdout:The following packages will be upgraded: 2021-02-13T17:44:42.534 INFO:teuthology.orchestra.run.gibba025.stdout: linux-generic linux-headers-generic linux-image-generic 2021-02-13T17:44:42.698 INFO:teuthology.orchestra.run.gibba025.stdout:3 upgraded, 5 newly installed, 0 to remove and 88 not upgraded. 2021-02-13T17:44:42.698 INFO:teuthology.orchestra.run.gibba025.stdout:Need to get 66.0 MB of archives. 2021-02-13T17:44:42.698 INFO:teuthology.orchestra.run.gibba025.stdout:After this operation, 334 MB of additional disk space will be used. 2021-02-13T17:44:42.699 INFO:teuthology.orchestra.run.gibba025.stdout:Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-modules-4.15.0-135-generic amd64 4.15.0-135.139 [13.1 MB] 2021-02-13T17:44:43.707 INFO:teuthology.orchestra.run.gibba025.stdout:Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-image-4.15.0-135-generic amd64 4.15.0-135.139 [8,019 kB] 2021-02-13T17:44:43.935 INFO:teuthology.orchestra.run.gibba025.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-modules-extra-4.15.0-135-generic amd64 4.15.0-135.139 [32.8 MB] 2021-02-13T17:44:44.820 INFO:teuthology.orchestra.run.gibba025.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-generic amd64 4.15.0.135.122 [1,868 B] 2021-02-13T17:44:44.821 INFO:teuthology.orchestra.run.gibba025.stdout:Get:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-image-generic amd64 4.15.0.135.122 [2,592 B] 2021-02-13T17:44:44.821 INFO:teuthology.orchestra.run.gibba025.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-4.15.0-135 all 4.15.0-135.139 [10.9 MB] 2021-02-13T17:44:45.128 INFO:teuthology.orchestra.run.gibba025.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-4.15.0-135-generic amd64 4.15.0-135.139 [1,097 kB] 2021-02-13T17:44:45.138 INFO:teuthology.orchestra.run.gibba025.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-generic amd64 4.15.0.135.122 [2,488 B] 2021-02-13T17:44:45.440 INFO:teuthology.orchestra.run.gibba025.stdout:Fetched 66.0 MB in 3s (25.4 MB/s) 2021-02-13T17:44:45.553 INFO:teuthology.orchestra.run.gibba025.stdout:Selecting previously unselected package linux-modules-4.15.0-135-generic. 2021-02-13T17:44:45.569 INFO:teuthology.orchestra.run.gibba025.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 102071 files and directories currently installed.) 2021-02-13T17:44:45.571 INFO:teuthology.orchestra.run.gibba025.stdout:Preparing to unpack .../0-linux-modules-4.15.0-135-generic_4.15.0-135.139_amd64.deb ... 2021-02-13T17:44:45.609 INFO:teuthology.orchestra.run.gibba025.stdout:Unpacking linux-modules-4.15.0-135-generic (4.15.0-135.139) ... 2021-02-13T17:44:46.875 INFO:teuthology.orchestra.run.gibba025.stdout:Selecting previously unselected package linux-image-4.15.0-135-generic. 2021-02-13T17:44:46.878 INFO:teuthology.orchestra.run.gibba025.stdout:Preparing to unpack .../1-linux-image-4.15.0-135-generic_4.15.0-135.139_amd64.deb ... 2021-02-13T17:44:46.950 INFO:teuthology.orchestra.run.gibba025.stdout:Unpacking linux-image-4.15.0-135-generic (4.15.0-135.139) ... 2021-02-13T17:44:47.388 INFO:teuthology.orchestra.run.gibba025.stdout:Selecting previously unselected package linux-modules-extra-4.15.0-135-generic. 2021-02-13T17:44:47.391 INFO:teuthology.orchestra.run.gibba025.stdout:Preparing to unpack .../2-linux-modules-extra-4.15.0-135-generic_4.15.0-135.139_amd64.deb ... 2021-02-13T17:44:47.430 INFO:teuthology.orchestra.run.gibba025.stdout:Unpacking linux-modules-extra-4.15.0-135-generic (4.15.0-135.139) ... 2021-02-13T17:44:49.850 INFO:teuthology.orchestra.run.gibba025.stdout:Preparing to unpack .../3-linux-generic_4.15.0.135.122_amd64.deb ... 2021-02-13T17:44:49.963 INFO:teuthology.orchestra.run.gibba025.stdout:Unpacking linux-generic (4.15.0.135.122) over (4.15.0.122.109) ... 2021-02-13T17:44:50.244 INFO:teuthology.orchestra.run.gibba025.stdout:Preparing to unpack .../4-linux-image-generic_4.15.0.135.122_amd64.deb ... 2021-02-13T17:44:50.367 INFO:teuthology.orchestra.run.gibba025.stdout:Unpacking linux-image-generic (4.15.0.135.122) over (4.15.0.122.109) ... 2021-02-13T17:44:50.678 INFO:teuthology.orchestra.run.gibba025.stdout:Selecting previously unselected package linux-headers-4.15.0-135. 2021-02-13T17:44:50.681 INFO:teuthology.orchestra.run.gibba025.stdout:Preparing to unpack .../5-linux-headers-4.15.0-135_4.15.0-135.139_all.deb ... 2021-02-13T17:44:50.720 INFO:teuthology.orchestra.run.gibba025.stdout:Unpacking linux-headers-4.15.0-135 (4.15.0-135.139) ... 2021-02-13T17:44:53.073 INFO:teuthology.orchestra.run.gibba025.stdout:Selecting previously unselected package linux-headers-4.15.0-135-generic. 2021-02-13T17:44:53.081 INFO:teuthology.orchestra.run.gibba025.stdout:Preparing to unpack .../6-linux-headers-4.15.0-135-generic_4.15.0-135.139_amd64.deb ... 2021-02-13T17:44:53.123 INFO:teuthology.orchestra.run.gibba025.stdout:Unpacking linux-headers-4.15.0-135-generic (4.15.0-135.139) ... 2021-02-13T17:44:54.437 INFO:teuthology.orchestra.run.gibba025.stdout:Preparing to unpack .../7-linux-headers-generic_4.15.0.135.122_amd64.deb ... 2021-02-13T17:44:54.564 INFO:teuthology.orchestra.run.gibba025.stdout:Unpacking linux-headers-generic (4.15.0.135.122) over (4.15.0.122.109) ... 2021-02-13T17:44:54.835 INFO:teuthology.orchestra.run.gibba025.stdout:Setting up linux-modules-4.15.0-135-generic (4.15.0-135.139) ... 2021-02-13T17:44:55.227 INFO:teuthology.orchestra.run.gibba025.stdout:Setting up linux-headers-4.15.0-135 (4.15.0-135.139) ... 2021-02-13T17:44:55.353 INFO:teuthology.orchestra.run.gibba025.stdout:Setting up linux-image-4.15.0-135-generic (4.15.0-135.139) ... 2021-02-13T17:44:55.696 INFO:teuthology.orchestra.run.gibba025.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-4.15.0-135-generic 2021-02-13T17:44:55.697 INFO:teuthology.orchestra.run.gibba025.stdout:I: /initrd.img is now a symlink to boot/initrd.img-4.15.0-135-generic 2021-02-13T17:44:55.830 INFO:teuthology.orchestra.run.gibba025.stdout:Setting up linux-modules-extra-4.15.0-135-generic (4.15.0-135.139) ... 2021-02-13T17:44:56.189 INFO:teuthology.orchestra.run.gibba025.stdout:Setting up linux-headers-4.15.0-135-generic (4.15.0-135.139) ... 2021-02-13T17:44:56.307 INFO:teuthology.orchestra.run.gibba025.stdout:Setting up linux-image-generic (4.15.0.135.122) ... 2021-02-13T17:44:56.425 INFO:teuthology.orchestra.run.gibba025.stdout:Setting up linux-headers-generic (4.15.0.135.122) ... 2021-02-13T17:44:56.526 INFO:teuthology.orchestra.run.gibba025.stdout:Setting up linux-generic (4.15.0.135.122) ... 2021-02-13T17:44:56.627 INFO:teuthology.orchestra.run.gibba025.stdout:Processing triggers for linux-image-4.15.0-135-generic (4.15.0-135.139) ... 2021-02-13T17:44:56.754 INFO:teuthology.orchestra.run.gibba025.stdout:/etc/kernel/postinst.d/initramfs-tools: 2021-02-13T17:44:56.754 INFO:teuthology.orchestra.run.gibba025.stdout:update-initramfs: Generating /boot/initrd.img-4.15.0-135-generic 2021-02-13T17:45:05.839 INFO:teuthology.orchestra.run.gibba025.stdout:/etc/kernel/postinst.d/zz-update-grub: 2021-02-13T17:45:05.839 INFO:teuthology.orchestra.run.gibba025.stdout:Sourcing file `/etc/default/grub' 2021-02-13T17:45:05.898 INFO:teuthology.orchestra.run.gibba025.stdout:Generating grub configuration file ... 2021-02-13T17:45:06.289 INFO:teuthology.orchestra.run.gibba025.stdout:Found linux image: /boot/vmlinuz-4.15.0-135-generic 2021-02-13T17:45:06.325 INFO:teuthology.orchestra.run.gibba025.stdout:Found initrd image: /boot/initrd.img-4.15.0-135-generic 2021-02-13T17:45:06.809 INFO:teuthology.orchestra.run.gibba025.stdout:Found linux image: /boot/vmlinuz-4.15.0-122-generic 2021-02-13T17:45:06.841 INFO:teuthology.orchestra.run.gibba025.stdout:Found initrd image: /boot/initrd.img-4.15.0-122-generic 2021-02-13T17:45:07.813 INFO:teuthology.orchestra.run.gibba025.stdout:done 2021-02-13T17:45:08.114 DEBUG:teuthology.orchestra.run.gibba025:> dpkg -s linux-image-generic 2021-02-13T17:45:08.126 INFO:teuthology.orchestra.run.gibba025.stdout:Package: linux-image-generic 2021-02-13T17:45:08.126 INFO:teuthology.orchestra.run.gibba025.stdout:Status: install ok installed 2021-02-13T17:45:08.126 INFO:teuthology.orchestra.run.gibba025.stdout:Priority: optional 2021-02-13T17:45:08.126 INFO:teuthology.orchestra.run.gibba025.stdout:Section: kernel 2021-02-13T17:45:08.126 INFO:teuthology.orchestra.run.gibba025.stdout:Installed-Size: 17 2021-02-13T17:45:08.126 INFO:teuthology.orchestra.run.gibba025.stdout:Maintainer: Ubuntu Kernel Team 2021-02-13T17:45:08.127 INFO:teuthology.orchestra.run.gibba025.stdout:Architecture: amd64 2021-02-13T17:45:08.127 INFO:teuthology.orchestra.run.gibba025.stdout:Source: linux-meta 2021-02-13T17:45:08.127 INFO:teuthology.orchestra.run.gibba025.stdout:Version: 4.15.0.135.122 2021-02-13T17:45:08.127 INFO:teuthology.orchestra.run.gibba025.stdout:Provides: wireguard-modules (= 1.0.20201112-1~18.04.1), zfs-modules (= 0.7.5-1ubuntu16.10) 2021-02-13T17:45:08.127 INFO:teuthology.orchestra.run.gibba025.stdout:Depends: linux-image-4.15.0-135-generic, linux-modules-extra-4.15.0-135-generic, linux-firmware, intel-microcode, amd64-microcode 2021-02-13T17:45:08.127 INFO:teuthology.orchestra.run.gibba025.stdout:Recommends: thermald 2021-02-13T17:45:08.127 INFO:teuthology.orchestra.run.gibba025.stdout:Description: Generic Linux kernel image 2021-02-13T17:45:08.127 INFO:teuthology.orchestra.run.gibba025.stdout: This package will always depend on the latest generic kernel image 2021-02-13T17:45:08.127 INFO:teuthology.orchestra.run.gibba025.stdout: available. 2021-02-13T17:45:08.127 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.15.0-122-generic Expected: 4.15.0-135-generic 2021-02-13T17:45:08.128 DEBUG:teuthology.orchestra.run.gibba036:> uname -r 2021-02-13T17:45:08.135 INFO:teuthology.orchestra.run.gibba036.stdout:4.15.0-122-generic 2021-02-13T17:45:08.136 INFO:teuthology.task.kernel:Running kernel on gibba036: 4.15.0-122-generic 2021-02-13T17:45:08.136 DEBUG:teuthology.orchestra.run.gibba036:> sudo apt-get clean 2021-02-13T17:45:08.219 DEBUG:teuthology.orchestra.run.gibba036:> sudo apt-get update 2021-02-13T17:45:08.497 INFO:teuthology.orchestra.run.gibba036.stdout:Get:1 http://security.ubuntu.com/ubuntu bionic-security InRelease [88.7 kB] 2021-02-13T17:45:08.518 INFO:teuthology.orchestra.run.gibba036.stdout:Hit:2 http://archive.ubuntu.com/ubuntu bionic InRelease 2021-02-13T17:45:08.580 INFO:teuthology.orchestra.run.gibba036.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic-updates InRelease [88.7 kB] 2021-02-13T17:45:08.810 INFO:teuthology.orchestra.run.gibba036.stdout:Get:4 http://security.ubuntu.com/ubuntu bionic-security/main amd64 Packages [1,544 kB] 2021-02-13T17:45:08.889 INFO:teuthology.orchestra.run.gibba036.stdout:Get:5 http://archive.ubuntu.com/ubuntu bionic-backports InRelease [74.6 kB] 2021-02-13T17:45:08.987 INFO:teuthology.orchestra.run.gibba036.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 Packages [1,884 kB] 2021-02-13T17:45:09.238 INFO:teuthology.orchestra.run.gibba036.stdout:Get:7 http://security.ubuntu.com/ubuntu bionic-security/main i386 Packages [916 kB] 2021-02-13T17:45:09.258 INFO:teuthology.orchestra.run.gibba036.stdout:Get:8 http://security.ubuntu.com/ubuntu bionic-security/main Translation-en [298 kB] 2021-02-13T17:45:09.263 INFO:teuthology.orchestra.run.gibba036.stdout:Get:9 http://security.ubuntu.com/ubuntu bionic-security/restricted i386 Packages [13.5 kB] 2021-02-13T17:45:09.264 INFO:teuthology.orchestra.run.gibba036.stdout:Get:10 http://security.ubuntu.com/ubuntu bionic-security/restricted amd64 Packages [226 kB] 2021-02-13T17:45:09.268 INFO:teuthology.orchestra.run.gibba036.stdout:Get:11 http://security.ubuntu.com/ubuntu bionic-security/restricted Translation-en [29.9 kB] 2021-02-13T17:45:09.268 INFO:teuthology.orchestra.run.gibba036.stdout:Get:12 http://security.ubuntu.com/ubuntu bionic-security/universe amd64 Packages [1,109 kB] 2021-02-13T17:45:09.306 INFO:teuthology.orchestra.run.gibba036.stdout:Get:13 http://archive.ubuntu.com/ubuntu bionic-updates/main i386 Packages [1,220 kB] 2021-02-13T17:45:09.337 INFO:teuthology.orchestra.run.gibba036.stdout:Get:14 http://security.ubuntu.com/ubuntu bionic-security/universe i386 Packages [975 kB] 2021-02-13T17:45:09.357 INFO:teuthology.orchestra.run.gibba036.stdout:Get:15 http://archive.ubuntu.com/ubuntu bionic-updates/main Translation-en [390 kB] 2021-02-13T17:45:09.362 INFO:teuthology.orchestra.run.gibba036.stdout:Get:16 http://security.ubuntu.com/ubuntu bionic-security/universe Translation-en [248 kB] 2021-02-13T17:45:09.373 INFO:teuthology.orchestra.run.gibba036.stdout:Get:17 http://archive.ubuntu.com/ubuntu bionic-updates/restricted i386 Packages [20.2 kB] 2021-02-13T17:45:09.374 INFO:teuthology.orchestra.run.gibba036.stdout:Get:18 http://archive.ubuntu.com/ubuntu bionic-updates/restricted amd64 Packages [247 kB] 2021-02-13T17:45:09.377 INFO:teuthology.orchestra.run.gibba036.stdout:Get:19 http://security.ubuntu.com/ubuntu bionic-security/multiverse i386 Packages [9,208 B] 2021-02-13T17:45:09.378 INFO:teuthology.orchestra.run.gibba036.stdout:Get:20 http://security.ubuntu.com/ubuntu bionic-security/multiverse amd64 Packages [26.0 kB] 2021-02-13T17:45:09.379 INFO:teuthology.orchestra.run.gibba036.stdout:Get:21 http://security.ubuntu.com/ubuntu bionic-security/multiverse Translation-en [5,272 B] 2021-02-13T17:45:09.383 INFO:teuthology.orchestra.run.gibba036.stdout:Get:22 http://archive.ubuntu.com/ubuntu bionic-updates/restricted Translation-en [33.4 kB] 2021-02-13T17:45:09.385 INFO:teuthology.orchestra.run.gibba036.stdout:Get:23 http://archive.ubuntu.com/ubuntu bionic-updates/universe i386 Packages [1,560 kB] 2021-02-13T17:45:09.422 INFO:teuthology.orchestra.run.gibba036.stdout:Get:24 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 Packages [1,718 kB] 2021-02-13T17:45:09.472 INFO:teuthology.orchestra.run.gibba036.stdout:Get:25 http://archive.ubuntu.com/ubuntu bionic-updates/universe Translation-en [363 kB] 2021-02-13T17:45:09.490 INFO:teuthology.orchestra.run.gibba036.stdout:Get:26 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse i386 Packages [14.3 kB] 2021-02-13T17:45:09.490 INFO:teuthology.orchestra.run.gibba036.stdout:Get:27 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse amd64 Packages [31.8 kB] 2021-02-13T17:45:09.490 INFO:teuthology.orchestra.run.gibba036.stdout:Get:28 http://archive.ubuntu.com/ubuntu bionic-updates/multiverse Translation-en [7,300 B] 2021-02-13T17:45:10.561 INFO:teuthology.orchestra.run.gibba036.stdout:Fetched 13.1 MB in 2s (6,228 kB/s) 2021-02-13T17:45:11.723 INFO:teuthology.orchestra.run.gibba036.stdout:Reading package lists... 2021-02-13T17:45:11.748 DEBUG:teuthology.orchestra.run.gibba036:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2021-02-13T17:45:11.793 INFO:teuthology.orchestra.run.gibba036.stdout:Reading package lists... 2021-02-13T17:45:11.960 INFO:teuthology.orchestra.run.gibba036.stdout:Building dependency tree... 2021-02-13T17:45:11.961 INFO:teuthology.orchestra.run.gibba036.stdout:Reading state information... 2021-02-13T17:45:12.010 INFO:teuthology.orchestra.run.gibba036.stderr:E: Unable to locate package linux-image-current-generic 2021-02-13T17:45:12.011 DEBUG:teuthology.orchestra.run:got remote process result: 100 2021-02-13T17:45:12.012 DEBUG:teuthology.orchestra.run.gibba036:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-02-13T17:45:12.100 INFO:teuthology.orchestra.run.gibba036.stdout:Reading package lists... 2021-02-13T17:45:12.267 INFO:teuthology.orchestra.run.gibba036.stdout:Building dependency tree... 2021-02-13T17:45:12.267 INFO:teuthology.orchestra.run.gibba036.stdout:Reading state information... 2021-02-13T17:45:12.371 INFO:teuthology.orchestra.run.gibba036.stdout:The following additional packages will be installed: 2021-02-13T17:45:12.371 INFO:teuthology.orchestra.run.gibba036.stdout: linux-generic linux-headers-4.15.0-135 linux-headers-4.15.0-135-generic 2021-02-13T17:45:12.371 INFO:teuthology.orchestra.run.gibba036.stdout: linux-headers-generic linux-image-4.15.0-135-generic 2021-02-13T17:45:12.371 INFO:teuthology.orchestra.run.gibba036.stdout: linux-modules-4.15.0-135-generic linux-modules-extra-4.15.0-135-generic 2021-02-13T17:45:12.372 INFO:teuthology.orchestra.run.gibba036.stdout:Suggested packages: 2021-02-13T17:45:12.372 INFO:teuthology.orchestra.run.gibba036.stdout: fdutils linux-doc-4.15.0 | linux-source-4.15.0 linux-tools 2021-02-13T17:45:12.372 INFO:teuthology.orchestra.run.gibba036.stdout:Recommended packages: 2021-02-13T17:45:12.372 INFO:teuthology.orchestra.run.gibba036.stdout: thermald 2021-02-13T17:45:12.387 INFO:teuthology.orchestra.run.gibba036.stdout:The following NEW packages will be installed: 2021-02-13T17:45:12.387 INFO:teuthology.orchestra.run.gibba036.stdout: linux-headers-4.15.0-135 linux-headers-4.15.0-135-generic 2021-02-13T17:45:12.387 INFO:teuthology.orchestra.run.gibba036.stdout: linux-image-4.15.0-135-generic linux-modules-4.15.0-135-generic 2021-02-13T17:45:12.387 INFO:teuthology.orchestra.run.gibba036.stdout: linux-modules-extra-4.15.0-135-generic 2021-02-13T17:45:12.388 INFO:teuthology.orchestra.run.gibba036.stdout:The following packages will be upgraded: 2021-02-13T17:45:12.388 INFO:teuthology.orchestra.run.gibba036.stdout: linux-generic linux-headers-generic linux-image-generic 2021-02-13T17:45:12.556 INFO:teuthology.orchestra.run.gibba036.stdout:3 upgraded, 5 newly installed, 0 to remove and 88 not upgraded. 2021-02-13T17:45:12.556 INFO:teuthology.orchestra.run.gibba036.stdout:Need to get 66.0 MB of archives. 2021-02-13T17:45:12.556 INFO:teuthology.orchestra.run.gibba036.stdout:After this operation, 334 MB of additional disk space will be used. 2021-02-13T17:45:12.556 INFO:teuthology.orchestra.run.gibba036.stdout:Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-modules-4.15.0-135-generic amd64 4.15.0-135.139 [13.1 MB] 2021-02-13T17:45:13.561 INFO:teuthology.orchestra.run.gibba036.stdout:Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-image-4.15.0-135-generic amd64 4.15.0-135.139 [8,019 kB] 2021-02-13T17:45:13.788 INFO:teuthology.orchestra.run.gibba036.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-modules-extra-4.15.0-135-generic amd64 4.15.0-135.139 [32.8 MB] 2021-02-13T17:45:14.687 INFO:teuthology.orchestra.run.gibba036.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-generic amd64 4.15.0.135.122 [1,868 B] 2021-02-13T17:45:14.687 INFO:teuthology.orchestra.run.gibba036.stdout:Get:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-image-generic amd64 4.15.0.135.122 [2,592 B] 2021-02-13T17:45:14.687 INFO:teuthology.orchestra.run.gibba036.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-4.15.0-135 all 4.15.0-135.139 [10.9 MB] 2021-02-13T17:45:15.018 INFO:teuthology.orchestra.run.gibba036.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-4.15.0-135-generic amd64 4.15.0-135.139 [1,097 kB] 2021-02-13T17:45:15.037 INFO:teuthology.orchestra.run.gibba036.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 linux-headers-generic amd64 4.15.0.135.122 [2,488 B] 2021-02-13T17:45:15.357 INFO:teuthology.orchestra.run.gibba036.stdout:Fetched 66.0 MB in 3s (25.0 MB/s) 2021-02-13T17:45:15.508 INFO:teuthology.orchestra.run.gibba036.stdout:Selecting previously unselected package linux-modules-4.15.0-135-generic. 2021-02-13T17:45:15.562 INFO:teuthology.orchestra.run.gibba036.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 102071 files and directories currently installed.) 2021-02-13T17:45:15.564 INFO:teuthology.orchestra.run.gibba036.stdout:Preparing to unpack .../0-linux-modules-4.15.0-135-generic_4.15.0-135.139_amd64.deb ... 2021-02-13T17:45:15.612 INFO:teuthology.orchestra.run.gibba036.stdout:Unpacking linux-modules-4.15.0-135-generic (4.15.0-135.139) ... 2021-02-13T17:45:16.854 INFO:teuthology.orchestra.run.gibba036.stdout:Selecting previously unselected package linux-image-4.15.0-135-generic. 2021-02-13T17:45:16.857 INFO:teuthology.orchestra.run.gibba036.stdout:Preparing to unpack .../1-linux-image-4.15.0-135-generic_4.15.0-135.139_amd64.deb ... 2021-02-13T17:45:16.947 INFO:teuthology.orchestra.run.gibba036.stdout:Unpacking linux-image-4.15.0-135-generic (4.15.0-135.139) ... 2021-02-13T17:45:17.390 INFO:teuthology.orchestra.run.gibba036.stdout:Selecting previously unselected package linux-modules-extra-4.15.0-135-generic. 2021-02-13T17:45:17.393 INFO:teuthology.orchestra.run.gibba036.stdout:Preparing to unpack .../2-linux-modules-extra-4.15.0-135-generic_4.15.0-135.139_amd64.deb ... 2021-02-13T17:45:17.432 INFO:teuthology.orchestra.run.gibba036.stdout:Unpacking linux-modules-extra-4.15.0-135-generic (4.15.0-135.139) ... 2021-02-13T17:45:19.856 INFO:teuthology.orchestra.run.gibba036.stdout:Preparing to unpack .../3-linux-generic_4.15.0.135.122_amd64.deb ... 2021-02-13T17:45:19.977 INFO:teuthology.orchestra.run.gibba036.stdout:Unpacking linux-generic (4.15.0.135.122) over (4.15.0.122.109) ... 2021-02-13T17:45:20.295 INFO:teuthology.orchestra.run.gibba036.stdout:Preparing to unpack .../4-linux-image-generic_4.15.0.135.122_amd64.deb ... 2021-02-13T17:45:20.421 INFO:teuthology.orchestra.run.gibba036.stdout:Unpacking linux-image-generic (4.15.0.135.122) over (4.15.0.122.109) ... 2021-02-13T17:45:20.741 INFO:teuthology.orchestra.run.gibba036.stdout:Selecting previously unselected package linux-headers-4.15.0-135. 2021-02-13T17:45:20.744 INFO:teuthology.orchestra.run.gibba036.stdout:Preparing to unpack .../5-linux-headers-4.15.0-135_4.15.0-135.139_all.deb ... 2021-02-13T17:45:20.783 INFO:teuthology.orchestra.run.gibba036.stdout:Unpacking linux-headers-4.15.0-135 (4.15.0-135.139) ... 2021-02-13T17:45:23.227 INFO:teuthology.orchestra.run.gibba036.stdout:Selecting previously unselected package linux-headers-4.15.0-135-generic. 2021-02-13T17:45:23.234 INFO:teuthology.orchestra.run.gibba036.stdout:Preparing to unpack .../6-linux-headers-4.15.0-135-generic_4.15.0-135.139_amd64.deb ... 2021-02-13T17:45:23.268 INFO:teuthology.orchestra.run.gibba036.stdout:Unpacking linux-headers-4.15.0-135-generic (4.15.0-135.139) ... 2021-02-13T17:45:24.584 INFO:teuthology.orchestra.run.gibba036.stdout:Preparing to unpack .../7-linux-headers-generic_4.15.0.135.122_amd64.deb ... 2021-02-13T17:45:24.710 INFO:teuthology.orchestra.run.gibba036.stdout:Unpacking linux-headers-generic (4.15.0.135.122) over (4.15.0.122.109) ... 2021-02-13T17:45:24.982 INFO:teuthology.orchestra.run.gibba036.stdout:Setting up linux-modules-4.15.0-135-generic (4.15.0-135.139) ... 2021-02-13T17:45:25.389 INFO:teuthology.orchestra.run.gibba036.stdout:Setting up linux-headers-4.15.0-135 (4.15.0-135.139) ... 2021-02-13T17:45:25.514 INFO:teuthology.orchestra.run.gibba036.stdout:Setting up linux-image-4.15.0-135-generic (4.15.0-135.139) ... 2021-02-13T17:45:25.809 INFO:teuthology.orchestra.run.gibba036.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-4.15.0-135-generic 2021-02-13T17:45:25.809 INFO:teuthology.orchestra.run.gibba036.stdout:I: /initrd.img is now a symlink to boot/initrd.img-4.15.0-135-generic 2021-02-13T17:45:25.954 INFO:teuthology.orchestra.run.gibba036.stdout:Setting up linux-modules-extra-4.15.0-135-generic (4.15.0-135.139) ... 2021-02-13T17:45:26.318 INFO:teuthology.orchestra.run.gibba036.stdout:Setting up linux-headers-4.15.0-135-generic (4.15.0-135.139) ... 2021-02-13T17:45:26.444 INFO:teuthology.orchestra.run.gibba036.stdout:Setting up linux-image-generic (4.15.0.135.122) ... 2021-02-13T17:45:26.553 INFO:teuthology.orchestra.run.gibba036.stdout:Setting up linux-headers-generic (4.15.0.135.122) ... 2021-02-13T17:45:26.656 INFO:teuthology.orchestra.run.gibba036.stdout:Setting up linux-generic (4.15.0.135.122) ... 2021-02-13T17:45:26.755 INFO:teuthology.orchestra.run.gibba036.stdout:Processing triggers for linux-image-4.15.0-135-generic (4.15.0-135.139) ... 2021-02-13T17:45:26.881 INFO:teuthology.orchestra.run.gibba036.stdout:/etc/kernel/postinst.d/initramfs-tools: 2021-02-13T17:45:26.882 INFO:teuthology.orchestra.run.gibba036.stdout:update-initramfs: Generating /boot/initrd.img-4.15.0-135-generic 2021-02-13T17:45:35.944 INFO:teuthology.orchestra.run.gibba036.stdout:/etc/kernel/postinst.d/zz-update-grub: 2021-02-13T17:45:35.944 INFO:teuthology.orchestra.run.gibba036.stdout:Sourcing file `/etc/default/grub' 2021-02-13T17:45:35.978 INFO:teuthology.orchestra.run.gibba036.stdout:Generating grub configuration file ... 2021-02-13T17:45:36.368 INFO:teuthology.orchestra.run.gibba036.stdout:Found linux image: /boot/vmlinuz-4.15.0-135-generic 2021-02-13T17:45:36.410 INFO:teuthology.orchestra.run.gibba036.stdout:Found initrd image: /boot/initrd.img-4.15.0-135-generic 2021-02-13T17:45:36.769 INFO:teuthology.orchestra.run.gibba036.stdout:Found linux image: /boot/vmlinuz-4.15.0-122-generic 2021-02-13T17:45:36.807 INFO:teuthology.orchestra.run.gibba036.stdout:Found initrd image: /boot/initrd.img-4.15.0-122-generic 2021-02-13T17:45:37.889 INFO:teuthology.orchestra.run.gibba036.stdout:done 2021-02-13T17:45:38.215 DEBUG:teuthology.orchestra.run.gibba036:> dpkg -s linux-image-generic 2021-02-13T17:45:38.267 INFO:teuthology.orchestra.run.gibba036.stdout:Package: linux-image-generic 2021-02-13T17:45:38.267 INFO:teuthology.orchestra.run.gibba036.stdout:Status: install ok installed 2021-02-13T17:45:38.267 INFO:teuthology.orchestra.run.gibba036.stdout:Priority: optional 2021-02-13T17:45:38.267 INFO:teuthology.orchestra.run.gibba036.stdout:Section: kernel 2021-02-13T17:45:38.267 INFO:teuthology.orchestra.run.gibba036.stdout:Installed-Size: 17 2021-02-13T17:45:38.267 INFO:teuthology.orchestra.run.gibba036.stdout:Maintainer: Ubuntu Kernel Team 2021-02-13T17:45:38.267 INFO:teuthology.orchestra.run.gibba036.stdout:Architecture: amd64 2021-02-13T17:45:38.267 INFO:teuthology.orchestra.run.gibba036.stdout:Source: linux-meta 2021-02-13T17:45:38.267 INFO:teuthology.orchestra.run.gibba036.stdout:Version: 4.15.0.135.122 2021-02-13T17:45:38.267 INFO:teuthology.orchestra.run.gibba036.stdout:Provides: wireguard-modules (= 1.0.20201112-1~18.04.1), zfs-modules (= 0.7.5-1ubuntu16.10) 2021-02-13T17:45:38.267 INFO:teuthology.orchestra.run.gibba036.stdout:Depends: linux-image-4.15.0-135-generic, linux-modules-extra-4.15.0-135-generic, linux-firmware, intel-microcode, amd64-microcode 2021-02-13T17:45:38.267 INFO:teuthology.orchestra.run.gibba036.stdout:Recommends: thermald 2021-02-13T17:45:38.268 INFO:teuthology.orchestra.run.gibba036.stdout:Description: Generic Linux kernel image 2021-02-13T17:45:38.268 INFO:teuthology.orchestra.run.gibba036.stdout: This package will always depend on the latest generic kernel image 2021-02-13T17:45:38.268 INFO:teuthology.orchestra.run.gibba036.stdout: available. 2021-02-13T17:45:38.268 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.15.0-122-generic Expected: 4.15.0-135-generic 2021-02-13T17:45:38.268 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2021-02-13T17:45:38.268 DEBUG:teuthology.task.kernel:src is distro, skipping download 2021-02-13T17:45:38.268 DEBUG:teuthology.task.kernel:src is distro, skipping download 2021-02-13T17:45:38.268 INFO:teuthology.task.kernel:Installing distro kernel on c1.mon.a... 2021-02-13T17:45:38.269 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@gibba025.front.sepia.ceph.com, path=None, version=distro) 2021-02-13T17:45:38.269 DEBUG:teuthology.orchestra.run.gibba025:> sudo apt-get clean 2021-02-13T17:45:38.297 DEBUG:teuthology.orchestra.run.gibba025:> sudo apt-get update 2021-02-13T17:45:38.554 INFO:teuthology.orchestra.run.gibba025.stdout:Hit:1 http://archive.ubuntu.com/ubuntu bionic InRelease 2021-02-13T17:45:38.554 INFO:teuthology.orchestra.run.gibba025.stdout:Hit:2 http://security.ubuntu.com/ubuntu bionic-security InRelease 2021-02-13T17:45:38.629 INFO:teuthology.orchestra.run.gibba025.stdout:Hit:3 http://archive.ubuntu.com/ubuntu bionic-updates InRelease 2021-02-13T17:45:38.707 INFO:teuthology.orchestra.run.gibba025.stdout:Hit:4 http://archive.ubuntu.com/ubuntu bionic-backports InRelease 2021-02-13T17:45:39.675 INFO:teuthology.orchestra.run.gibba025.stdout:Reading package lists... 2021-02-13T17:45:39.701 DEBUG:teuthology.orchestra.run.gibba025:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2021-02-13T17:45:39.746 INFO:teuthology.orchestra.run.gibba025.stdout:Reading package lists... 2021-02-13T17:45:39.910 INFO:teuthology.orchestra.run.gibba025.stdout:Building dependency tree... 2021-02-13T17:45:39.910 INFO:teuthology.orchestra.run.gibba025.stdout:Reading state information... 2021-02-13T17:45:39.970 INFO:teuthology.orchestra.run.gibba025.stderr:E: Unable to locate package linux-image-current-generic 2021-02-13T17:45:39.971 DEBUG:teuthology.orchestra.run:got remote process result: 100 2021-02-13T17:45:39.972 DEBUG:teuthology.orchestra.run.gibba025:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-02-13T17:45:40.059 INFO:teuthology.orchestra.run.gibba025.stdout:Reading package lists... 2021-02-13T17:45:40.222 INFO:teuthology.orchestra.run.gibba025.stdout:Building dependency tree... 2021-02-13T17:45:40.222 INFO:teuthology.orchestra.run.gibba025.stdout:Reading state information... 2021-02-13T17:45:40.332 INFO:teuthology.orchestra.run.gibba025.stdout:linux-image-generic is already the newest version (4.15.0.135.122). 2021-02-13T17:45:40.332 INFO:teuthology.orchestra.run.gibba025.stdout:0 upgraded, 0 newly installed, 0 to remove and 88 not upgraded. 2021-02-13T17:45:40.333 DEBUG:teuthology.orchestra.run.gibba025:> dpkg -s linux-image-generic 2021-02-13T17:45:40.385 INFO:teuthology.orchestra.run.gibba025.stdout:Package: linux-image-generic 2021-02-13T17:45:40.385 INFO:teuthology.orchestra.run.gibba025.stdout:Status: install ok installed 2021-02-13T17:45:40.385 INFO:teuthology.orchestra.run.gibba025.stdout:Priority: optional 2021-02-13T17:45:40.385 INFO:teuthology.orchestra.run.gibba025.stdout:Section: kernel 2021-02-13T17:45:40.386 INFO:teuthology.orchestra.run.gibba025.stdout:Installed-Size: 17 2021-02-13T17:45:40.386 INFO:teuthology.orchestra.run.gibba025.stdout:Maintainer: Ubuntu Kernel Team 2021-02-13T17:45:40.386 INFO:teuthology.orchestra.run.gibba025.stdout:Architecture: amd64 2021-02-13T17:45:40.386 INFO:teuthology.orchestra.run.gibba025.stdout:Source: linux-meta 2021-02-13T17:45:40.386 INFO:teuthology.orchestra.run.gibba025.stdout:Version: 4.15.0.135.122 2021-02-13T17:45:40.386 INFO:teuthology.orchestra.run.gibba025.stdout:Provides: wireguard-modules (= 1.0.20201112-1~18.04.1), zfs-modules (= 0.7.5-1ubuntu16.10) 2021-02-13T17:45:40.386 INFO:teuthology.orchestra.run.gibba025.stdout:Depends: linux-image-4.15.0-135-generic, linux-modules-extra-4.15.0-135-generic, linux-firmware, intel-microcode, amd64-microcode 2021-02-13T17:45:40.386 INFO:teuthology.orchestra.run.gibba025.stdout:Recommends: thermald 2021-02-13T17:45:40.386 INFO:teuthology.orchestra.run.gibba025.stdout:Description: Generic Linux kernel image 2021-02-13T17:45:40.386 INFO:teuthology.orchestra.run.gibba025.stdout: This package will always depend on the latest generic kernel image 2021-02-13T17:45:40.386 INFO:teuthology.orchestra.run.gibba025.stdout: available. 2021-02-13T17:45:40.387 DEBUG:teuthology.orchestra.run.gibba025:> mktemp 2021-02-13T17:45:40.428 INFO:teuthology.orchestra.run.gibba025.stdout:/tmp/tmp.PJwWno4LXs 2021-02-13T17:45:40.429 DEBUG:teuthology.orchestra.run.gibba025:> sudo cp /boot/grub/grub.cfg /tmp/tmp.PJwWno4LXs 2021-02-13T17:45:40.475 DEBUG:teuthology.orchestra.run.gibba025:> sudo chmod 0666 /tmp/tmp.PJwWno4LXs 2021-02-13T17:45:40.572 DEBUG:teuthology.orchestra.remote:gibba025:/tmp/tmp.PJwWno4LXs is 8KB 2021-02-13T17:45:40.621 DEBUG:teuthology.orchestra.run.gibba025:> rm -fr /tmp/tmp.PJwWno4LXs 2021-02-13T17:45:40.627 DEBUG:teuthology.orchestra.run.gibba025:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2021-02-13T17:45:40.671 DEBUG:teuthology.orchestra.run.gibba025:> set -ex 2021-02-13T17:45:40.671 DEBUG:teuthology.orchestra.run.gibba025:> sudo dd of=/etc/grub.d/01_ceph_kernel 2021-02-13T17:45:40.671 DEBUG:teuthology.orchestra.run.gibba025:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2021-02-13T17:45:40.772 INFO:teuthology.task.kernel:Distro Kernel Version: 4.15.0-135-generic 2021-02-13T17:45:40.772 DEBUG:teuthology.orchestra.run.gibba025:> sudo update-grub 2021-02-13T17:45:41.984 INFO:teuthology.orchestra.run.gibba025.stderr:Sourcing file `/etc/default/grub' 2021-02-13T17:45:42.004 INFO:teuthology.orchestra.run.gibba025.stderr:Generating grub configuration file ... 2021-02-13T17:45:42.320 INFO:teuthology.orchestra.run.gibba025.stderr:Found linux image: /boot/vmlinuz-4.15.0-135-generic 2021-02-13T17:45:42.336 INFO:teuthology.orchestra.run.gibba025.stderr:Found initrd image: /boot/initrd.img-4.15.0-135-generic 2021-02-13T17:45:42.683 INFO:teuthology.orchestra.run.gibba025.stderr:Found linux image: /boot/vmlinuz-4.15.0-122-generic 2021-02-13T17:45:42.698 INFO:teuthology.orchestra.run.gibba025.stderr:Found initrd image: /boot/initrd.img-4.15.0-122-generic 2021-02-13T17:45:43.623 INFO:teuthology.orchestra.run.gibba025.stderr:done 2021-02-13T17:45:43.623 DEBUG:teuthology.orchestra.run.gibba025:> sudo shutdown -r now 2021-02-13T17:45:43.625 INFO:teuthology.task.kernel:Installing distro kernel on c2.mon.a... 2021-02-13T17:45:43.625 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@gibba036.front.sepia.ceph.com, path=None, version=distro) 2021-02-13T17:45:43.625 DEBUG:teuthology.orchestra.run.gibba036:> sudo apt-get clean 2021-02-13T17:45:43.657 DEBUG:teuthology.orchestra.run.gibba036:> sudo apt-get update 2021-02-13T17:45:43.780 INFO:teuthology.orchestra.run.gibba036.stdout:Hit:1 http://security.ubuntu.com/ubuntu bionic-security InRelease 2021-02-13T17:45:43.894 INFO:teuthology.orchestra.run.gibba036.stdout:Hit:2 http://archive.ubuntu.com/ubuntu bionic InRelease 2021-02-13T17:45:43.974 INFO:teuthology.orchestra.run.gibba036.stdout:Hit:3 http://archive.ubuntu.com/ubuntu bionic-updates InRelease 2021-02-13T17:45:44.053 INFO:teuthology.orchestra.run.gibba036.stdout:Hit:4 http://archive.ubuntu.com/ubuntu bionic-backports InRelease 2021-02-13T17:45:45.022 INFO:teuthology.orchestra.run.gibba036.stdout:Reading package lists... 2021-02-13T17:45:45.049 DEBUG:teuthology.orchestra.run.gibba036:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2021-02-13T17:45:45.094 INFO:teuthology.orchestra.run.gibba036.stdout:Reading package lists... 2021-02-13T17:45:45.260 INFO:teuthology.orchestra.run.gibba036.stdout:Building dependency tree... 2021-02-13T17:45:45.260 INFO:teuthology.orchestra.run.gibba036.stdout:Reading state information... 2021-02-13T17:45:45.310 INFO:teuthology.orchestra.run.gibba036.stderr:E: Unable to locate package linux-image-current-generic 2021-02-13T17:45:45.311 DEBUG:teuthology.orchestra.run:got remote process result: 100 2021-02-13T17:45:45.311 DEBUG:teuthology.orchestra.run.gibba036:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-02-13T17:45:45.403 INFO:teuthology.orchestra.run.gibba036.stdout:Reading package lists... 2021-02-13T17:45:45.569 INFO:teuthology.orchestra.run.gibba036.stdout:Building dependency tree... 2021-02-13T17:45:45.569 INFO:teuthology.orchestra.run.gibba036.stdout:Reading state information... 2021-02-13T17:45:45.682 INFO:teuthology.orchestra.run.gibba036.stdout:linux-image-generic is already the newest version (4.15.0.135.122). 2021-02-13T17:45:45.682 INFO:teuthology.orchestra.run.gibba036.stdout:0 upgraded, 0 newly installed, 0 to remove and 88 not upgraded. 2021-02-13T17:45:45.683 DEBUG:teuthology.orchestra.run.gibba036:> dpkg -s linux-image-generic 2021-02-13T17:45:45.733 INFO:teuthology.orchestra.run.gibba036.stdout:Package: linux-image-generic 2021-02-13T17:45:45.733 INFO:teuthology.orchestra.run.gibba036.stdout:Status: install ok installed 2021-02-13T17:45:45.733 INFO:teuthology.orchestra.run.gibba036.stdout:Priority: optional 2021-02-13T17:45:45.733 INFO:teuthology.orchestra.run.gibba036.stdout:Section: kernel 2021-02-13T17:45:45.733 INFO:teuthology.orchestra.run.gibba036.stdout:Installed-Size: 17 2021-02-13T17:45:45.733 INFO:teuthology.orchestra.run.gibba036.stdout:Maintainer: Ubuntu Kernel Team 2021-02-13T17:45:45.733 INFO:teuthology.orchestra.run.gibba036.stdout:Architecture: amd64 2021-02-13T17:45:45.734 INFO:teuthology.orchestra.run.gibba036.stdout:Source: linux-meta 2021-02-13T17:45:45.734 INFO:teuthology.orchestra.run.gibba036.stdout:Version: 4.15.0.135.122 2021-02-13T17:45:45.734 INFO:teuthology.orchestra.run.gibba036.stdout:Provides: wireguard-modules (= 1.0.20201112-1~18.04.1), zfs-modules (= 0.7.5-1ubuntu16.10) 2021-02-13T17:45:45.734 INFO:teuthology.orchestra.run.gibba036.stdout:Depends: linux-image-4.15.0-135-generic, linux-modules-extra-4.15.0-135-generic, linux-firmware, intel-microcode, amd64-microcode 2021-02-13T17:45:45.734 INFO:teuthology.orchestra.run.gibba036.stdout:Recommends: thermald 2021-02-13T17:45:45.734 INFO:teuthology.orchestra.run.gibba036.stdout:Description: Generic Linux kernel image 2021-02-13T17:45:45.734 INFO:teuthology.orchestra.run.gibba036.stdout: This package will always depend on the latest generic kernel image 2021-02-13T17:45:45.734 INFO:teuthology.orchestra.run.gibba036.stdout: available. 2021-02-13T17:45:45.734 DEBUG:teuthology.orchestra.run.gibba036:> mktemp 2021-02-13T17:45:45.777 INFO:teuthology.orchestra.run.gibba036.stdout:/tmp/tmp.Nc5kbViq4R 2021-02-13T17:45:45.778 DEBUG:teuthology.orchestra.run.gibba036:> sudo cp /boot/grub/grub.cfg /tmp/tmp.Nc5kbViq4R 2021-02-13T17:45:45.831 DEBUG:teuthology.orchestra.run.gibba036:> sudo chmod 0666 /tmp/tmp.Nc5kbViq4R 2021-02-13T17:45:45.929 DEBUG:teuthology.orchestra.remote:gibba036:/tmp/tmp.Nc5kbViq4R is 8KB 2021-02-13T17:45:45.975 DEBUG:teuthology.orchestra.run.gibba036:> rm -fr /tmp/tmp.Nc5kbViq4R 2021-02-13T17:45:45.978 DEBUG:teuthology.orchestra.run.gibba036:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2021-02-13T17:45:46.024 DEBUG:teuthology.orchestra.run.gibba036:> set -ex 2021-02-13T17:45:46.024 DEBUG:teuthology.orchestra.run.gibba036:> sudo dd of=/etc/grub.d/01_ceph_kernel 2021-02-13T17:45:46.024 DEBUG:teuthology.orchestra.run.gibba036:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2021-02-13T17:45:46.083 INFO:teuthology.task.kernel:Distro Kernel Version: 4.15.0-135-generic 2021-02-13T17:45:46.083 DEBUG:teuthology.orchestra.run.gibba036:> sudo update-grub 2021-02-13T17:45:47.133 INFO:teuthology.orchestra.run.gibba036.stderr:Sourcing file `/etc/default/grub' 2021-02-13T17:45:47.165 INFO:teuthology.orchestra.run.gibba036.stderr:Generating grub configuration file ... 2021-02-13T17:45:47.331 INFO:teuthology.orchestra.run.gibba036.stderr:Found linux image: /boot/vmlinuz-4.15.0-135-generic 2021-02-13T17:45:47.334 INFO:teuthology.orchestra.run.gibba036.stderr:Found initrd image: /boot/initrd.img-4.15.0-135-generic 2021-02-13T17:45:47.480 INFO:teuthology.orchestra.run.gibba036.stderr:Found linux image: /boot/vmlinuz-4.15.0-122-generic 2021-02-13T17:45:47.483 INFO:teuthology.orchestra.run.gibba036.stderr:Found initrd image: /boot/initrd.img-4.15.0-122-generic 2021-02-13T17:45:48.024 INFO:teuthology.orchestra.run.gibba036.stderr:done 2021-02-13T17:45:48.025 DEBUG:teuthology.orchestra.run.gibba036:> sudo shutdown -r now 2021-02-13T17:46:18.098 INFO:teuthology.misc:Re-opening connections... 2021-02-13T17:46:18.099 INFO:teuthology.misc:trying to connect to ubuntu@gibba025.front.sepia.ceph.com 2021-02-13T17:46:18.099 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-02-13T17:46:18.100 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba025.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-02-13T17:46:36.611 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.2.125 2021-02-13T17:46:36.611 INFO:teuthology.misc:trying to connect to ubuntu@gibba036.front.sepia.ceph.com 2021-02-13T17:46:36.611 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-02-13T17:46:36.612 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba036.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-02-13T17:46:55.042 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.2.136 2021-02-13T17:46:55.043 DEBUG:teuthology.misc:waited 36.943997383117676 2021-02-13T17:46:56.043 INFO:teuthology.misc:trying to connect to ubuntu@gibba025.front.sepia.ceph.com 2021-02-13T17:46:56.043 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-02-13T17:46:56.044 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba025.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-02-13T17:46:59.110 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.2.125 2021-02-13T17:46:59.111 INFO:teuthology.misc:trying to connect to ubuntu@gibba036.front.sepia.ceph.com 2021-02-13T17:46:59.111 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-02-13T17:46:59.111 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba036.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-02-13T17:47:02.178 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.2.136 2021-02-13T17:47:02.178 DEBUG:teuthology.misc:waited 44.07978010177612 2021-02-13T17:47:03.180 INFO:teuthology.misc:trying to connect to ubuntu@gibba025.front.sepia.ceph.com 2021-02-13T17:47:03.180 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-02-13T17:47:03.181 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba025.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-02-13T17:47:34.723 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.2.125 2021-02-13T17:47:34.724 INFO:teuthology.misc:trying to connect to ubuntu@gibba036.front.sepia.ceph.com 2021-02-13T17:47:34.724 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-02-13T17:47:34.724 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba036.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-02-13T17:47:41.890 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.2.136 2021-02-13T17:47:41.891 DEBUG:teuthology.misc:waited 83.7918872833252 2021-02-13T17:47:42.891 INFO:teuthology.misc:trying to connect to ubuntu@gibba025.front.sepia.ceph.com 2021-02-13T17:47:42.891 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-02-13T17:47:42.892 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba025.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-02-13T17:47:43.006 DEBUG:teuthology.orchestra.run.gibba025:> true 2021-02-13T17:47:43.288 DEBUG:teuthology.misc:waited 85.1895980834961 2021-02-13T17:47:44.289 INFO:teuthology.misc:trying to connect to ubuntu@gibba036.front.sepia.ceph.com 2021-02-13T17:47:44.289 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-02-13T17:47:44.290 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba036.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-02-13T17:47:44.525 DEBUG:teuthology.orchestra.run.gibba036:> true 2021-02-13T17:47:45.425 DEBUG:teuthology.misc:waited 87.32591485977173 2021-02-13T17:47:46.425 INFO:teuthology.task.kernel:Checking client c1.mon.a for new kernel version... 2021-02-13T17:47:46.426 INFO:teuthology.task.kernel:Checking kernel version of c1.mon.a, want "4.15.0-135-generic"... 2021-02-13T17:47:46.426 DEBUG:teuthology.orchestra.run.gibba025:> uname -r 2021-02-13T17:47:46.435 INFO:teuthology.orchestra.run.gibba025.stdout:4.15.0-135-generic 2021-02-13T17:47:46.435 DEBUG:teuthology.task.kernel:current kernel version is 4.15.0-135-generic vs 4.15.0-135-generic 2021-02-13T17:47:46.435 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2021-02-13T17:47:46.435 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2021-02-13T17:47:46.435 INFO:teuthology.task.kernel:Checking client c2.mon.a for new kernel version... 2021-02-13T17:47:46.435 INFO:teuthology.task.kernel:Checking kernel version of c2.mon.a, want "4.15.0-135-generic"... 2021-02-13T17:47:46.436 DEBUG:teuthology.orchestra.run.gibba036:> uname -r 2021-02-13T17:47:46.440 INFO:teuthology.orchestra.run.gibba036.stdout:4.15.0-135-generic 2021-02-13T17:47:46.440 DEBUG:teuthology.task.kernel:current kernel version is 4.15.0-135-generic vs 4.15.0-135-generic 2021-02-13T17:47:46.440 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2021-02-13T17:47:46.440 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2021-02-13T17:47:47.441 INFO:teuthology.task.kernel:Enabling kdb on c1.mon.a... 2021-02-13T17:47:47.442 DEBUG:teuthology.orchestra.run.gibba025:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-02-13T17:47:47.465 INFO:teuthology.orchestra.run.gibba025.stdout:ttyS1 2021-02-13T17:47:47.506 INFO:teuthology.task.kernel:Enabling kdb on c2.mon.a... 2021-02-13T17:47:47.506 DEBUG:teuthology.orchestra.run.gibba036:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-02-13T17:47:47.532 INFO:teuthology.orchestra.run.gibba036.stdout:ttyS1 2021-02-13T17:47:47.558 INFO:teuthology.run_tasks:Running task internal.base... 2021-02-13T17:47:47.568 INFO:teuthology.task.internal:Creating test directory... 2021-02-13T17:47:47.568 DEBUG:teuthology.orchestra.run.gibba025:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-02-13T17:47:47.571 DEBUG:teuthology.orchestra.run.gibba036:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-02-13T17:47:47.606 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2021-02-13T17:47:47.671 INFO:teuthology.run_tasks:Running task internal.archive... 2021-02-13T17:47:47.722 INFO:teuthology.task.internal:Creating archive directory... 2021-02-13T17:47:47.722 DEBUG:teuthology.orchestra.run.gibba025:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-02-13T17:47:47.725 DEBUG:teuthology.orchestra.run.gibba036:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-02-13T17:47:47.747 INFO:teuthology.run_tasks:Running task internal.coredump... 2021-02-13T17:47:47.780 INFO:teuthology.task.internal:Enabling coredump saving... 2021-02-13T17:47:47.781 DEBUG:teuthology.orchestra.run.gibba025:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-02-13T17:47:47.784 DEBUG:teuthology.orchestra.run.gibba036:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-02-13T17:47:47.804 INFO:teuthology.orchestra.run.gibba036.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-02-13T17:47:47.805 INFO:teuthology.orchestra.run.gibba025.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-02-13T17:47:47.806 INFO:teuthology.orchestra.run.gibba036.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-02-13T17:47:47.807 INFO:teuthology.orchestra.run.gibba025.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-02-13T17:47:47.807 INFO:teuthology.run_tasks:Running task internal.sudo... 2021-02-13T17:47:47.839 INFO:teuthology.task.internal:Configuring sudo... 2021-02-13T17:47:47.839 DEBUG:teuthology.orchestra.run.gibba025:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-02-13T17:47:47.849 DEBUG:teuthology.orchestra.run.gibba036:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-02-13T17:47:47.860 INFO:teuthology.run_tasks:Running task internal.syslog... 2021-02-13T17:47:47.892 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2021-02-13T17:47:47.892 DEBUG:teuthology.orchestra.run.gibba025:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-02-13T17:47:47.898 DEBUG:teuthology.orchestra.run.gibba036:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-02-13T17:47:47.909 DEBUG:teuthology.orchestra.run.gibba025:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-02-13T17:47:47.946 DEBUG:teuthology.orchestra.run.gibba025:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-02-13T17:47:47.996 DEBUG:teuthology.orchestra.run.gibba025:> set -ex 2021-02-13T17:47:47.997 DEBUG:teuthology.orchestra.run.gibba025:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-02-13T17:47:48.053 DEBUG:teuthology.orchestra.run.gibba036:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-02-13T17:47:48.062 DEBUG:teuthology.orchestra.run.gibba036:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-02-13T17:47:48.113 DEBUG:teuthology.orchestra.run.gibba036:> set -ex 2021-02-13T17:47:48.113 DEBUG:teuthology.orchestra.run.gibba036:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-02-13T17:47:48.182 DEBUG:teuthology.orchestra.run.gibba025:> sudo service rsyslog restart 2021-02-13T17:47:48.185 DEBUG:teuthology.orchestra.run.gibba036:> sudo service rsyslog restart 2021-02-13T17:47:48.285 INFO:teuthology.run_tasks:Running task internal.timer... 2021-02-13T17:47:48.296 INFO:teuthology.task.internal:Starting timer... 2021-02-13T17:47:48.296 INFO:teuthology.run_tasks:Running task pcp... 2021-02-13T17:47:48.328 INFO:teuthology.run_tasks:Running task selinux... 2021-02-13T17:47:48.375 DEBUG:teuthology.task.selinux:Excluding gibba025: OS 'ubuntu' does not support SELinux 2021-02-13T17:47:48.375 DEBUG:teuthology.task.selinux:Excluding gibba036: OS 'ubuntu' does not support SELinux 2021-02-13T17:47:48.375 DEBUG:teuthology.task.selinux:Getting current SELinux state 2021-02-13T17:47:48.376 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2021-02-13T17:47:48.376 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2021-02-13T17:47:48.376 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2021-02-13T17:47:48.407 DEBUG:teuthology.repo_utils:Setting repo remote to git://git.ceph.com/git/ceph-cm-ansible.git 2021-02-13T17:47:48.412 INFO:teuthology.repo_utils:Fetching master from origin 2021-02-13T17:47:48.451 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to origin/master 2021-02-13T17:47:48.467 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}] 2021-02-13T17:47:48.468 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit gibba025.front.sepia.ceph.com,gibba036.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml 2021-02-13T17:47:48.981 INFO:teuthology.task.ansible.out:Using /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/ansible.cfg as config file 2021-02-13T17:47:50.491 INFO:teuthology.task.ansible.out:[WARNING]: file /home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/roles/testnode/tasks/setup-opensuse.yml is empty and had no tasks to include 2021-02-13T17:47:53.277 INFO:teuthology.task.ansible.out: PLAY [all] ********************************************************************* 2021-02-13T17:47:53.311 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:47:53 +0000 (0:00:00.147) 0:00:00.147 ***** 2021-02-13T17:47:53.333 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:47:53 +0000 (0:00:00.021) 0:00:00.169 ***** 2021-02-13T17:47:54.593 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [gibba025.front.sepia.ceph.com] 2021-02-13T17:47:54.678 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:47:54 +0000 (0:00:01.345) 0:00:01.515 ***** 2021-02-13T17:47:54.701 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] 2021-02-13T17:47:54.791 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:47:54 +0000 (0:00:00.113) 0:00:01.628 ***** 2021-02-13T17:47:54.912 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** 2021-02-13T17:47:54.913 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} ok: [gibba025.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-02-13T17:47:54.949 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:47:54 +0000 (0:00:00.157) 0:00:01.785 ***** 2021-02-13T17:47:54.984 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:47:54 +0000 (0:00:00.035) 0:00:01.821 ***** 2021-02-13T17:47:55.324 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** 2021-02-13T17:47:55.325 INFO:teuthology.task.ansible.out:changed: [gibba036.front.sepia.ceph.com] => {"append": false, "changed": true, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2021-02-13T17:47:55.361 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:47:55 +0000 (0:00:00.377) 0:00:02.198 ***** 2021-02-13T17:47:55.369 INFO:teuthology.task.ansible.out:changed: [gibba025.front.sepia.ceph.com] => {"append": false, "changed": true, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2021-02-13T17:47:55.409 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:47:55 +0000 (0:00:00.047) 0:00:02.245 ***** 2021-02-13T17:47:55.623 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** 2021-02-13T17:47:55.625 INFO:teuthology.task.ansible.out:changed: [gibba036.front.sepia.ceph.com] => {"changed": true, "cmd": ["passwd", "-d", "cm"], "delta": "0:00:00.051523", "end": "2021-02-13 17:47:55.836772", "rc": 0, "start": "2021-02-13 17:47:55.785249", "stderr": "", "stderr_lines": [], "stdout": "passwd: password expiry information changed.", "stdout_lines": ["passwd: password expiry information changed."]} 2021-02-13T17:47:55.659 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:47:55 +0000 (0:00:00.250) 0:00:02.496 ***** 2021-02-13T17:47:55.666 INFO:teuthology.task.ansible.out:changed: [gibba025.front.sepia.ceph.com] => {"changed": true, "cmd": ["passwd", "-d", "cm"], "delta": "0:00:00.059272", "end": "2021-02-13 17:47:55.718285", "rc": 0, "start": "2021-02-13 17:47:55.659013", "stderr": "", "stderr_lines": [], "stdout": "passwd: password expiry information changed.", "stdout_lines": ["passwd: password expiry information changed."]} 2021-02-13T17:47:55.704 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:47:55 +0000 (0:00:00.045) 0:00:02.541 ***** 2021-02-13T17:47:55.866 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** 2021-02-13T17:47:55.868 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-02-13T17:47:55.929 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:47:55 +0000 (0:00:00.224) 0:00:02.765 ***** 2021-02-13T17:47:55.940 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-02-13T17:47:55.981 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:47:55 +0000 (0:00:00.052) 0:00:02.818 ***** 2021-02-13T17:47:56.617 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the cephlab_sudo sudoers.d file.] *************** 2021-02-13T17:47:56.619 INFO:teuthology.task.ansible.out:changed: [gibba036.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1613238475.9490032-239248344382049/source", "state": "file", "uid": 0} 2021-02-13T17:47:56.659 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:47:56 +0000 (0:00:00.677) 0:00:03.496 ***** 2021-02-13T17:47:56.666 INFO:teuthology.task.ansible.out:changed: [gibba025.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1613238475.9949968-128368159663263/source", "state": "file", "uid": 0} 2021-02-13T17:47:56.706 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:47:56 +0000 (0:00:00.046) 0:00:03.542 ***** 2021-02-13T17:47:56.924 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Add authorized keys for the ansible user.] ************* 2021-02-13T17:47:56.926 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4 2021-02-13T17:47:56.927 INFO:teuthology.task.ansible.out:r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} ok: [gibba036.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.c 2021-02-13T17:47:56.929 INFO:teuthology.task.ansible.out:om\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@ak 2021-02-13T17:47:56.930 INFO:teuthology.task.ansible.out:lap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2021-02-13T17:47:57.085 INFO:teuthology.task.ansible.out: PLAY [teuthology] ************************************************************** skipping: no hosts matched 2021-02-13T17:47:57.093 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2021-02-13T17:47:57.245 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:47:57 +0000 (0:00:00.539) 0:00:04.082 ***** 2021-02-13T17:47:57.280 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:47:57 +0000 (0:00:00.034) 0:00:04.116 ***** 2021-02-13T17:47:57.680 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [gibba025.front.sepia.ceph.com] 2021-02-13T17:47:57.727 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] 2021-02-13T17:47:57.728 INFO:teuthology.task.ansible.out: 2021-02-13T17:47:57.773 INFO:teuthology.task.ansible.out:[WARNING]: Using run_once with the free strategy is not currently supported. This task will still be executed for every host in the inventory list. 2021-02-13T17:47:57.774 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:47:57 +0000 (0:00:00.493) 0:00:04.610 ***** 2021-02-13T17:47:57.847 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:47:57 +0000 (0:00:00.073) 0:00:04.683 ***** 2021-02-13T17:47:58.104 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** 2021-02-13T17:47:58.106 INFO:teuthology.task.ansible.out:changed: [gibba025.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.139355", "end": "2021-02-13 17:47:58.084590", "rc": 0, "start": "2021-02-13 17:47:57.945235", "stderr": "", "stderr_lines": [], "stdout": "df8946f08e870e2d2565b79099289ca48bd825f3", "stdout_lines": ["df8946f08e870e2d2565b79099289ca48bd825f3"]} 2021-02-13T17:47:58.140 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:47:58 +0000 (0:00:00.293) 0:00:04.977 ***** 2021-02-13T17:47:58.178 INFO:teuthology.task.ansible.out:changed: [gibba036.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.140218", "end": "2021-02-13 17:47:58.154280", "rc": 0, "start": "2021-02-13 17:47:58.014062", "stderr": "", "stderr_lines": [], "stdout": "df8946f08e870e2d2565b79099289ca48bd825f3", "stdout_lines": ["df8946f08e870e2d2565b79099289ca48bd825f3"]} 2021-02-13T17:47:58.215 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:47:58 +0000 (0:00:00.074) 0:00:05.052 ***** 2021-02-13T17:47:58.231 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2021-02-13T17:47:58.233 INFO:teuthology.task.ansible.out:changed: [gibba025.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.005960", "end": "2021-02-13 17:47:58.305585", "failed_when_result": false, "rc": 0, "start": "2021-02-13 17:47:58.299625", "stderr": "", "stderr_lines": [], "stdout": "e549618f811c1ef59d08997aa55e495f75d8d5e6", "stdout_lines": ["e549618f811c1ef59d08997aa55e495f75d8d5e6"]} 2021-02-13T17:47:58.272 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:47:58 +0000 (0:00:00.056) 0:00:05.108 ***** 2021-02-13T17:47:58.299 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** 2021-02-13T17:47:58.301 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:47:58.336 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:47:58 +0000 (0:00:00.064) 0:00:05.173 ***** 2021-02-13T17:47:58.343 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** changed: [gibba036.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.004145", "end": "2021-02-13 17:47:58.522311", "failed_when_result": false, "rc": 0, "start": "2021-02-13 17:47:58.518166", "stderr": "", "stderr_lines": [], "stdout": "e549618f811c1ef59d08997aa55e495f75d8d5e6", "stdout_lines": ["e549618f811c1ef59d08997aa55e495f75d8d5e6"]} 2021-02-13T17:47:58.381 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:47:58 +0000 (0:00:00.045) 0:00:05.218 ***** 2021-02-13T17:47:58.387 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** 2021-02-13T17:47:58.388 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:47:58.425 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:47:58 +0000 (0:00:00.043) 0:00:05.262 ***** 2021-02-13T17:47:58.433 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** 2021-02-13T17:47:58.434 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:47:58.481 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:47:58 +0000 (0:00:00.056) 0:00:05.318 ***** 2021-02-13T17:47:58.487 INFO:teuthology.task.ansible.out: TASK [users : Remove managed_admin_users from managed_users] ******************* 2021-02-13T17:47:58.488 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:47:58.524 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:47:58 +0000 (0:00:00.042) 0:00:05.360 ***** 2021-02-13T17:47:58.529 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** 2021-02-13T17:47:58.531 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:47:58.566 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:47:58 +0000 (0:00:00.042) 0:00:05.403 ***** 2021-02-13T17:47:58.571 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_users list] *********************************** 2021-02-13T17:47:58.573 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:47:58.608 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:47:58 +0000 (0:00:00.041) 0:00:05.445 ***** 2021-02-13T17:47:58.614 INFO:teuthology.task.ansible.out: TASK [users : Remove managed_admin_users from managed_users] ******************* 2021-02-13T17:47:58.615 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:47:58.650 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:47:58 +0000 (0:00:00.042) 0:00:05.487 ***** 2021-02-13T17:47:58.656 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_admin_users list] ***************************** 2021-02-13T17:47:58.657 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:47:58.696 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:47:58 +0000 (0:00:00.045) 0:00:05.533 ***** 2021-02-13T17:47:58.703 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_users list] *********************************** 2021-02-13T17:47:58.704 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:47:58.742 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:47:58 +0000 (0:00:00.045) 0:00:05.579 ***** 2021-02-13T17:47:58.771 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_admin_users list] ***************************** skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:47:58.811 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:47:58 +0000 (0:00:00.068) 0:00:05.647 ***** 2021-02-13T17:47:58.817 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2021-02-13T17:47:58.819 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-02-13T17:47:58.855 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:47:58 +0000 (0:00:00.044) 0:00:05.691 ***** 2021-02-13T17:47:58.904 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-02-13T17:47:58.940 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:47:58 +0000 (0:00:00.085) 0:00:05.777 ***** 2021-02-13T17:47:58.987 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2021-02-13T17:47:58.988 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2021-02-13T17:47:59.073 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2021-02-13T17:47:59.074 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2021-02-13T17:47:59.162 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2021-02-13T17:47:59.163 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2021-02-13T17:47:59.237 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2021-02-13T17:47:59.238 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2021-02-13T17:47:59.324 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2021-02-13T17:47:59.325 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2021-02-13T17:47:59.400 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2021-02-13T17:47:59.411 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2021-02-13T17:47:59.413 INFO:teuthology.task.ansible.out: 2021-02-13T17:47:59.486 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2021-02-13T17:47:59.498 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2021-02-13T17:47:59.572 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2021-02-13T17:47:59.573 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2021-02-13T17:47:59.658 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2021-02-13T17:47:59.659 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2021-02-13T17:47:59.744 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2021-02-13T17:47:59.745 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2021-02-13T17:47:59.829 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2021-02-13T17:47:59.851 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2021-02-13T17:47:59.914 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2021-02-13T17:47:59.916 INFO:teuthology.task.ansible.out: 2021-02-13T17:47:59.937 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2021-02-13T17:47:59.938 INFO:teuthology.task.ansible.out: 2021-02-13T17:48:00.001 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2021-02-13T17:48:00.024 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2021-02-13T17:48:00.087 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2021-02-13T17:48:00.109 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2021-02-13T17:48:00.173 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2021-02-13T17:48:00.195 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2021-02-13T17:48:00.259 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2021-02-13T17:48:00.281 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2021-02-13T17:48:00.345 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2021-02-13T17:48:00.367 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2021-02-13T17:48:00.431 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1118} 2021-02-13T17:48:00.432 INFO:teuthology.task.ansible.out: 2021-02-13T17:48:00.454 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2021-02-13T17:48:00.518 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2021-02-13T17:48:00.529 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1118} 2021-02-13T17:48:00.604 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2021-02-13T17:48:00.615 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2021-02-13T17:48:00.691 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1121} 2021-02-13T17:48:00.693 INFO:teuthology.task.ansible.out: 2021-02-13T17:48:00.703 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2021-02-13T17:48:00.776 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1123} 2021-02-13T17:48:00.788 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1121} 2021-02-13T17:48:00.854 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1124} 2021-02-13T17:48:00.876 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1123} 2021-02-13T17:48:00.951 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1125} 2021-02-13T17:48:00.963 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1124} 2021-02-13T17:48:01.050 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1126} 2021-02-13T17:48:01.051 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1125} 2021-02-13T17:48:01.149 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1126} 2021-02-13T17:48:01.150 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1127} 2021-02-13T17:48:01.224 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1127} 2021-02-13T17:48:01.237 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1128} 2021-02-13T17:48:01.322 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1128} 2021-02-13T17:48:01.323 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1129} 2021-02-13T17:48:01.408 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1129} 2021-02-13T17:48:01.419 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1130} 2021-02-13T17:48:01.494 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1131} 2021-02-13T17:48:01.506 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1130} 2021-02-13T17:48:01.581 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1132} 2021-02-13T17:48:01.593 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1131} 2021-02-13T17:48:01.666 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1132} 2021-02-13T17:48:01.667 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1133} 2021-02-13T17:48:01.753 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1133} 2021-02-13T17:48:01.755 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1134} 2021-02-13T17:48:01.852 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1134} 2021-02-13T17:48:01.853 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1135} 2021-02-13T17:48:01.930 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1135} 2021-02-13T17:48:01.932 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1136} 2021-02-13T17:48:02.017 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1137} 2021-02-13T17:48:02.019 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1136} 2021-02-13T17:48:02.093 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/jdillaman", "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "move_home": false, "name": "jdillaman", "shell": "/bin/bash", "state": "present", "uid": 1138} 2021-02-13T17:48:02.105 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1137} 2021-02-13T17:48:02.189 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-02-13T17:48:02.201 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/jdillaman", "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "move_home": false, "name": "jdillaman", "shell": "/bin/bash", "state": "present", "uid": 1138} 2021-02-13T17:48:02.264 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-02-13T17:48:02.275 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-02-13T17:48:02.349 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1141} 2021-02-13T17:48:02.371 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-02-13T17:48:02.447 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1142} 2021-02-13T17:48:02.459 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1141} 2021-02-13T17:48:02.534 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1143} 2021-02-13T17:48:02.546 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1142} 2021-02-13T17:48:02.631 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1144} 2021-02-13T17:48:02.643 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1143} 2021-02-13T17:48:02.721 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1145} 2021-02-13T17:48:02.734 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1144} 2021-02-13T17:48:02.810 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1146} 2021-02-13T17:48:02.822 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1145} 2021-02-13T17:48:02.886 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-02-13T17:48:02.908 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1146} 2021-02-13T17:48:02.983 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-02-13T17:48:02.984 INFO:teuthology.task.ansible.out: 2021-02-13T17:48:02.995 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-02-13T17:48:03.070 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1149} 2021-02-13T17:48:03.082 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-02-13T17:48:03.083 INFO:teuthology.task.ansible.out: 2021-02-13T17:48:03.151 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1150} 2021-02-13T17:48:03.177 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1149} 2021-02-13T17:48:03.243 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1151} 2021-02-13T17:48:03.266 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1150} 2021-02-13T17:48:03.333 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1152} 2021-02-13T17:48:03.355 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1151} 2021-02-13T17:48:03.419 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1153} 2021-02-13T17:48:03.430 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1152} 2021-02-13T17:48:03.504 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1154} 2021-02-13T17:48:03.516 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1153} 2021-02-13T17:48:03.591 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1155} 2021-02-13T17:48:03.613 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1154} 2021-02-13T17:48:03.688 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1156} 2021-02-13T17:48:03.699 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1155} 2021-02-13T17:48:03.773 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1157} 2021-02-13T17:48:03.784 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1156} 2021-02-13T17:48:03.858 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1158} 2021-02-13T17:48:03.870 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1157} 2021-02-13T17:48:03.944 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1159} 2021-02-13T17:48:03.956 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1158} 2021-02-13T17:48:04.032 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1160} 2021-02-13T17:48:04.044 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1159} 2021-02-13T17:48:04.119 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1161} 2021-02-13T17:48:04.131 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1160} 2021-02-13T17:48:04.205 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1162} 2021-02-13T17:48:04.227 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1161} 2021-02-13T17:48:04.291 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1163} 2021-02-13T17:48:04.303 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1162} 2021-02-13T17:48:04.378 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1164} 2021-02-13T17:48:04.391 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1163} 2021-02-13T17:48:04.466 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-02-13T17:48:04.478 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1164} 2021-02-13T17:48:04.552 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1165} 2021-02-13T17:48:04.563 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-02-13T17:48:04.648 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1166} 2021-02-13T17:48:04.834 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1165} ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1167} ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1166} ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home 2021-02-13T17:48:04.835 INFO:teuthology.task.ansible.out:/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1168} 2021-02-13T17:48:04.844 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1167} 2021-02-13T17:48:04.910 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1169} 2021-02-13T17:48:04.932 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1168} 2021-02-13T17:48:05.006 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1170} 2021-02-13T17:48:05.018 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1169} 2021-02-13T17:48:05.092 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1171} 2021-02-13T17:48:05.104 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1170} 2021-02-13T17:48:05.178 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1172} 2021-02-13T17:48:05.190 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1171} 2021-02-13T17:48:05.274 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1173} 2021-02-13T17:48:05.275 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1172} 2021-02-13T17:48:05.359 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1174} 2021-02-13T17:48:05.360 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1173} 2021-02-13T17:48:05.434 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1175} 2021-02-13T17:48:05.446 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1174} 2021-02-13T17:48:05.519 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1176} 2021-02-13T17:48:05.521 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1175} 2021-02-13T17:48:05.605 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1177} 2021-02-13T17:48:05.607 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1176} 2021-02-13T17:48:05.689 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1178} 2021-02-13T17:48:05.690 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1177} 2021-02-13T17:48:05.775 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1178} 2021-02-13T17:48:05.776 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1179} 2021-02-13T17:48:05.777 INFO:teuthology.task.ansible.out: 2021-02-13T17:48:05.861 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1179} 2021-02-13T17:48:05.861 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1180} 2021-02-13T17:48:05.946 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1180} 2021-02-13T17:48:05.947 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1181} 2021-02-13T17:48:06.031 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1181} 2021-02-13T17:48:06.032 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1182} 2021-02-13T17:48:06.117 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1183} 2021-02-13T17:48:06.118 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1182} 2021-02-13T17:48:06.192 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1183} 2021-02-13T17:48:06.193 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1184} 2021-02-13T17:48:06.278 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1185} 2021-02-13T17:48:06.278 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1184} 2021-02-13T17:48:06.373 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1185} 2021-02-13T17:48:06.374 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1186} 2021-02-13T17:48:06.448 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1186} 2021-02-13T17:48:06.459 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1187} 2021-02-13T17:48:06.543 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1187} 2021-02-13T17:48:06.555 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1188} 2021-02-13T17:48:06.639 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1189} 2021-02-13T17:48:06.640 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1188} 2021-02-13T17:48:06.717 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1190} 2021-02-13T17:48:06.728 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1189} 2021-02-13T17:48:06.814 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1191} 2021-02-13T17:48:06.815 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1190} 2021-02-13T17:48:06.892 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1192} 2021-02-13T17:48:06.904 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1191} 2021-02-13T17:48:06.978 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1193} 2021-02-13T17:48:06.990 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1192} 2021-02-13T17:48:07.075 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1194} 2021-02-13T17:48:07.076 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1193} 2021-02-13T17:48:07.161 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1195} 2021-02-13T17:48:07.162 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1194} 2021-02-13T17:48:07.247 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1195} 2021-02-13T17:48:07.248 INFO:teuthology.task.ansible.out: ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1196} 2021-02-13T17:48:07.333 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1196} 2021-02-13T17:48:07.334 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1197} 2021-02-13T17:48:07.419 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1197} 2021-02-13T17:48:07.420 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1198} 2021-02-13T17:48:07.505 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1198} 2021-02-13T17:48:07.506 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1199} 2021-02-13T17:48:07.590 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1199} 2021-02-13T17:48:07.591 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1200} 2021-02-13T17:48:07.665 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1200} 2021-02-13T17:48:07.687 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1201} 2021-02-13T17:48:07.689 INFO:teuthology.task.ansible.out: 2021-02-13T17:48:07.762 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1201} 2021-02-13T17:48:07.773 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-02-13T17:48:07.838 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-02-13T17:48:07.860 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1202} 2021-02-13T17:48:07.924 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1202} 2021-02-13T17:48:07.945 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1203} 2021-02-13T17:48:08.010 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1203} 2021-02-13T17:48:08.032 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1204} 2021-02-13T17:48:08.095 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1204} 2021-02-13T17:48:08.117 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1205} 2021-02-13T17:48:08.181 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1205} 2021-02-13T17:48:08.203 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1206} 2021-02-13T17:48:08.267 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1206} 2021-02-13T17:48:08.289 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1207} 2021-02-13T17:48:08.343 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1207} 2021-02-13T17:48:08.375 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1208} 2021-02-13T17:48:08.439 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1208} 2021-02-13T17:48:08.461 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1209} 2021-02-13T17:48:08.525 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1209} 2021-02-13T17:48:08.549 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1210} 2021-02-13T17:48:08.622 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1210} 2021-02-13T17:48:08.634 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1211} 2021-02-13T17:48:08.718 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1211} 2021-02-13T17:48:08.729 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1212} 2021-02-13T17:48:08.794 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1212} 2021-02-13T17:48:08.826 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1213} 2021-02-13T17:48:08.879 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1213} 2021-02-13T17:48:08.901 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1214} 2021-02-13T17:48:08.965 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1214} 2021-02-13T17:48:08.988 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "move_home": false, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "uid": 1215} 2021-02-13T17:48:09.051 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "move_home": false, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "uid": 1215} 2021-02-13T17:48:09.073 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1216, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "move_home": false, "name": "prateek", "shell": "/bin/bash", "state": "present", "uid": 1216} 2021-02-13T17:48:09.138 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1216, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "move_home": false, "name": "prateek", "shell": "/bin/bash", "state": "present", "uid": 1216} 2021-02-13T17:48:09.160 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1217, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "move_home": false, "name": "jelopez", "shell": "/bin/bash", "state": "present", "uid": 1217} 2021-02-13T17:48:09.214 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1217, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "move_home": false, "name": "jelopez", "shell": "/bin/bash", "state": "present", "uid": 1217} 2021-02-13T17:48:09.246 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1218, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "move_home": false, "name": "dcain", "shell": "/bin/bash", "state": "present", "uid": 1218} 2021-02-13T17:48:09.299 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1218, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "move_home": false, "name": "dcain", "shell": "/bin/bash", "state": "present", "uid": 1218} 2021-02-13T17:48:09.343 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1219, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "move_home": false, "name": "sunny", "shell": "/bin/bash", "state": "present", "uid": 1219} 2021-02-13T17:48:09.396 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1219, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "move_home": false, "name": "sunny", "shell": "/bin/bash", "state": "present", "uid": 1219} 2021-02-13T17:48:09.418 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1220, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "move_home": false, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "uid": 1220} 2021-02-13T17:48:09.471 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1220, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "move_home": false, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "uid": 1220} 2021-02-13T17:48:09.504 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1221, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "move_home": false, "name": "aclewett", "shell": "/bin/bash", "state": "present", "uid": 1221} 2021-02-13T17:48:09.568 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1221, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "move_home": false, "name": "aclewett", "shell": "/bin/bash", "state": "present", "uid": 1221} 2021-02-13T17:48:09.603 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1222, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "move_home": false, "name": "cblum", "shell": "/bin/bash", "state": "present", "uid": 1222} 2021-02-13T17:48:09.646 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1222, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "move_home": false, "name": "cblum", "shell": "/bin/bash", "state": "present", "uid": 1222} 2021-02-13T17:48:09.680 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1223, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "move_home": false, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "uid": 1223} 2021-02-13T17:48:09.733 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1223, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "move_home": false, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "uid": 1223} 2021-02-13T17:48:09.766 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1224, "groups": "sudo", "home": "/home/shyamsundarr", "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "move_home": false, "name": "shyamsundarr", "shell": "/bin/bash", "state": "present", "uid": 1224} 2021-02-13T17:48:09.820 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1224, "groups": "sudo", "home": "/home/shyamsundarr", "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "move_home": false, "name": "shyamsundarr", "shell": "/bin/bash", "state": "present", "uid": 1224} 2021-02-13T17:48:09.852 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1225, "groups": "sudo", "home": "/home/shuzhenyi", "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "move_home": false, "name": "shuzhenyi", "shell": "/bin/bash", "state": "present", "uid": 1225} 2021-02-13T17:48:09.917 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1225, "groups": "sudo", "home": "/home/shuzhenyi", "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "move_home": false, "name": "shuzhenyi", "shell": "/bin/bash", "state": "present", "uid": 1225} 2021-02-13T17:48:09.949 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1226, "groups": "sudo", "home": "/home/mdipalma", "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "move_home": false, "name": "mdipalma", "shell": "/bin/bash", "state": "present", "uid": 1226} 2021-02-13T17:48:10.034 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1227, "groups": "sudo", "home": "/home/kchang", "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "move_home": false, "name": "kchang", "shell": "/bin/bash", "state": "present", "uid": 1227} 2021-02-13T17:48:10.046 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1226, "groups": "sudo", "home": "/home/mdipalma", "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "move_home": false, "name": "mdipalma", "shell": "/bin/bash", "state": "present", "uid": 1226} 2021-02-13T17:48:10.142 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1228, "groups": "sudo", "home": "/home/vereddy", "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "move_home": false, "name": "vereddy", "shell": "/bin/bash", "state": "present", "uid": 1228} 2021-02-13T17:48:10.143 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1227, "groups": "sudo", "home": "/home/kchang", "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "move_home": false, "name": "kchang", "shell": "/bin/bash", "state": "present", "uid": 1227} 2021-02-13T17:48:10.231 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1228, "groups": "sudo", "home": "/home/vereddy", "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "move_home": false, "name": "vereddy", "shell": "/bin/bash", "state": "present", "uid": 1228} 2021-02-13T17:48:10.232 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1229, "groups": "sudo", "home": "/home/benhanokh", "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "move_home": false, "name": "benhanokh", "shell": "/bin/bash", "state": "present", "uid": 1229} 2021-02-13T17:48:10.317 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1229, "groups": "sudo", "home": "/home/benhanokh", "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "move_home": false, "name": "benhanokh", "shell": "/bin/bash", "state": "present", "uid": 1229} 2021-02-13T17:48:10.338 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1230, "groups": "sudo", "home": "/home/jsalomon", "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "move_home": false, "name": "jsalomon", "shell": "/bin/bash", "state": "present", "uid": 1230} 2021-02-13T17:48:10.424 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1230, "groups": "sudo", "home": "/home/jsalomon", "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "move_home": false, "name": "jsalomon", "shell": "/bin/bash", "state": "present", "uid": 1230} 2021-02-13T17:48:10.435 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1231, "groups": "sudo", "home": "/home/jolmomar", "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "move_home": false, "name": "jolmomar", "shell": "/bin/bash", "state": "present", "uid": 1231} 2021-02-13T17:48:10.520 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1231, "groups": "sudo", "home": "/home/jolmomar", "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "move_home": false, "name": "jolmomar", "shell": "/bin/bash", "state": "present", "uid": 1231} 2021-02-13T17:48:10.531 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1232, "groups": "sudo", "home": "/home/hmunjulu", "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "move_home": false, "name": "hmunjulu", "shell": "/bin/bash", "state": "present", "uid": 1232} 2021-02-13T17:48:10.622 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1232, "groups": "sudo", "home": "/home/hmunjulu", "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "move_home": false, "name": "hmunjulu", "shell": "/bin/bash", "state": "present", "uid": 1232} 2021-02-13T17:48:10.633 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1233, "groups": "sudo", "home": "/home/julpark", "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "move_home": false, "name": "julpark", "shell": "/bin/bash", "state": "present", "uid": 1233} 2021-02-13T17:48:10.718 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1233, "groups": "sudo", "home": "/home/julpark", "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "move_home": false, "name": "julpark", "shell": "/bin/bash", "state": "present", "uid": 1233} 2021-02-13T17:48:11.090 INFO:teuthology.task.ansible.out:changed: [gibba025.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10103, "groups": "sudo", "home": "/home/pdhange", "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "name": "pdhange", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10102} 2021-02-13T17:48:11.230 INFO:teuthology.task.ansible.out:changed: [gibba036.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10103, "groups": "sudo", "home": "/home/pdhange", "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "name": "pdhange", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10102} 2021-02-13T17:48:11.557 INFO:teuthology.task.ansible.out:changed: [gibba025.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10104, "groups": "sudo", "home": "/home/dpivonka", "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "name": "dpivonka", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10103} 2021-02-13T17:48:11.579 INFO:teuthology.task.ansible.out:changed: [gibba036.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10104, "groups": "sudo", "home": "/home/dpivonka", "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "name": "dpivonka", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10103} 2021-02-13T17:48:11.915 INFO:teuthology.task.ansible.out:changed: [gibba025.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10105, "groups": "sudo", "home": "/home/adking", "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "name": "adking", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10104} 2021-02-13T17:48:11.957 INFO:teuthology.task.ansible.out:changed: [gibba036.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10105, "groups": "sudo", "home": "/home/adking", "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "name": "adking", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10104} 2021-02-13T17:48:12.270 INFO:teuthology.task.ansible.out:changed: [gibba025.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10106, "groups": "sudo", "home": "/home/amathuri", "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267"}, "name": "amathuri", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10105} 2021-02-13T17:48:12.386 INFO:teuthology.task.ansible.out:changed: [gibba036.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10106, "groups": "sudo", "home": "/home/amathuri", "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267"}, "name": "amathuri", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10105} 2021-02-13T17:48:12.762 INFO:teuthology.task.ansible.out:changed: [gibba036.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10107, "groups": "sudo", "home": "/home/nizamial09", "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "name": "nizamial09", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10106} 2021-02-13T17:48:12.773 INFO:teuthology.task.ansible.out:changed: [gibba025.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10107, "groups": "sudo", "home": "/home/nizamial09", "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "name": "nizamial09", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10106} 2021-02-13T17:48:12.960 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:12 +0000 (0:00:14.019) 0:00:19.796 ***** 2021-02-13T17:48:12.994 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:12 +0000 (0:00:00.034) 0:00:19.831 ***** 2021-02-13T17:48:13.000 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2021-02-13T17:48:13.041 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:13 +0000 (0:00:00.046) 0:00:19.878 ***** 2021-02-13T17:48:13.085 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:13 +0000 (0:00:00.044) 0:00:19.922 ***** 2021-02-13T17:48:13.093 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* 2021-02-13T17:48:13.095 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratza@fedora r 2021-02-13T17:48:13.097 INFO:teuthology.task.ansible.out:T6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c 2021-02-13T17:48:13.098 INFO:teuthology.task.ansible.out:63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancich 2021-02-13T17:48:13.099 INFO:teuthology.task.ansible.out:", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiR 2021-02-13T17:48:13.101 INFO:teuthology.task.ansible.out:enVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "jdillaman", "ovpn": "jdi 2021-02-13T17:48:13.101 INFO:teuthology.task.ansible.out:llaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumr 2021-02-13T17:48:13.102 INFO:teuthology.task.ansible.out:ao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69m 2021-02-13T17:48:13.104 INFO:teuthology.task.ansible.out:h95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d84 2021-02-13T17:48:13.105 INFO:teuthology.task.ansible.out:1a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, {"name": "oliveiradan", "ovpn": "oliveiradan 2021-02-13T17:48:13.106 INFO:teuthology.task.ansible.out:@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOen 2021-02-13T17:48:13.108 INFO:teuthology.task.ansible.out:VV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9g 2021-02-13T17:48:13.109 INFO:teuthology.task.ansible.out:I46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": " 2021-02-13T17:48:13.110 INFO:teuthology.task.ansible.out:dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "acl 2021-02-13T17:48:13.110 INFO:teuthology.task.ansible.out:ewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NIN 2021-02-13T17:48:13.112 INFO:teuthology.task.ansible.out:j0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267"}, {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}]}, "changed": false} 2021-02-13T17:48:13.153 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:13 +0000 (0:00:00.067) 0:00:19.990 ***** 2021-02-13T17:48:13.163 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratza@fedora r 2021-02-13T17:48:13.164 INFO:teuthology.task.ansible.out:T6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c 2021-02-13T17:48:13.166 INFO:teuthology.task.ansible.out:63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancich 2021-02-13T17:48:13.167 INFO:teuthology.task.ansible.out:", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiR 2021-02-13T17:48:13.168 INFO:teuthology.task.ansible.out:enVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovp 2021-02-13T17:48:13.168 INFO:teuthology.task.ansible.out:n": "vumrao@vumr 2021-02-13T17:48:13.170 INFO:teuthology.task.ansible.out:ao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69m 2021-02-13T17:48:13.171 INFO:teuthology.task.ansible.out:h95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d84 2021-02-13T17:48:13.172 INFO:teuthology.task.ansible.out:1a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, {"name": "oliveiradan", "ovpn": "oliveiradan 2021-02-13T17:48:13.174 INFO:teuthology.task.ansible.out:@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOen 2021-02-13T17:48:13.175 INFO:teuthology.task.ansible.out:VV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001 2021-02-13T17:48:13.175 INFO:teuthology.task.ansible.out:f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9g 2021-02-13T17:48:13.176 INFO:teuthology.task.ansible.out:I46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": " 2021-02-13T17:48:13.178 INFO:teuthology.task.ansible.out:dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NIN 2021-02-13T17:48:13.179 INFO:teuthology.task.ansible.out:j0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267"}, {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}]}, "changed": false} 2021-02-13T17:48:13.218 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:13 +0000 (0:00:00.064) 0:00:20.055 ***** 2021-02-13T17:48:13.937 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2021-02-13T17:48:13.938 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com -> localhost] => {"after": "df8946f08e870e2d2565b79099289ca48bd825f3", "attempts": 1, "before": "df8946f08e870e2d2565b79099289ca48bd825f3", "changed": false, "remote_url_changed": false} 2021-02-13T17:48:13.978 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:13 +0000 (0:00:00.760) 0:00:20.815 ***** 2021-02-13T17:48:13.985 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com -> localhost] => {"after": "df8946f08e870e2d2565b79099289ca48bd825f3", "attempts": 1, "before": "df8946f08e870e2d2565b79099289ca48bd825f3", "changed": false, "remote_url_changed": false} 2021-02-13T17:48:14.022 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:14 +0000 (0:00:00.043) 0:00:20.858 ***** 2021-02-13T17:48:14.111 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-02-13T17:48:14.111 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2021-02-13T17:48:14.164 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2021-02-13T17:48:14.207 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2021-02-13T17:48:14.281 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2021-02-13T17:48:14.283 INFO:teuthology.task.ansible.out: 2021-02-13T17:48:14.314 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2021-02-13T17:48:14.378 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2021-02-13T17:48:14.421 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZt 2021-02-13T17:48:14.422 INFO:teuthology.task.ansible.out:IEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2021-02-13T17:48:14.495 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZt 2021-02-13T17:48:14.496 INFO:teuthology.task.ansible.out:IEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2021-02-13T17:48:14.516 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2021-02-13T17:48:14.590 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2021-02-13T17:48:14.612 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o 2021-02-13T17:48:14.613 INFO:teuthology.task.ansible.out:8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2021-02-13T17:48:14.697 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o 2021-02-13T17:48:14.698 INFO:teuthology.task.ansible.out:8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2021-02-13T17:48:14.708 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2021-02-13T17:48:14.808 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCgaz5AsLB+hPwnHjlf6vktlUQ8iWsKA+hViok+j+uCm0U/iho7O7Qd8E/3tp9yBx10Wkvuz1mmf6v2AO7Qa8+SE1QQPmA+4xLp4xXCqlUGFjnzm/7uQcQZtlWdfBHzQ9jVyPAgUpnGVUtW8PhW0txe8MEtecOO2C3Snx0yuTOx6O11jNvT938QjOeRQWw3X2YFUtMIOiwEhKtqstBIGXlMdaQKfvdlbA9MjyYy6VfK1x8lVcu8umUf/z56YmMkC2iO117/obhdu1XsU9SmjM51wHMOUCXSVqH8E3BWu0yohy4QmZDkdFihyYa+hoS9dOqGC91dFaQc46xrdmV4wqg1 jcaratza@MacBook-Pro\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAV78mqEy/VkB2BthIE/m7iE5sbTjTRS0KuH7AB0KPvZBsDIw5cL8jKyxiaPC85+aOkBa4LrP0TUFBzN87Snt+PLMz2QHBOvlSTfUuRkHVo3vWJFzVuUSzzddkYds3hAxUriAHKv6CRSy1yFBxPQQHTSATUHKWqihMElbUCZrrrfH8A7J9vwixzCSLg4KbINjfa77rxefcZwugUqiYiVUWUSOb023f+QEaDm7OP+/uzz3SjF1Y0LMwa75yctttIfkRBKjY7uFCuZdKc3l2A/fdPxbFwlZmIox3LLngdTzHMVXGbVHqq9Ixo8FSAXiI1Buy2LTMoXMJwQYSvzsv7xNwujKVlUjoE9cOOIdzCC5AziwSiJB4+tNh73c5tRUzMMC98HLOhPJriSPvOt1pMEdWDX3/evcyxvRgJUKgYnmQG7n8v8O/CLyG0sAJDmGC3U9S/3fUDUjZIKWSsc85Q3xRaJwZJIS2VZwH0zG1Gmynih8PPq7VeDx7tKuNm4uTYT8= bigjust@desktop-jsho3l9.lan", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2021-02-13T17:48:14.809 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2021-02-13T17:48:14.915 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2021-02-13T17:48:14.926 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCgaz5AsLB+hPwnHjlf6vktlUQ8iWsKA+hViok+j+uCm0U/iho7O7Qd8E/3tp9yBx10Wkvuz1mmf6v2AO7Qa8+SE1QQPmA+4xLp4xXCqlUGFjnzm/7uQcQZtlWdfBHzQ9jVyPAgUpnGVUtW8PhW0txe8MEtecOO2C3Snx0yuTOx6O11jNvT938QjOeRQWw3X2YFUtMIOiwEhKtqstBIGXlMdaQKfvdlbA9MjyYy6VfK1x8lVcu8umUf/z56YmMkC2iO117/obhdu1XsU9SmjM51wHMOUCXSVqH8E3BWu0yohy4QmZDkdFihyYa+hoS9dOqGC91dFaQc46xrdmV4wqg1 jcaratza@MacBook-Pro\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAV78mqEy/VkB2BthIE/m7iE5sbTjTRS0KuH7AB0KPvZBsDIw5cL8jKyxiaPC85+aOkBa4LrP0TUFBzN87Snt+PLMz2QHBOvlSTfUuRkHVo3vWJFzVuUSzzddkYds3hAxUriAHKv6CRSy1yFBxPQQHTSATUHKWqihMElbUCZrrrfH8A7J9vwixzCSLg4KbINjfa77rxefcZwugUqiYiVUWUSOb023f+QEaDm7OP+/uzz3SjF1Y0LMwa75yctttIfkRBKjY7uFCuZdKc3l2A/fdPxbFwlZmIox3LLngdTzHMVXGbVHqq9Ixo8FSAXiI1Buy2LTMoXMJwQYSvzsv7xNwujKVlUjoE9cOOIdzCC5AziwSiJB4+tNh73c5tRUzMMC98HLOhPJriSPvOt1pMEdWDX3/evcyxvRgJUKgYnmQG7n8v8O/CLyG0sAJDmGC3U9S/3fUDUjZIKWSsc85Q3xRaJwZJIS2VZwH0zG1Gmynih8PPq7VeDx7tKuNm4uTYT8= bigjust@desktop-jsho3l9.lan", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2021-02-13T17:48:14.938 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:15.022 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2021-02-13T17:48:15.033 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMorb 2021-02-13T17:48:15.035 INFO:teuthology.task.ansible.out:nuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:15.129 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMorb 2021-02-13T17:48:15.130 INFO:teuthology.task.ansible.out:nuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2021-02-13T17:48:15.141 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihWpgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemers 2021-02-13T17:48:15.143 INFO:teuthology.task.ansible.out:on", "validate_certs": true} 2021-02-13T17:48:15.152 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:15.164 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:15.227 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihWpgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemers 2021-02-13T17:48:15.229 INFO:teuthology.task.ansible.out:on", "validate_certs": true} 2021-02-13T17:48:15.239 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:15.251 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:15.263 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2021-02-13T17:48:15.266 INFO:teuthology.task.ansible.out: 2021-02-13T17:48:15.349 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2021-02-13T17:48:15.392 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtSo 2021-02-13T17:48:15.394 INFO:teuthology.task.ansible.out:AWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2021-02-13T17:48:15.456 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtSo 2021-02-13T17:48:15.458 INFO:teuthology.task.ansible.out:AWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2021-02-13T17:48:15.488 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2021-02-13T17:48:15.542 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2021-02-13T17:48:15.585 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "davidz", "validate_certs": true} 2021-02-13T17:48:15.586 INFO:teuthology.task.ansible.out: 2021-02-13T17:48:15.649 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "davidz", "validate_certs": true} 2021-02-13T17:48:15.651 INFO:teuthology.task.ansible.out: 2021-02-13T17:48:15.682 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2021-02-13T17:48:15.683 INFO:teuthology.task.ansible.out: 2021-02-13T17:48:15.736 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2021-02-13T17:48:15.780 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2021-02-13T17:48:15.835 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2021-02-13T17:48:15.868 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2021-02-13T17:48:15.922 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2021-02-13T17:48:15.968 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9C 2021-02-13T17:48:15.969 INFO:teuthology.task.ansible.out:kxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2021-02-13T17:48:16.011 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9C 2021-02-13T17:48:16.012 INFO:teuthology.task.ansible.out:kxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2021-02-13T17:48:16.054 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBYB 2021-02-13T17:48:16.055 INFO:teuthology.task.ansible.out:0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2021-02-13T17:48:16.108 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBYB 2021-02-13T17:48:16.110 INFO:teuthology.task.ansible.out:0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2021-02-13T17:48:16.151 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2021-02-13T17:48:16.204 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2021-02-13T17:48:16.236 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2021-02-13T17:48:16.289 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2021-02-13T17:48:16.332 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46T 2021-02-13T17:48:16.334 INFO:teuthology.task.ansible.out:RJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2021-02-13T17:48:16.386 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46T 2021-02-13T17:48:16.388 INFO:teuthology.task.ansible.out:RJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2021-02-13T17:48:16.419 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2021-02-13T17:48:16.483 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2021-02-13T17:48:16.515 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2021-02-13T17:48:16.569 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2021-02-13T17:48:16.611 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2021-02-13T17:48:16.664 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2021-02-13T17:48:16.696 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2021-02-13T17:48:16.696 INFO:teuthology.task.ansible.out: 2021-02-13T17:48:16.749 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2021-02-13T17:48:16.792 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2021-02-13T17:48:16.834 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2021-02-13T17:48:16.887 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQvU 2021-02-13T17:48:16.889 INFO:teuthology.task.ansible.out:xUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2021-02-13T17:48:16.929 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQvU 2021-02-13T17:48:16.931 INFO:teuthology.task.ansible.out:xUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2021-02-13T17:48:16.972 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2021-02-13T17:48:17.035 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2021-02-13T17:48:17.056 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2021-02-13T17:48:17.121 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2021-02-13T17:48:17.144 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2021-02-13T17:48:17.207 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2021-02-13T17:48:17.229 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2021-02-13T17:48:17.313 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2021-02-13T17:48:17.335 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA296in+8Sr9slF8hrzAV3dNz0q94Q4FlFaMYw08II5PQm6HOpabGOGOwOud/PPeh3lMUHhs45N5WnbgdfQdzz9lpDoNBcqxeACdMicdECMHtYWf2GuFUdTAnPBFVl8wFW5JcziQYJePUcAUJRXGGfdMLMppAi8VEuhMw/z3jz89UN+zf51Y9eT3rgAVSCR+Zn47kite4OB2S1aVMEcZBE0fPnh60i+rpN26s80fh3wG2N9JrPBEvst6LbL0aEixrlRUtoFHZuWNCIjntVMANa+idpuWSxN2dzfcoxpGLF1TFzqx0moznp0PnDs7ZAFFS1/EkeSCgBflyhPV6csG3VNw== jdillaman@ceph1.example.com", "key_options": null, "keyfile": "/home/jdillaman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jdillaman", "validate_certs": true} 2021-02-13T17:48:17.399 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA296in+8Sr9slF8hrzAV3dNz0q94Q4FlFaMYw08II5PQm6HOpabGOGOwOud/PPeh3lMUHhs45N5WnbgdfQdzz9lpDoNBcqxeACdMicdECMHtYWf2GuFUdTAnPBFVl8wFW5JcziQYJePUcAUJRXGGfdMLMppAi8VEuhMw/z3jz89UN+zf51Y9eT3rgAVSCR+Zn47kite4OB2S1aVMEcZBE0fPnh60i+rpN26s80fh3wG2N9JrPBEvst6LbL0aEixrlRUtoFHZuWNCIjntVMANa+idpuWSxN2dzfcoxpGLF1TFzqx0moznp0PnDs7ZAFFS1/EkeSCgBflyhPV6csG3VNw== jdillaman@ceph1.example.com", "key_options": null, "keyfile": "/home/jdillaman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jdillaman", "validate_certs": true} 2021-02-13T17:48:17.431 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2021-02-13T17:48:17.485 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2021-02-13T17:48:17.517 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-02-13T17:48:17.580 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-02-13T17:48:17.602 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2021-02-13T17:48:17.666 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2021-02-13T17:48:17.688 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIKepJjIovBTCkdVyvAdptljhw9bYcwtIqV/ojdbpeuJtxDo9UyrEkNoLeVpZgOcrbgrkOE7AEixo3qB9PbD8z5NRUleV7wipSh3QwrDmSylSVReJKOwYdxUKkzesZYBGIGYzAbTKqcVzPUWCeW314+xmv90XkO/+1vgbC5uoXfbfnaiDHQimBom8QV5Egr+EhhcuCqMEqaVSvjMr1T0e6IL9gUens6Mys6czI37go6QvmgEzkBbDJJ64PsiOOFHVNk4DJVJ1c7TRtsnpIHM1YVFjsH1AnAL6UufbgNSFf5dziUB/Bz815P1/jsOGpHkUKE37DbHU5xtLGl3MmimMt4ndcG6EggBGEYBwfEWPRAsZs3qngssrNH5W0CzbysLaoovzq5VqS8SdLMu5XrRLBEB0uWWzLq2bobYymk3t/oby5zrHJV78xAuLmldqjvlPZSdkgwWNv9YBLkteBVr2HhjtuashJ6amNPbA4kCGhXMpeRhfvfqs31CBEKbTV+A8ODWbWAoQxLCcqS24x0yMi73N0UzuqDTaJMcE8ODJvOxcLNaV688QDbrC/UehpX/Bp/DM7fLHj4YhkRpZxkkN5w2kb/bBbWya4DrffhHKqn9CH1z5ynj0237PhTwCXjtRn0JzpeRgN8OraFgR2H3uPc9XNqlkFxxOBK0lRngbxzw== owasserm@redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2021-02-13T17:48:17.690 INFO:teuthology.task.ansible.out: 2021-02-13T17:48:17.762 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIKepJjIovBTCkdVyvAdptljhw9bYcwtIqV/ojdbpeuJtxDo9UyrEkNoLeVpZgOcrbgrkOE7AEixo3qB9PbD8z5NRUleV7wipSh3QwrDmSylSVReJKOwYdxUKkzesZYBGIGYzAbTKqcVzPUWCeW314+xmv90XkO/+1vgbC5uoXfbfnaiDHQimBom8QV5Egr+EhhcuCqMEqaVSvjMr1T0e6IL9gUens6Mys6czI37go6QvmgEzkBbDJJ64PsiOOFHVNk4DJVJ1c7TRtsnpIHM1YVFjsH1AnAL6UufbgNSFf5dziUB/Bz815P1/jsOGpHkUKE37DbHU5xtLGl3MmimMt4ndcG6EggBGEYBwfEWPRAsZs3qngssrNH5W0CzbysLaoovzq5VqS8SdLMu5XrRLBEB0uWWzLq2bobYymk3t/oby5zrHJV78xAuLmldqjvlPZSdkgwWNv9YBLkteBVr2HhjtuashJ6amNPbA4kCGhXMpeRhfvfqs31CBEKbTV+A8ODWbWAoQxLCcqS24x0yMi73N0UzuqDTaJMcE8ODJvOxcLNaV688QDbrC/UehpX/Bp/DM7fLHj4YhkRpZxkkN5w2kb/bBbWya4DrffhHKqn9CH1z5ynj0237PhTwCXjtRn0JzpeRgN8OraFgR2H3uPc9XNqlkFxxOBK0lRngbxzw== owasserm@redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2021-02-13T17:48:17.785 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1O 2021-02-13T17:48:17.786 INFO:teuthology.task.ansible.out:MJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2021-02-13T17:48:17.849 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1O 2021-02-13T17:48:17.850 INFO:teuthology.task.ansible.out:MJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2021-02-13T17:48:17.881 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyKz 2021-02-13T17:48:17.883 INFO:teuthology.task.ansible.out:2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2021-02-13T17:48:17.934 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyKz 2021-02-13T17:48:17.936 INFO:teuthology.task.ansible.out:2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2021-02-13T17:48:17.966 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2021-02-13T17:48:18.030 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2021-02-13T17:48:18.062 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2021-02-13T17:48:18.115 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2021-02-13T17:48:18.151 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2021-02-13T17:48:18.204 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2021-02-13T17:48:18.236 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": nul 2021-02-13T17:48:18.238 INFO:teuthology.task.ansible.out:l, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-02-13T17:48:18.289 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": nul 2021-02-13T17:48:18.290 INFO:teuthology.task.ansible.out:l, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-02-13T17:48:18.321 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjEf 2021-02-13T17:48:18.323 INFO:teuthology.task.ansible.out:dVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+dT 2021-02-13T17:48:18.324 INFO:teuthology.task.ansible.out:zNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2021-02-13T17:48:18.385 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjEf 2021-02-13T17:48:18.386 INFO:teuthology.task.ansible.out:dVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+dT 2021-02-13T17:48:18.387 INFO:teuthology.task.ansible.out:zNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2021-02-13T17:48:18.417 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2021-02-13T17:48:18.481 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2021-02-13T17:48:18.503 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2021-02-13T17:48:18.556 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2021-02-13T17:48:18.588 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2021-02-13T17:48:18.651 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2021-02-13T17:48:18.673 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2021-02-13T17:48:18.737 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2021-02-13T17:48:18.759 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2021-02-13T17:48:18.826 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2021-02-13T17:48:18.847 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home/ 2021-02-13T17:48:18.849 INFO:teuthology.task.ansible.out:nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2021-02-13T17:48:18.921 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home/ 2021-02-13T17:48:18.922 INFO:teuthology.task.ansible.out:nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2021-02-13T17:48:18.943 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2021-02-13T17:48:19.006 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2021-02-13T17:48:19.028 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2021-02-13T17:48:19.092 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2021-02-13T17:48:19.124 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "g 2021-02-13T17:48:19.125 INFO:teuthology.task.ansible.out:abrioux", "validate_certs": true} 2021-02-13T17:48:19.188 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "g 2021-02-13T17:48:19.189 INFO:teuthology.task.ansible.out:abrioux", "validate_certs": true} 2021-02-13T17:48:19.210 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2021-02-13T17:48:19.273 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2021-02-13T17:48:19.305 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2021-02-13T17:48:19.368 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2021-02-13T17:48:19.400 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kkk 2021-02-13T17:48:19.401 INFO:teuthology.task.ansible.out:e6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2021-02-13T17:48:19.453 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kkk 2021-02-13T17:48:19.455 INFO:teuthology.task.ansible.out:e6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2021-02-13T17:48:19.486 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2021-02-13T17:48:19.550 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2021-02-13T17:48:19.572 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2021-02-13T17:48:19.646 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2021-02-13T17:48:19.658 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2021-02-13T17:48:19.742 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-02-13T17:48:19.743 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2021-02-13T17:48:19.849 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2021-02-13T17:48:19.849 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-02-13T17:48:19.933 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2021-02-13T17:48:19.934 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2021-02-13T17:48:20.018 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2021-02-13T17:48:20.020 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2021-02-13T17:48:20.105 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2021-02-13T17:48:20.116 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2021-02-13T17:48:20.201 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2021-02-13T17:48:20.202 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2021-02-13T17:48:20.288 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2021-02-13T17:48:20.289 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2021-02-13T17:48:20.384 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2021-02-13T17:48:20.384 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2021-02-13T17:48:20.479 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2021-02-13T17:48:20.480 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2021-02-13T17:48:20.565 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2021-02-13T17:48:20.566 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2021-02-13T17:48:20.649 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2021-02-13T17:48:20.650 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2021-02-13T17:48:20.745 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2021-02-13T17:48:20.746 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDklgWHrL9TMaMxIyN9MxVR6nR3xh9zfj0iR63/yOzaslX0WoVBk7CYTsRlH2GFVctvixVwrWbQgMaKe49utal/3FA6sMl8S2DTrtgC1a/exUTvU0U/+ZhyUlkyjQfRgtYOUwodNupL5NsC8VZqZshgmgXC34uye3bplx3VwvpUt9r6QxJN3/9Dbi6HxudhDCLfmvROhwQYHaFF+GglcbyjAt3uvsuwXVKBd1/vMQwbcUo9/zQlrnmWBRuqTNkXGrZauWigoi/hyuWYQ3MUbRc3LVpJncMv7BEtcj8fCVvPB09SFee3nSeTtFkm01GvRcYd3HBz/YL4Rz92wXl9VIxqs8aaJBzy+MD0NO496Rfqtz6YuZ1m7AxDIccDW+OpcPgYwaUKFXNTuVLWZXhkS0p4swefcKWRlQFF3BLOebN/Kr9jq1MFa+5pX7Gj4WF5uCIX0/fx40KVZNhfl3qywBy/d5MKwXO7PCHMiGcu2FIXdZ334MxdgiIVoX54PpRP4hs= smanjara@localhost.localdomain", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2021-02-13T17:48:20.841 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDklgWHrL9TMaMxIyN9MxVR6nR3xh9zfj0iR63/yOzaslX0WoVBk7CYTsRlH2GFVctvixVwrWbQgMaKe49utal/3FA6sMl8S2DTrtgC1a/exUTvU0U/+ZhyUlkyjQfRgtYOUwodNupL5NsC8VZqZshgmgXC34uye3bplx3VwvpUt9r6QxJN3/9Dbi6HxudhDCLfmvROhwQYHaFF+GglcbyjAt3uvsuwXVKBd1/vMQwbcUo9/zQlrnmWBRuqTNkXGrZauWigoi/hyuWYQ3MUbRc3LVpJncMv7BEtcj8fCVvPB09SFee3nSeTtFkm01GvRcYd3HBz/YL4Rz92wXl9VIxqs8aaJBzy+MD0NO496Rfqtz6YuZ1m7AxDIccDW+OpcPgYwaUKFXNTuVLWZXhkS0p4swefcKWRlQFF3BLOebN/Kr9jq1MFa+5pX7Gj4WF5uCIX0/fx40KVZNhfl3qywBy/d5MKwXO7PCHMiGcu2FIXdZ334MxdgiIVoX54PpRP4hs= smanjara@localhost.localdomain", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2021-02-13T17:48:20.841 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2021-02-13T17:48:20.936 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2021-02-13T17:48:20.936 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2021-02-13T17:48:21.020 INFO:teuthology.task.ansible.out:changed: [gibba025.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDQu/CuhCIFVGCLbA0cjn+qqcwX12cRcFA1sHyJtkj6Ltfmge8FnfgAsex/LaPJwbtbBiVl9xRcazHNfBaDw5DxMRSJF+e7WTydZC2Jm4qIj4D3Lr+imGPrJTK+kjN0QXRXknGsNn36oRF/I41cGqYRGwawFGSPZBHuav+ehDk1doTrbDlll4zMUWm2iXTcBIcJo4NR1LoE2c9/MPfbH7jKm5ke7aS0ets+EANEplkeClfCVAashtIF+Bz6a9qk4F2n0baLT/s3IQkXCwwO2fxxY03x8gWiB1n4E7sousEB+J1Skl/z0bwmaiY0C+raPoV/FyZxQuh0ocvdU7fnQbKuNoGE/Usfm9Y3g8eH81b/k4fMJL2lqXHkPft6zUV9bJsp3v1iGEkIf2+ER/QLczteNz6kw/uTPQctMEDXM17GEnBXISVrQcPSW3i93eFwWacs8iT3G4bjEQvpxSBQrhDdCCoxy8bVWqkVeDWw5u2q/3WL9Ov1NrY+G4/DYb2qONNQds0vTHCGvemU5GNjtaeCbojkZ7Z3KOeAY8080kKrsO7fve+ZMACCIFD+se8kF7NN4ZJASSqq9lJpBWvtbc0O8jCcVGNuN7exXjrcbiN1L/9HkARV+KEJU3jbXObAhAnfAaeRWBwmTfZodCu+fDd/Jor6l36tjD4kC4/CPrDtyQ== alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2021-02-13T17:48:21.021 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2021-02-13T17:48:21.116 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2021-02-13T17:48:21.116 INFO:teuthology.task.ansible.out:changed: [gibba036.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDQu/CuhCIFVGCLbA0cjn+qqcwX12cRcFA1sHyJtkj6Ltfmge8FnfgAsex/LaPJwbtbBiVl9xRcazHNfBaDw5DxMRSJF+e7WTydZC2Jm4qIj4D3Lr+imGPrJTK+kjN0QXRXknGsNn36oRF/I41cGqYRGwawFGSPZBHuav+ehDk1doTrbDlll4zMUWm2iXTcBIcJo4NR1LoE2c9/MPfbH7jKm5ke7aS0ets+EANEplkeClfCVAashtIF+Bz6a9qk4F2n0baLT/s3IQkXCwwO2fxxY03x8gWiB1n4E7sousEB+J1Skl/z0bwmaiY0C+raPoV/FyZxQuh0ocvdU7fnQbKuNoGE/Usfm9Y3g8eH81b/k4fMJL2lqXHkPft6zUV9bJsp3v1iGEkIf2+ER/QLczteNz6kw/uTPQctMEDXM17GEnBXISVrQcPSW3i93eFwWacs8iT3G4bjEQvpxSBQrhDdCCoxy8bVWqkVeDWw5u2q/3WL9Ov1NrY+G4/DYb2qONNQds0vTHCGvemU5GNjtaeCbojkZ7Z3KOeAY8080kKrsO7fve+ZMACCIFD+se8kF7NN4ZJASSqq9lJpBWvtbc0O8jCcVGNuN7exXjrcbiN1L/9HkARV+KEJU3jbXObAhAnfAaeRWBwmTfZodCu+fDd/Jor6l36tjD4kC4/CPrDtyQ== alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2021-02-13T17:48:21.201 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2021-02-13T17:48:21.212 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2021-02-13T17:48:21.296 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDp0xz0ml2XuoQe70TxVeTo3Ib5xMinDrYNJ5eq5XYNa8ZLGcEByeDK4myzixTloAo31Rb/yDyGqv6kQ6nFChihO2aab3Ni/bsMOaJat1scrznaIYXGvLvw5KYx/qBDUxb3qW0vO0N/bB3dUPS1l 2021-02-13T17:48:21.297 INFO:teuthology.task.ansible.out:XTJaVf+KuljUk7v38ov2gsPWlofRYZNkPGQfUKXFEXc39OVj+Ex5LkehH/Z1LwjRYJa7jAdSm8hE5m8m6WborrzAA4/iFuLbhtM/Bqm4boSqa7koBVux422QX/HblSQ2KAeT1GFOS7xdcO6ndyp6mIpCZWunTjZwSLyK20NvIV/AzdAro4GZWi0D34PPtbSG344ZT1dSLeDRhYVkDjS6uutrmw9C+Ns1bo8s1ydhxL2XEsU14SWRWlbyrMF9PXyJOsaNiBNWGwc9lTly0ZlmPnN3l0AC3RIKOstkEYmI+TMj21r1tltz48e+6dH1an51wwnhNRYiODd3hbS67tmIg05BuSU5+whJ93wzXw2rC4FLE= ylifshit@localhost.localdomain", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2021-02-13T17:48:21.381 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2021-02-13T17:48:21.393 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDp0xz0ml2XuoQe70TxVeTo3Ib5xMinDrYNJ5eq5XYNa8ZLGcEByeDK4myzixTloAo31Rb/yDyGqv6kQ6nFChihO2aab3Ni/bsMOaJat1scrznaIYXGvLvw5KYx/qBDUxb3qW0vO0N/bB3dUPS1l 2021-02-13T17:48:21.394 INFO:teuthology.task.ansible.out:XTJaVf+KuljUk7v38ov2gsPWlofRYZNkPGQfUKXFEXc39OVj+Ex5LkehH/Z1LwjRYJa7jAdSm8hE5m8m6WborrzAA4/iFuLbhtM/Bqm4boSqa7koBVux422QX/HblSQ2KAeT1GFOS7xdcO6ndyp6mIpCZWunTjZwSLyK20NvIV/AzdAro4GZWi0D34PPtbSG344ZT1dSLeDRhYVkDjS6uutrmw9C+Ns1bo8s1ydhxL2XEsU14SWRWlbyrMF9PXyJOsaNiBNWGwc9lTly0ZlmPnN3l0AC3RIKOstkEYmI+TMj21r1tltz48e+6dH1an51wwnhNRYiODd3hbS67tmIg05BuSU5+whJ93wzXw2rC4FLE= ylifshit@localhost.localdomain", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2021-02-13T17:48:21.477 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2021-02-13T17:48:21.478 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2021-02-13T17:48:21.562 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2021-02-13T17:48:21.562 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2021-02-13T17:48:21.658 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2021-02-13T17:48:21.659 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2021-02-13T17:48:21.743 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2021-02-13T17:48:21.743 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.localdo 2021-02-13T17:48:21.745 INFO:teuthology.task.ansible.out:main", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} 2021-02-13T17:48:21.838 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.localdo 2021-02-13T17:48:21.840 INFO:teuthology.task.ansible.out:main", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJ 2021-02-13T17:48:21.841 INFO:teuthology.task.ansible.out:Mlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2021-02-13T17:48:21.934 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq2 2021-02-13T17:48:21.935 INFO:teuthology.task.ansible.out:z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdqbYcbJYtgCrAbLo7PcS82caXxcT8cpX0RkULaFXfaiUDs8Foy6Yf/XoEHIdpgw8kX6qBdydYXxti6HFhYDNsL5KleKu/yA+bVKlvri39CRNkNxFHAUL2CR 2021-02-13T17:48:21.937 INFO:teuthology.task.ansible.out:BT5Hefj1AJQBm/BKVEN4/eb05OlJJ808Qb/aNycot/YwgpNvUIaO2yTMA0meq82wNdZmUcmyLB9QXz4QInTcoAsxq70KxX95YC938rTWpbg1hM8gzLkJJt/OD/Z7TMYv/Sc5KGOFqo930AmObQ5KPmffkWGYbLT65TxlCULnvIr63lWHdGTj5mYjib/v9ncu24az9GYRWYcicV0B/def+KVrrIp3Mz ideepika@teuthology", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2021-02-13T17:48:22.029 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2021-02-13T17:48:22.030 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdqbYcbJYtgCrAbLo7PcS82caXxcT8cpX0RkULaFXfaiUDs8Foy6Yf/XoEHIdpgw8kX6qBdydYXxti6HFhYDNsL5KleKu/yA+bVKlvri39CRNkNxFHAUL2CRBT5Hefj1AJQBm/BKVEN4/eb05OlJJ808Qb/aNycot/YwgpNvUIaO2yTMA0meq82wNdZmUcmyLB9QXz4QInTcoAsxq70KxX95YC938rTWpbg1hM8gzLkJJt/OD/Z7TMYv/Sc5KGOFqo930AmObQ5KPmffkWGYbLT65TxlCULnvIr63lWHdGTj5mYjib/v9ncu24az9GYRWYcicV0B/def+KVrrIp3Mz ideepika@teuthology", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2021-02-13T17:48:22.114 INFO:teuthology.task.ansible.out:changed: [gibba025.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrGYBGPDQqn+2jnxKhDurSrAJvTT8dZMYGVCt6NbjpFhDFYtyvrF8Jv5NKBQynG18LwscN7a57L0Oq0e4jOEPRz//CDcAfP+L6p45L4BdUzTysN4+rQ7waMnIiYp7VjSswhGH/BnYIVKwmDqzM2fo1w/oLIT6mgwUYqAdceeswAkXBt7jgagL8ox3E4oHBqER7f60AHdTviuW953t5luVQiMjyF2fOwZuo2ycufIzBee0CwS+xyRuJQwdgD3HL4Qs2vtBCX+H8n3wC6A9JrMA5tzCDr5VZKBJZURIniwvaXfJodjO4SvBL5jAfXoMqriv8ZWHbap2fk82YE8/uPqNvSISjixJEBgQinklZ+iAOYm5tfPbhPM/8ErpN/yJ0EoGRn+nj6X6nAjXAIk3AENopeqtM7mLZ26RFIuEV5ld7eqUvAfiy6Hk2LH9Q1Z4CXaxD0gDGzUxgdAaaAgLAR4btWi2n7Tb7ZNDdOfctg2ya9ftzZBOHvCaVXSpJCry/GMU= skoduri@localhost.localdomain", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2021-02-13T17:48:22.115 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2021-02-13T17:48:22.211 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2021-02-13T17:48:22.212 INFO:teuthology.task.ansible.out:changed: [gibba036.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrGYBGPDQqn+2jnxKhDurSrAJvTT8dZMYGVCt6NbjpFhDFYtyvrF8Jv5NKBQynG18LwscN7a57L0Oq0e4jOEPRz//CDcAfP+L6p45L4BdUzTysN4+rQ7waMnIiYp7VjSswhGH/BnYIVKwmDqzM2fo1w/oLIT6mgwUYqAdceeswAkXBt7jgagL8ox3E4oHBqER7f60AHdTviuW953t5luVQiMjyF2fOwZuo2ycufIzBee0CwS+xyRuJQwdgD3HL4Qs2vtBCX+H8n3wC6A9JrMA5tzCDr5VZKBJZURIniwvaXfJodjO4SvBL5jAfXoMqriv8ZWHbap2fk82YE8/uPqNvSISjixJEBgQinklZ+iAOYm5tfPbhPM/8ErpN/yJ0EoGRn+nj6X6nAjXAIk3AENopeqtM7mLZ26RFIuEV5ld7eqUvAfiy6Hk2LH9Q1Z4CXaxD0gDGzUxgdAaaAgLAR4btWi2n7Tb7ZNDdOfctg2ya9ftzZBOHvCaVXSpJCry/GMU= skoduri@localhost.localdomain", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2021-02-13T17:48:22.297 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2021-02-13T17:48:22.298 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2021-02-13T17:48:22.394 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2021-02-13T17:48:22.396 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2021-02-13T17:48:22.492 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2021-02-13T17:48:22.493 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2021-02-13T17:48:22.567 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2021-02-13T17:48:22.578 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDS3HkgHb6z+gi4tN5rBL/N+WLJgN8RtUokt0YnRjpor2epRbmqgmEFRbRFqjLK9LiTuLxmkwol1/G56AJms9ixue33M6jVs73nc259LDxn2qj/NCtxeU7xdjSDuhKyItgM0yuiFjWOKSYTghNtwoR26PX7SQVbycD4NN1ZuwUbdMQA31VrLvQR7d0lYKlis2auH2Xb6WifotoEyszZz1KYRwzJvOHtHku/jAyNmTD/8kAsuCjEgUPSyyehAfdWn59tY2gM7aFyj/dtRoAghekv5gkov9zx+zjN6D2LSN7e+DRti05iJMifA3nfmdj7f8aHzXDtsDL0XNkmmT3g9N2OQ8WL4ESOFASXPPj9JGUROealgnaQ+Y64evDClhbt2L7FLbgj5sgKb+XYhpGnAiC+v3t1Rq3HZrstOYf2qSYguIo+zW9gHwzJDqH5YNCpSF4ZDCfkJ94ngl5ptQmZ/FcrH2hBs2cMoyK9EyDpcI9hBeACTzu19kaB6DrOC+UTvBgYL2sNbCvi+caIqhENJICZ21rI4u4EZqu7PVb+Y3CLgSjTEgclGYBZoxlrT/X2QHrIfZF7lLGeeh0bureedCrBg4b61SL7ZU3Me9x1iWOZMSJgVvg+qPSrzZiHbA46k8i0af5Q+geL1BuuGy76zbYd/KR0KiNZnXjdlHyRz76rpQ== kamoltatsirivadhna@Ksirivad-MacBook-Pro.loca 2021-02-13T17:48:22.580 INFO:teuthology.task.ansible.out:l", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2021-02-13T17:48:22.663 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2021-02-13T17:48:22.674 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDS3HkgHb6z+gi4tN5rBL/N+WLJgN8RtUokt0YnRjpor2epRbmqgmEFRbRFqjLK9LiTuLxmkwol1/G56AJms9ixue33M6jVs73nc259LDxn2qj/NCtxeU7xdjSDuhKyItgM0yuiFjWOKSYTghNtwoR26PX7SQVbycD4NN1ZuwUbdMQA31VrLvQR7d0lYKlis2auH2Xb6WifotoEyszZz1KYRwzJvOHtHku/jAyNmTD/8kAsuCjEgUPSyyehAfdWn59tY2gM7aFyj/dtRoAghekv5gkov9zx+zjN6D2LSN7e+DRti05iJMifA3nfmdj7f8aHzXDtsDL0XNkmmT3g9N2OQ8WL4ESOFASXPPj9JGUROealgnaQ+Y64evDClhbt2L7FLbgj5sgKb+XYhpGnAiC+v3t1Rq3HZrstOYf2qSYguIo+zW9gHwzJDqH5YNCpSF4ZDCfkJ94ngl5ptQmZ/FcrH2hBs2cMoyK9EyDpcI9hBeACTzu19kaB6DrOC+UTvBgYL2sNbCvi+caIqhENJICZ21rI4u4EZqu7PVb+Y3CLgSjTEgclGYBZoxlrT/X2QHrIfZF7lLGeeh0bureedCrBg4b61SL7ZU3Me9x1iWOZMSJgVvg+qPSrzZiHbA46k8i0af5Q+geL1BuuGy76zbYd/KR0KiNZnXjdlHyRz76rpQ== kamoltatsirivadhna@Ksirivad-MacBook-Pro.loca 2021-02-13T17:48:22.676 INFO:teuthology.task.ansible.out:l", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2021-02-13T17:48:22.749 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2021-02-13T17:48:22.760 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2021-02-13T17:48:22.844 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2021-02-13T17:48:22.845 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2021-02-13T17:48:22.934 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2021-02-13T17:48:22.934 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2021-02-13T17:48:23.018 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2021-02-13T17:48:23.029 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2021-02-13T17:48:23.114 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2021-02-13T17:48:23.115 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2021-02-13T17:48:23.199 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", " 2021-02-13T17:48:23.200 INFO:teuthology.task.ansible.out:manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2021-02-13T17:48:23.295 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", " 2021-02-13T17:48:23.296 INFO:teuthology.task.ansible.out:manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOJg56HsyNa5vHHb52G6O5vtv9I2tdlNMjFlG3SVCCu/bVZwVeGzp1ekuNGU10owmnIvhlSldMjLn2wwTwiDjbvYJVVCPvzK63vCUcMevRsvr9EyU16JdAgrmrGMyuYYEb+wh8XWI9Dc72o84fMaBYFSSer1S9nUBL+KVLVhIe7culgADimrDgDVh2t7u2JHBI0m0nKFGJZNcIyYf+GKOM+n7SaQXIYIytvSteU5BvUIKPsDd4z5lVlWiKO3kG6jF2RnKFV6KWBWI9m8YGItdGu25mXELXN9MOlApZF3AoGTmCE2Web7uDVGvO6rz6b+dc7RXTOlbWIhtMoRqQf6mz zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2021-02-13T17:48:23.380 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2021-02-13T17:48:23.381 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOJg56HsyNa5vHHb52G6O5vtv9I2tdlNMjFlG3SVCCu/bVZwVeGzp1ekuNGU10owmnIvhlSldMjLn2wwTwiDjbvYJVVCPvzK63vCUcMevRsvr9EyU16JdAgrmrGMyuYYEb+wh8XWI9Dc72o84fMaBYFSSer1S9nUBL+KVLVhIe7culgADimrDgDVh2t7u2JHBI0m0nKFGJZNcIyYf+GKOM+n7SaQXIYIytvSteU5BvUIKPsDd4z5lVlWiKO3kG6jF2RnKFV6KWBWI9m8YGItdGu25mXELXN9MOlApZF3AoGTmCE2Web7uDVGvO6rz6b+dc7RXTOlbWIhtMoRqQf6mz zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2021-02-13T17:48:23.475 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2021-02-13T17:48:23.476 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2021-02-13T17:48:23.559 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2021-02-13T17:48:23.560 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2021-02-13T17:48:23.644 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2021-02-13T17:48:23.644 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2021-02-13T17:48:23.729 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2021-02-13T17:48:23.729 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2021-02-13T17:48:23.824 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2021-02-13T17:48:23.824 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2021-02-13T17:48:23.908 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2021-02-13T17:48:23.920 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2021-02-13T17:48:24.005 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2021-02-13T17:48:24.005 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2021-02-13T17:48:24.089 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2021-02-13T17:48:24.090 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2021-02-13T17:48:24.174 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2021-02-13T17:48:24.175 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2021-02-13T17:48:24.259 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2021-02-13T17:48:24.260 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2021-02-13T17:48:24.344 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2021-02-13T17:48:24.355 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2021-02-13T17:48:24.441 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2021-02-13T17:48:24.441 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2021-02-13T17:48:24.527 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2021-02-13T17:48:24.539 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2021-02-13T17:48:24.624 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2021-02-13T17:48:24.625 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2021-02-13T17:48:24.710 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2021-02-13T17:48:24.721 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2021-02-13T17:48:24.806 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2021-02-13T17:48:24.807 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2021-02-13T17:48:24.893 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2021-02-13T17:48:24.905 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9VRB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFTVsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7TgpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpbcmjLd 2021-02-13T17:48:24.907 INFO:teuthology.task.ansible.out:+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} 2021-02-13T17:48:24.989 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9VRB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFTVsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7TgpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpbcmjLd 2021-02-13T17:48:24.991 INFO:teuthology.task.ansible.out:+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} 2021-02-13T17:48:25.073 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} 2021-02-13T17:48:25.084 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_certs": true} 2021-02-13T17:48:25.168 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} 2021-02-13T17:48:25.180 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_certs": true} 2021-02-13T17:48:25.264 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYh28a9R3a7jpRfPqVAL9EcD+S6KkZzKTfCmRn4s8Fg39kUZsgnWUZQ3jUxKSeBA00te7WMR8CsIEzulm7f+/egNuPcvzNI/SaaCDtVMaxqlEuW85ll8uBQi3s4SLmOu9oS+5oid4cqTrGTcG6uhl29oWS/53SxoGh+T+y6GesO2cYRuTpcUHxGMvIgZe/bKtVGdP1y7rQd62e8emb9UupMBxaHpkYj9AaMuLjovHbBgecWbe4PlzPWNzl+eITVk2d6CxxIem4/bw9VHkRjQZlhL2nbwRgtczLYhlaZAd4ePEtsqA+7nTDjTDhXXHVIf1pDAsJbZEdgQCSGH3FzxtrQ2hZJrH/NIKdHk/OtI06e7POSGj7PcHzTvMjQSFnTpJXinxwzn0lvFSlmABN/00lIE0p2ZXfPs6dgWJ17JnTq6dMUoTiGhfKphPHyfSXJCzfa2VB+lQQ5eAaa9cRXy9pLmWGHXVGz2hsBMtyYmTjR/wr8kdTzeK+Jk4opBtGgcxDustg59b9x/jvgoc3HCdtnkqLTug2KmutB6kb+4KnVO07GsSp0RmNtDmCRcXs9YN/eia9ICtIGDWPc3YDRppsw1Vktza/+ZW5vGzIKILZTo4SNGcg19zQw4Qxd9eLkXfB66vE2CQvA90CGo7mcye+UWjjXLr7i0cDEszAloQ9aQ== srangana@redhat.com", "key_options": null, "keyfile": "/home/shyamsundarr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyamsundarr", "validate_certs": true} 2021-02-13T17:48:25.264 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} 2021-02-13T17:48:25.351 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRZyOnj6D9tCw5o4+ujpos5Uj1O0XVvea798DsXPRh8bEE1pLkARQJLv4iW6LsG3x/CXruahmwT+6C/VHppIsbgtpadMWdCTPYrsjctPK0/N9nr4kQEL6XeK3/GHFnwqYcc+LySpNNfbKrgN4qWOwdZBhQjSV7K7FJd4ZYSm4wp6TVbvKKp7o+JdeM2zhstfC9AcCtBv/TpxixFFq/+y8/Z0PwqN1YyHduDOr1dr1DWn4ZzrkhiTYfPOltx0jweD6zTJoTAJDqae7kBA+3XH3dUGX3n7Tchsa3bnIKVz9sLQvH/vPro61I+Xig6MQh77JsylNvpwb1LLOEzDf7dxl bigwhite@wrjj37deMacBook-Pro-2.local", "key_options": null, "keyfile": "/home/shuzhenyi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shuzhenyi", "validate_certs": true} 2021-02-13T17:48:25.351 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYh28a9R3a7jpRfPqVAL9EcD+S6KkZzKTfCmRn4s8Fg39kUZsgnWUZQ3jUxKSeBA00te7WMR8CsIEzulm7f+/egNuPcvzNI/SaaCDtVMaxqlEuW85ll8uBQi3s4SLmOu9oS+5oid4cqTrGTcG6uhl29oWS/53SxoGh+T+y6GesO2cYRuTpcUHxGMvIgZe/bKtVGdP1y7rQd62e8emb9UupMBxaHpkYj9AaMuLjovHbBgecWbe4PlzPWNzl+eITVk2d6CxxIem4/bw9VHkRjQZlhL2nbwRgtczLYhlaZAd4ePEtsqA+7nTDjTDhXXHVIf1pDAsJbZEdgQCSGH3FzxtrQ2hZJrH/NIKdHk/OtI06e7POSGj7PcHzTvMjQSFnTpJXinxwzn0lvFSlmABN/00lIE0p2ZXfPs6dgWJ17JnTq6dMUoTiGhfKphPHyfSXJCzfa2VB+lQQ5eAaa9cRXy9pLmWGHXVGz2hsBMtyYmTjR/wr8kdTzeK+Jk4opBtGgcxDustg59b9x/jvgoc3HCdtnkqLTug2KmutB6kb+4KnVO07GsSp0RmNtDmCRcXs9YN/eia9ICtIGDWPc3YDRppsw1Vktza/+ZW5vGzIKILZTo4SNGcg19zQw4Qxd9eLkXfB66vE2CQvA90CGo7mcye+UWjjXLr7i0cDEszAloQ9aQ== srangana@redhat.com", "key_options": null, "keyfile": "/home/shyamsundarr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyamsundarr", "validate_certs": true} 2021-02-13T17:48:25.437 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEcI3X9mNxtHRSvi2gVFavu21kRCWDd1erXW3d/1zWnoUvRxe9ft2xA1c3Bmo067GqhFudPcXoYJvz3atAGR9k3n1UTtTJe95XRZ1Zmn/boi6mn7I2oRVFpW/KjxaiM3iN2SHKknMtcs6qRTioapYCU7u924oc0izqPBvkrC73cfVF4emH1ERWEcQBTxWub6N6Mn3xaDmJ5xnGlNvDY70CC9osoa2VRNJM7GU9eUQClHirPbSooDvvVKfTGD7YfMH76j6PdDR/a/cgNeiMevtMbeFGhu1SOEHb1ihCNoGq2vQFPPWwwTCzMI05XuUEc4iaxw/kbGBMpWbmIvswIMQrRwgwLZk67GGpf/dEeutI6WseeNKNuHnTzzx43AW9G2coGq0RKE7OuA5Cqj0CO7Kcf5UA4AqIIroLETVBrrEV6qzpkD74QBZXPl7gbSZIyxLpvtQoMfSSzN+Mj184LmQoURCqIT+yM5gddF5/S5I+rpw81vBj5M9ZskyzVQAo0H8= michelledipalma@mdipalma-mac", "key_options": null, "keyfile": "/home/mdipalma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mdipalma", "validate_certs": true} 2021-02-13T17:48:25.449 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRZyOnj6D9tCw5o4+ujpos5Uj1O0XVvea798DsXPRh8bEE1pLkARQJLv4iW6LsG3x/CXruahmwT+6C/VHppIsbgtpadMWdCTPYrsjctPK0/N9nr4kQEL6XeK3/GHFnwqYcc+LySpNNfbKrgN4qWOwdZBhQjSV7K7FJd4ZYSm4wp6TVbvKKp7o+JdeM2zhstfC9AcCtBv/TpxixFFq/+y8/Z0PwqN1YyHduDOr1dr1DWn4ZzrkhiTYfPOltx0jweD6zTJoTAJDqae7kBA+3XH3dUGX3n7Tchsa3bnIKVz9sLQvH/vPro61I+Xig6MQh77JsylNvpwb1LLOEzDf7dxl bigwhite@wrjj37deMacBook-Pro-2.local", "key_options": null, "keyfile": "/home/shuzhenyi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shuzhenyi", "validate_certs": true} 2021-02-13T17:48:25.450 INFO:teuthology.task.ansible.out: 2021-02-13T17:48:25.524 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+tqgRGdlbb7NMefZVPCtbzVZBapxmmPcKaUtqT7E/9AKRoHuroZQ7KJQfO15POpIfEja7BugBt5F95aW2Bd9/xhulzC4/JjiZYc6ST5Na03BrcudI3YcktoGR8Mm7ZVzSojvm0SKtLLHM5Su17JpCC7BitMdao1mETlUOklEXc6pgbr9XHOayo1zeuos8DB90iA8TQ2soR/POD1Rix4GKniCHXz10+iXQFYPsif1HsQ3rh8Vi1M0cTq98bMSmfsKODil8KIxf+lvLCL4GAgDYEyxnstiTFh5GAcIMOOo2dl1fDb/Oa981CxWU+xxJD+M7AEJVeyAqqAnShvZU6y1L kiefer@kiefer-uchi", "key_options": null, "keyfile": "/home/kchang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchang", "validate_certs": true} 2021-02-13T17:48:25.534 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEcI3X9mNxtHRSvi2gVFavu21kRCWDd1erXW3d/1zWnoUvRxe9ft2xA1c3Bmo067GqhFudPcXoYJvz3atAGR9k3n1UTtTJe95XRZ1Zmn/boi6mn7I2oRVFpW/KjxaiM3iN2SHKknMtcs6qRTioapYCU7u924oc0izqPBvkrC73cfVF4emH1ERWEcQBTxWub6N6Mn3xaDmJ5xnGlNvDY70CC9osoa2VRNJM7GU9eUQClHirPbSooDvvVKfTGD7YfMH76j6PdDR/a/cgNeiMevtMbeFGhu1SOEHb1ihCNoGq2vQFPPWwwTCzMI05XuUEc4iaxw/kbGBMpWbmIvswIMQrRwgwLZk67GGpf/dEeutI6WseeNKNuHnTzzx43AW9G2coGq0RKE7OuA5Cqj0CO7Kcf5UA4AqIIroLETVBrrEV6qzpkD74QBZXPl7gbSZIyxLpvtQoMfSSzN+Mj184LmQoURCqIT+yM5gddF5/S5I+rpw81vBj5M9ZskyzVQAo0H8= michelledipalma@mdipalma-mac", "key_options": null, "keyfile": "/home/mdipalma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mdipalma", "validate_certs": true} 2021-02-13T17:48:25.619 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+tqgRGdlbb7NMefZVPCtbzVZBapxmmPcKaUtqT7E/9AKRoHuroZQ7KJQfO15POpIfEja7BugBt5F95aW2Bd9/xhulzC4/JjiZYc6ST5Na03BrcudI3YcktoGR8Mm7ZVzSojvm0SKtLLHM5Su17JpCC7BitMdao1mETlUOklEXc6pgbr9XHOayo1zeuos8DB90iA8TQ2soR/POD1Rix4GKniCHXz10+iXQFYPsif1HsQ3rh8Vi1M0cTq98bMSmfsKODil8KIxf+lvLCL4GAgDYEyxnstiTFh5GAcIMOOo2dl1fDb/Oa981CxWU+xxJD+M7AEJVeyAqqAnShvZU6y1L kiefer@kiefer-uchi", "key_options": null, "keyfile": "/home/kchang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchang", "validate_certs": true} 2021-02-13T17:48:25.620 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDjj3bbbLvd4IHeFrSJyM9N6uKXA7ElQrzfcisKRGjUPON8IsAWkXQeAnHoBsIQv7tRGudXOrK+tbfv7crLI0/CxL+o0cCVW8bxuTEtdz07ZFsND9cppCc7Yq+wHsg7nQ/n0QfxnlYc0T9pATXUoT+aW4c3NQoDbsupLSkNs1C+G/MEBzz6iH6tgrv43OAOUccfQbC+IYx4RIKL5MteEjVrZanNELIG+jsYe+CZLdsONk1nR8+xKQw19Sm/jkKdl1K9NXoVPEBQmFXrYl6G+7tCdWeU3Vq24lM1X5p1mVspcG6FyyctcuP/8+zhL2L208DrXlOVPcqHR/4FEf3Wmk89 vereddy@vereddy.remote.csb", "key_options": null, "keyfile": "/home/vereddy/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vereddy", "validate_certs": true} 2021-02-13T17:48:25.704 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+EkUbnaeC7Dqtq2N4/dX9v+WGlrgRS2ygHhlbZy4KHbd6+Q9T5NAWtqnFwqcbFpYYUBwMvz8zLo6HYN6gNskRN0qTiFKPQdtnydF0Tx1KHrdGGcX3G2lxyGH5P8nrqReXAPPvRiVc2/Mj7APCTmY2JftkSS1qYcTleeueivVyho6z6uD1AyC7OXANhtn7kGeIY/NvVKBhDr+3TuPmpPwPCQMcJUyZWCHYyp47v2vzNBy2Etp7WjGwOnfZ5ULiJGjH6PCXx0YfpmTUOPVkNbV6Om+0YJ3fcLlmQ/2nsdsWfOKvoAr+1uzO81h7ZBX9LVEitj8YU3WeSCV2vqS2VvOpq5NyHXWGq+ZkOCfhy4Z9MvMG+6hqp4p4z1JMpKsZ191kP7eAQua41GkTSQPlEfF+um1UV6ZjNzhB68utOXyGDoDcxct9oOdnhhjwu5W4/0t9iBHuMn02iHRYVrUWOH2FXVysR0p5x/L2xdvNPiTgFAZ2eN+EFWmdan4e9mAAw3M= gbenhano@localhost.localdomain", "key_options": null, "keyfile": "/home/benhanokh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "benhanokh", "validate_certs": true} 2021-02-13T17:48:25.705 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDjj3bbbLvd4IHeFrSJyM9N6uKXA7ElQrzfcisKRGjUPON8IsAWkXQeAnHoBsIQv7tRGudXOrK+tbfv7crLI0/CxL+o0cCVW8bxuTEtdz07ZFsND9cppCc7Yq+wHsg7nQ/n0QfxnlYc0T9pATXUoT+aW4c3NQoDbsupLSkNs1C+G/MEBzz6iH6tgrv43OAOUccfQbC+IYx4RIKL5MteEjVrZanNELIG+jsYe+CZLdsONk1nR8+xKQw19Sm/jkKdl1K9NXoVPEBQmFXrYl6G+7tCdWeU3Vq24lM1X5p1mVspcG6FyyctcuP/8+zhL2L208DrXlOVPcqHR/4FEf3Wmk89 vereddy@vereddy.remote.csb", "key_options": null, "keyfile": "/home/vereddy/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vereddy", "validate_certs": true} 2021-02-13T17:48:25.789 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBYtdHKBXQcXQFkEW8fSwlFK/xZM16VcFY288ABI/DPfejTStHhxiRvmlsWzMy0Ar5WadZ8FU1ptjA3MKBEY1Do1r1Ul369k3zHCvxXyg9QGGMNPYfHmnNeoF4GEgoJpuounPs0mkLmrPTR+cR+/XuaZZt38nsad8M/zJetnolvqCWpcV87D7+Rt8F32J6kGDknC4ikEe8I0n7F+goOmJhlgkqegbKEeJ/EMnOItwVZHFwaC+sxOq4IlYp2f1aZMKGAtr5+ICwYH1SMCcvnp3qWL8O//t2tvguZgQxzIs6Nf5GaxwdQkh4CvjbWiCkIbGFJ57YICS6k++KMXMbEnwh jsalomon@Josh-laptop.tlv.redhat.com", "key_options": null, "keyfile": "/home/jsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsalomon", "validate_certs": true} 2021-02-13T17:48:25.800 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+EkUbnaeC7Dqtq2N4/dX9v+WGlrgRS2ygHhlbZy4KHbd6+Q9T5NAWtqnFwqcbFpYYUBwMvz8zLo6HYN6gNskRN0qTiFKPQdtnydF0Tx1KHrdGGcX3G2lxyGH5P8nrqReXAPPvRiVc2/Mj7APCTmY2JftkSS1qYcTleeueivVyho6z6uD1AyC7OXANhtn7kGeIY/NvVKBhDr+3TuPmpPwPCQMcJUyZWCHYyp47v2vzNBy2Etp7WjGwOnfZ5ULiJGjH6PCXx0YfpmTUOPVkNbV6Om+0YJ3fcLlmQ/2nsdsWfOKvoAr+1uzO81h7ZBX9LVEitj8YU3WeSCV2vqS2VvOpq5NyHXWGq+ZkOCfhy4Z9MvMG+6hqp4p4z1JMpKsZ191kP7eAQua41GkTSQPlEfF+um1UV6ZjNzhB68utOXyGDoDcxct9oOdnhhjwu5W4/0t9iBHuMn02iHRYVrUWOH2FXVysR0p5x/L2xdvNPiTgFAZ2eN+EFWmdan4e9mAAw3M= gbenhano@localhost.localdomain", "key_options": null, "keyfile": "/home/benhanokh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "benhanokh", "validate_certs": true} 2021-02-13T17:48:25.885 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9ltUNitnn0FNwMeiGkBnozpBN5ziVR2MreaqkfqTQY2TgI24559xuILyy+TnAKumhemZ8i8nIQ876Iso85OzIXbUbRM45hpL/bMQX7pWyMIRNeFKrCDwf18OT0DPc8aeDOAFQ6YoN0j4awUENjdZuuAW80cfcjoQO3m7ORF8wBF0IvMWwPDIQQrz+Li31ECgXg6VC7K3e+BNHlfNQ/2/ahS0+V4J6JYFsylZL0r2tydhDMd6rR8QA9c9BgeBz7+KWobGtiZVe7KReTzJ0O38PxNd8br3aS50j5BiN63gch8eFxPAROaUMnuiavu6OTDy4/aeL3Zc5WpUy3VyyumWf jolmomar@localhost.localdomain", "key_options": null, "keyfile": "/home/jolmomar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jolmomar", "validate_certs": true} 2021-02-13T17:48:25.885 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBYtdHKBXQcXQFkEW8fSwlFK/xZM16VcFY288ABI/DPfejTStHhxiRvmlsWzMy0Ar5WadZ8FU1ptjA3MKBEY1Do1r1Ul369k3zHCvxXyg9QGGMNPYfHmnNeoF4GEgoJpuounPs0mkLmrPTR+cR+/XuaZZt38nsad8M/zJetnolvqCWpcV87D7+Rt8F32J6kGDknC4ikEe8I0n7F+goOmJhlgkqegbKEeJ/EMnOItwVZHFwaC+sxOq4IlYp2f1aZMKGAtr5+ICwYH1SMCcvnp3qWL8O//t2tvguZgQxzIs6Nf5GaxwdQkh4CvjbWiCkIbGFJ57YICS6k++KMXMbEnwh jsalomon@Josh-laptop.tlv.redhat.com", "key_options": null, "keyfile": "/home/jsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsalomon", "validate_certs": true} 2021-02-13T17:48:25.970 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQKiUAlB8dxudAY60M7jnIJvs9yb2pNaT+BVv1Vk1kMs0XjPjcw9cyT3DtQ1xGLF367phRi/cfQbXOYbHG+uyBzQ4EEnBFvziktWRx4mfeWYxKjkjbfkVfpKPsxztqCbwm6+NYzMxGK2cExN7jUHnghHAjfA0IUpVVg9peBD3kUveLwS+UxuJAnuj+G4480LS6GDyLrhFEXU7uOIIlW4S9oLnU6vJL6GAzwyLE4ijTA8Ek03SJ01Ey/gpU9AqnQNp9u12l/7sJely6sI9pAuIzmS8Ht324hexxSWN5sFjXgLvLfFK83ziDBdrFBr0WXnWsFdRpHs2CwSq1JTkByqbN hmunjulu@hmunjulu.remote.csb", "key_options": null, "keyfile": "/home/hmunjulu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hmunjulu", "validate_certs": true} 2021-02-13T17:48:25.971 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9ltUNitnn0FNwMeiGkBnozpBN5ziVR2MreaqkfqTQY2TgI24559xuILyy+TnAKumhemZ8i8nIQ876Iso85OzIXbUbRM45hpL/bMQX7pWyMIRNeFKrCDwf18OT0DPc8aeDOAFQ6YoN0j4awUENjdZuuAW80cfcjoQO3m7ORF8wBF0IvMWwPDIQQrz+Li31ECgXg6VC7K3e+BNHlfNQ/2/ahS0+V4J6JYFsylZL0r2tydhDMd6rR8QA9c9BgeBz7+KWobGtiZVe7KReTzJ0O38PxNd8br3aS50j5BiN63gch8eFxPAROaUMnuiavu6OTDy4/aeL3Zc5WpUy3VyyumWf jolmomar@localhost.localdomain", "key_options": null, "keyfile": "/home/jolmomar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jolmomar", "validate_certs": true} 2021-02-13T17:48:26.064 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoefxOfeArToGucfWG7y1tyLF2I1J/IkBSlmxxEJyHyDUB6ElXjYIJReoiPfmB0xLEmINpmt8QA4XN/8UbR1r9LFOexlZZbX1LSbihi11LXCvfIJWqkHVwIyKHRTu/duMrntBFVENJ0LVf0GSWVTtllXaDA+fMkp6/ra/hlRHQbx19UXy/9+Pogj8Xl+SntnMGiHlX8FFq2A2tUqhdQSf/1GW1HfUIa5WtwdEqIpKpAgMM7sOW9i3QAmLAMo8HiKrArSiy7jrRUODCqsTJsfifxEbmnOS0ZtmDh0eeWL/Dyqbz99Rg4WbFNeK8oyZYr7D6bEAhd2az2A+wycPx4Nq7 julpark@julpark.remote.csb", "key_options": null, "keyfile": "/home/julpark/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "julpark", "validate_certs": true} 2021-02-13T17:48:26.065 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQKiUAlB8dxudAY60M7jnIJvs9yb2pNaT+BVv1Vk1kMs0XjPjcw9cyT3DtQ1xGLF367phRi/cfQbXOYbHG+uyBzQ4EEnBFvziktWRx4mfeWYxKjkjbfkVfpKPsxztqCbwm6+NYzMxGK2cExN7jUHnghHAjfA0IUpVVg9peBD3kUveLwS+UxuJAnuj+G4480LS6GDyLrhFEXU7uOIIlW4S9oLnU6vJL6GAzwyLE4ijTA8Ek03SJ01Ey/gpU9AqnQNp9u12l/7sJely6sI9pAuIzmS8Ht324hexxSWN5sFjXgLvLfFK83ziDBdrFBr0WXnWsFdRpHs2CwSq1JTkByqbN hmunjulu@hmunjulu.remote.csb", "key_options": null, "keyfile": "/home/hmunjulu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hmunjulu", "validate_certs": true} 2021-02-13T17:48:26.149 INFO:teuthology.task.ansible.out:changed: [gibba025.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD03otezqmbR7v9dq62mWH5Kkg692jdmDZk6Ve4vux0A0YhxBuXDCyBWLE1Z4lLNxQahvK0pGsgokp+Uk+Q6aU+ZnF/E2jLp6YWerFXIHY3M7byObJx9+QuVBfNI0bZBkV3+vSjhSCGOYU+TrTHsKZqhsTcejZjmL3gFLmWfU6dTh0sX05qz97cdJl3CMPhCIR3KjtkiPygj417/N7wet/Efv1t79TvyS7dtK1oz+zRLEpKi/fZjvpXb8xec7as72Y0XexsWMDyZJ/N8PijTQ5L6EfLMV7ae/bWGzNAKsoC1dHVY7q/Q4pzktC6zU0Rc9sDRMtrgFg+q+04BfveSLfxTb9tqf7SbSvh7IAG1eKiEuDT/uy3T6Uiw+CiZ0eIqYzZscO/aDjUArGbS8eyaycybdYCBK9Jz38i0mYKkXg855yoVuIExr6MXieYwyVoVW8gbx1bAslaafrzra2dkAFByOJ0sbosPFRgR2+boUSxD6IaE+ALgno4T/0CI2RMiH0= prashant@cephdev", "key_options": null, "keyfile": "/home/pdhange/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdhange", "validate_certs": true} 2021-02-13T17:48:26.150 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoefxOfeArToGucfWG7y1tyLF2I1J/IkBSlmxxEJyHyDUB6ElXjYIJReoiPfmB0xLEmINpmt8QA4XN/8UbR1r9LFOexlZZbX1LSbihi11LXCvfIJWqkHVwIyKHRTu/duMrntBFVENJ0LVf0GSWVTtllXaDA+fMkp6/ra/hlRHQbx19UXy/9+Pogj8Xl+SntnMGiHlX8FFq2A2tUqhdQSf/1GW1HfUIa5WtwdEqIpKpAgMM7sOW9i3QAmLAMo8HiKrArSiy7jrRUODCqsTJsfifxEbmnOS0ZtmDh0eeWL/Dyqbz99Rg4WbFNeK8oyZYr7D6bEAhd2az2A+wycPx4Nq7 julpark@julpark.remote.csb", "key_options": null, "keyfile": "/home/julpark/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "julpark", "validate_certs": true} 2021-02-13T17:48:26.234 INFO:teuthology.task.ansible.out:changed: [gibba036.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD03otezqmbR7v9dq62mWH5Kkg692jdmDZk6Ve4vux0A0YhxBuXDCyBWLE1Z4lLNxQahvK0pGsgokp+Uk+Q6aU+ZnF/E2jLp6YWerFXIHY3M7byObJx9+QuVBfNI0bZBkV3+vSjhSCGOYU+TrTHsKZqhsTcejZjmL3gFLmWfU6dTh0sX05qz97cdJl3CMPhCIR3KjtkiPygj417/N7wet/Efv1t79TvyS7dtK1oz+zRLEpKi/fZjvpXb8xec7as72Y0XexsWMDyZJ/N8PijTQ5L6EfLMV7ae/bWGzNAKsoC1dHVY7q/Q4pzktC6zU0Rc9sDRMtrgFg+q+04BfveSLfxTb9tqf7SbSvh7IAG1eKiEuDT/uy3T6Uiw+CiZ0eIqYzZscO/aDjUArGbS8eyaycybdYCBK9Jz38i0mYKkXg855yoVuIExr6MXieYwyVoVW8gbx1bAslaafrzra2dkAFByOJ0sbosPFRgR2+boUSxD6IaE+ALgno4T/0CI2RMiH0= prashant@cephdev", "key_options": null, "keyfile": "/home/pdhange/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdhange", "validate_certs": true} 2021-02-13T17:48:26.235 INFO:teuthology.task.ansible.out:changed: [gibba025.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDg7xW5+Mk7pG5MjLxOc7GTvDTCPBJj2L3MEQZIapmmo6t8uPODwDewXncSzrKDH6zFVE4TTTD9fJdu+BhyT+jCFgXrEOMMabj7vJsg0wO0SWqr+4NECFPhD9y4ewfYiewBeXisclA5Bto91v93AtYpZBCdmPYSi0BEcPVc6S3iBUD0PzIrL62I/kBAtm0f/bScRiT7XvQJXvkbEObW2yS2XhUv2qgq1VlFvO1jl3B85KMTHVb8+LrKpQWOKfRfxJ74c51y6tnEjZLFO6Xn0JevqOhd8gPQIXueFZOM0g0pNp1mbtGaaBlEIibbrzo2p9kzsdvJeHMq1XuMIi1/Qyj9 dpivonka@dhcp-41-144.bos.redhat.com", "key_options": null, "keyfile": "/home/dpivonka/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dpivonka", "validate_certs": true} 2021-02-13T17:48:26.320 INFO:teuthology.task.ansible.out:changed: [gibba036.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDg7xW5+Mk7pG5MjLxOc7GTvDTCPBJj2L3MEQZIapmmo6t8uPODwDewXncSzrKDH6zFVE4TTTD9fJdu+BhyT+jCFgXrEOMMabj7vJsg0wO0SWqr+4NECFPhD9y4ewfYiewBeXisclA5Bto91v93AtYpZBCdmPYSi0BEcPVc6S3iBUD0PzIrL62I/kBAtm0f/bScRiT7XvQJXvkbEObW2yS2XhUv2qgq1VlFvO1jl3B85KMTHVb8+LrKpQWOKfRfxJ74c51y6tnEjZLFO6Xn0JevqOhd8gPQIXueFZOM0g0pNp1mbtGaaBlEIibbrzo2p9kzsdvJeHMq1XuMIi1/Qyj9 dpivonka@dhcp-41-144.bos.redhat.com", "key_options": null, "keyfile": "/home/dpivonka/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dpivonka", "validate_certs": true} 2021-02-13T17:48:26.321 INFO:teuthology.task.ansible.out:changed: [gibba025.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0m+8wna4RnrOcuCUj971EBe4cFiTXVkEWkIsUX3yeCUwMaS/ZjaoOjcdYX7cYpCp1ilo4FSO5BsochU0RiMbQEwLGcE0zB2q1ac8+yYKCuWWyknig2t4bOReu5OrXvl6mj/9R+p7clFlYhwIoNG5ZZ/2eTbo3nH7gWgaOKaPbTtvEGg/5R/qjQKg8OTC8oix6kLsaNTisQJ78Zd7b4ukg9bO0jlq/2UhQOBM072sU1/kJpWTkcA0xxm3nsC4rWPwapgz7UwBmMdyx116GZgWdfQecTLKO7b8pyJw21npk2ntUmeMi7WPZGX6VI3IpaAhBjW3KiATAb8JbAQh8F9bmejkw6x7zrP3hYKQOg3A+U8DKRRo/Ad+f0zz9gjC42DUvMEOr09RBdxZcEAPY7H/YRWEqbA2zPX3Gfth4b7/letzM3m9ToUvVfSt1CdjaZD+gIia9pCgDMb+j1j2w9reG4F7Us+W/1f5pYCyFyrm4XO3AdoYM9/FOAOR3vffTIQU= adking@localhost.localdomain", "key_options": null, "keyfile": "/home/adking/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adking", "validate_certs": true} 2021-02-13T17:48:26.404 INFO:teuthology.task.ansible.out:changed: [gibba036.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0m+8wna4RnrOcuCUj971EBe4cFiTXVkEWkIsUX3yeCUwMaS/ZjaoOjcdYX7cYpCp1ilo4FSO5BsochU0RiMbQEwLGcE0zB2q1ac8+yYKCuWWyknig2t4bOReu5OrXvl6mj/9R+p7clFlYhwIoNG5ZZ/2eTbo3nH7gWgaOKaPbTtvEGg/5R/qjQKg8OTC8oix6kLsaNTisQJ78Zd7b4ukg9bO0jlq/2UhQOBM072sU1/kJpWTkcA0xxm3nsC4rWPwapgz7UwBmMdyx116GZgWdfQecTLKO7b8pyJw21npk2ntUmeMi7WPZGX6VI3IpaAhBjW3KiATAb8JbAQh8F9bmejkw6x7zrP3hYKQOg3A+U8DKRRo/Ad+f0zz9gjC42DUvMEOr09RBdxZcEAPY7H/YRWEqbA2zPX3Gfth4b7/letzM3m9ToUvVfSt1CdjaZD+gIia9pCgDMb+j1j2w9reG4F7Us+W/1f5pYCyFyrm4XO3AdoYM9/FOAOR3vffTIQU= adking@localhost.localdomain", "key_options": null, "keyfile": "/home/adking/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adking", "validate_certs": true} 2021-02-13T17:48:26.416 INFO:teuthology.task.ansible.out:changed: [gibba025.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCs6q2b5NcUsNXl+w1Mrc7idNvGdwWkL0XRX5zTw22UNpQyqPkSrRTFKi4NxoY8ucv8JoLnaJL7hYSRHKTh7SqH78uPLZX0FLtoHvpYLgUgJzzJ5AOW5uekIhCMCm+3egmFnEBwFcNxtGnU2es02ByXNEXRxt4/LQ0f8K6lMqxVRSKYcltvWzlA7WFFdTnYMunbCYOdpw88RXm2pYjGIHRBnie7+pFiFSS6K/mkzQcfLiJmahgLSaYslI0ho1vQd8xfNLmZ700C5F4VTUlT/mJK/dI2LF3OfaPTsyqKNzOchrjLFx5b6dhZ4WZyqu7VKsHNm+xHZwT8VP3LPGSVVBdmEsiCsmV4g4QTI5ssZLi7siZDpaFp72nVAIO1i6kBGuiF3or+J4LmIh8ZRKzTc0DRDOw7S+IkWu1fv2UhYg83z6wrz4HeczI+bnolFFWW6HgGV3MFaUeRTRvrbxw2DPoEGQ+cjP0wsjyEhxlScwdh8W8IbVpNl+7mBe45YGUH2hg83Lst5QQxD4PHelriu40moWRHFKCnKfNesb4L1uqu29o8f+/PgpLdrWE/P5zIKe2ReWJyScYAI7jTMlFw+xgf+0TKryk44NMy90l3ei0umlx4qsFbbEv+lhzAALrUJ/da7fsQw7eIVykmcscBeYr99/YSYk4MGdk4jVCiHsQkdw== amathuri@redhat.com", "key_options": null, "keyfile": "/home/amathuri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amathuri", "validate_certs": true} 2021-02-13T17:48:26.489 INFO:teuthology.task.ansible.out:changed: [gibba036.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCs6q2b5NcUsNXl+w1Mrc7idNvGdwWkL0XRX5zTw22UNpQyqPkSrRTFKi4NxoY8ucv8JoLnaJL7hYSRHKTh7SqH78uPLZX0FLtoHvpYLgUgJzzJ5AOW5uekIhCMCm+3egmFnEBwFcNxtGnU2es02ByXNEXRxt4/LQ0f8K6lMqxVRSKYcltvWzlA7WFFdTnYMunbCYOdpw88RXm2pYjGIHRBnie7+pFiFSS6K/mkzQcfLiJmahgLSaYslI0ho1vQd8xfNLmZ700C5F4VTUlT/mJK/dI2LF3OfaPTsyqKNzOchrjLFx5b6dhZ4WZyqu7VKsHNm+xHZwT8VP3LPGSVVBdmEsiCsmV4g4QTI5ssZLi7siZDpaFp72nVAIO1i6kBGuiF3or+J4LmIh8ZRKzTc0DRDOw7S+IkWu1fv2UhYg83z6wrz4HeczI+bnolFFWW6HgGV3MFaUeRTRvrbxw2DPoEGQ+cjP0wsjyEhxlScwdh8W8IbVpNl+7mBe45YGUH2hg83Lst5QQxD4PHelriu40moWRHFKCnKfNesb4L1uqu29o8f+/PgpLdrWE/P5zIKe2ReWJyScYAI7jTMlFw+xgf+0TKryk44NMy90l3ei0umlx4qsFbbEv+lhzAALrUJ/da7fsQw7eIVykmcscBeYr99/YSYk4MGdk4jVCiHsQkdw== amathuri@redhat.com", "key_options": null, "keyfile": "/home/amathuri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amathuri", "validate_certs": true} 2021-02-13T17:48:26.501 INFO:teuthology.task.ansible.out:changed: [gibba025.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDr6H7hmtGCUrO3GppgMHwbmA4XT/Vipz/uLG/N8h6ZxtaLQKpCefRpdKcFlOdDwxkTmT5q9vmXQ8nl95lTGq+eeMxl4ho104ZD9e9AIYmgYqFy7/qNP8gkqduIPlypLL9m5rElTcGd7zqfMqgljMvAmnXLtZNJlIuFtszVU5WPI1QCwfQ3t5aHF6j66bpVoN9uWItVGB1LApQz9TtViWsQ9Hl8X4YauJToO+TkuSX+H/OGH7ZC6CPOzNZb3b3vF/jLMnTzXl86PJs1se4DjKkRGLVCVbr2WhLwQeZ8TEn3Hg1Gn5X8zNM5cTo6U8SnXBAe9ZYbuyfvghrNLdlZpmN+8l0/l5zC3z+N+sEzklXwHw4MQLF+KSloVFd9NN/kyenufTZAyp8VxllZ9TgdC+CPORIWyzmu1elOtYo7LNuE6CIh/Zm9B54SO6hVHhVoOCqe/dIyjeHJA0WKIZblK1XZEvWuu0E2T3jhxfe1GICyTukeB8WoBQH9DZ1yzMPt59E= nia@redhat.com", "key_options": null, "keyfile": "/home/nizamial09/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nizamial09", "validate_certs": true} 2021-02-13T17:48:26.588 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:26 +0000 (0:00:12.566) 0:00:33.425 ***** 2021-02-13T17:48:26.598 INFO:teuthology.task.ansible.out:changed: [gibba036.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDr6H7hmtGCUrO3GppgMHwbmA4XT/Vipz/uLG/N8h6ZxtaLQKpCefRpdKcFlOdDwxkTmT5q9vmXQ8nl95lTGq+eeMxl4ho104ZD9e9AIYmgYqFy7/qNP8gkqduIPlypLL9m5rElTcGd7zqfMqgljMvAmnXLtZNJlIuFtszVU5WPI1QCwfQ3t5aHF6j66bpVoN9uWItVGB1LApQz9TtViWsQ9Hl8X4YauJToO+TkuSX+H/OGH7ZC6CPOzNZb3b3vF/jLMnTzXl86PJs1se4DjKkRGLVCVbr2WhLwQeZ8TEn3Hg1Gn5X8zNM5cTo6U8SnXBAe9ZYbuyfvghrNLdlZpmN+8l0/l5zC3z+N+sEzklXwHw4MQLF+KSloVFd9NN/kyenufTZAyp8VxllZ9TgdC+CPORIWyzmu1elOtYo7LNuE6CIh/Zm9B54SO6hVHhVoOCqe/dIyjeHJA0WKIZblK1XZEvWuu0E2T3jhxfe1GICyTukeB8WoBQH9DZ1yzMPt59E= nia@redhat.com", "key_options": null, "keyfile": "/home/nizamial09/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nizamial09", "validate_certs": true} 2021-02-13T17:48:26.647 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:26.648 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:26.687 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:26 +0000 (0:00:00.099) 0:00:33.524 ***** 2021-02-13T17:48:26.694 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:26.695 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:26.696 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:26.698 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:26.698 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:26.699 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:26.733 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:26.734 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:26.744 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:26.755 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:26.755 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:26.766 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:26.777 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:26.778 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2021-02-13T17:48:26.779 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:26.789 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:26.790 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:26.801 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:26.875 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2021-02-13T17:48:26.888 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:26.889 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2021-02-13T17:48:26.901 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:26.974 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2021-02-13T17:48:26.976 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2021-02-13T17:48:26.977 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:26.987 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:26.998 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.009 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.010 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.020 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.032 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.043 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.043 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.054 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.066 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.066 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2021-02-13T17:48:27.068 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.079 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.079 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.081 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.091 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.092 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.093 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.104 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.105 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.115 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.117 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.127 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.128 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.139 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.140 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.141 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.151 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.152 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.153 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.163 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.164 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.165 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.175 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.177 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.187 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.188 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.189 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.199 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.200 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.201 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.211 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.211 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.213 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.223 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.225 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.235 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.236 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.248 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.249 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.260 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.260 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.271 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.272 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.273 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.283 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.284 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.286 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.297 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.297 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.308 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.309 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.310 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.321 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.321 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.322 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.332 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.333 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.334 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.345 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.345 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.346 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.357 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.358 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.359 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.369 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.370 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.371 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.381 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.382 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.383 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.393 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.394 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.396 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.406 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.406 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.408 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.418 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.418 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.419 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.430 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.430 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.431 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.441 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.442 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.442 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.453 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.454 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.455 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.465 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.465 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.476 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.477 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.487 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.488 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.489 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.500 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.501 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.512 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.512 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.513 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.524 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.524 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.526 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.535 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.536 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.537 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.548 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.549 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.550 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.561 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.562 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.563 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.573 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.574 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.575 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.585 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.587 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.588 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.599 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.599 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.610 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.611 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.612 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.622 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.623 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.634 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.634 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.636 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.646 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.648 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.658 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.659 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.660 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.670 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.671 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.672 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.682 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.683 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.684 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.694 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.695 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.696 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.707 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.707 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.718 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.719 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.720 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.731 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.732 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.733 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.744 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.745 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.746 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.756 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.756 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.758 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.768 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.768 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.770 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.780 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.782 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.792 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.792 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.793 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.803 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.804 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.805 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.815 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.816 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.817 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.827 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.827 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.829 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.839 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.839 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.840 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.851 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.851 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.853 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.862 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.863 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.864 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.875 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.875 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.886 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.887 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.888 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.898 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.899 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.900 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.900 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.911 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.912 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.913 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.923 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.924 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.925 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.935 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.936 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.937 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.947 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.964 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:27.965 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:28.002 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:27 +0000 (0:00:01.314) 0:00:34.839 ***** 2021-02-13T17:48:28.009 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:28.010 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:28.011 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:28.013 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:28.014 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:28.025 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:28.025 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** 2021-02-13T17:48:28.026 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:28.027 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:28.063 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:28 +0000 (0:00:00.060) 0:00:34.899 ***** 2021-02-13T17:48:28.069 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:28.070 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:28.071 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267"}, "skip_reason": "Conditional result was False"} skipping: [gibba036.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:28.136 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:28 +0000 (0:00:00.073) 0:00:34.973 ***** 2021-02-13T17:48:28.162 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** 2021-02-13T17:48:28.164 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:28.198 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:28 +0000 (0:00:00.062) 0:00:35.035 ***** 2021-02-13T17:48:28.204 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2021-02-13T17:48:28.205 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2021-02-13T17:48:28.248 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2021-02-13T17:48:28.311 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2021-02-13T17:48:28.333 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2021-02-13T17:48:28.396 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2021-02-13T17:48:28.417 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2021-02-13T17:48:28.470 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2021-02-13T17:48:28.502 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2021-02-13T17:48:28.555 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2021-02-13T17:48:28.587 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2021-02-13T17:48:28.640 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2021-02-13T17:48:28.661 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2021-02-13T17:48:28.724 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2021-02-13T17:48:28.746 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2021-02-13T17:48:28.809 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2021-02-13T17:48:28.830 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "name": "alfredodeza", "state": "absent"} 2021-02-13T17:48:28.883 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2021-02-13T17:48:28.918 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2021-02-13T17:48:28.971 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "name": "alfredodeza", "state": "absent"} 2021-02-13T17:48:29.003 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2021-02-13T17:48:29.056 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2021-02-13T17:48:29.077 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2021-02-13T17:48:29.130 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2021-02-13T17:48:29.162 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2021-02-13T17:48:29.214 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2021-02-13T17:48:29.246 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2021-02-13T17:48:29.299 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2021-02-13T17:48:29.331 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2021-02-13T17:48:29.384 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2021-02-13T17:48:29.416 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2021-02-13T17:48:29.469 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2021-02-13T17:48:29.470 INFO:teuthology.task.ansible.out: 2021-02-13T17:48:29.501 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2021-02-13T17:48:29.544 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2021-02-13T17:48:29.586 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2021-02-13T17:48:29.629 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2021-02-13T17:48:29.660 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2021-02-13T17:48:29.703 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2021-02-13T17:48:29.745 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2021-02-13T17:48:29.787 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2021-02-13T17:48:29.830 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2021-02-13T17:48:29.862 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2021-02-13T17:48:29.914 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "name": "loic", "state": "absent"} 2021-02-13T17:48:29.946 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2021-02-13T17:48:29.989 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2021-02-13T17:48:30.031 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "name": "loic", "state": "absent"} 2021-02-13T17:48:30.074 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2021-02-13T17:48:30.106 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2021-02-13T17:48:30.159 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2021-02-13T17:48:30.190 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2021-02-13T17:48:30.233 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2021-02-13T17:48:30.275 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2021-02-13T17:48:30.318 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2021-02-13T17:48:30.350 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2021-02-13T17:48:30.402 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2021-02-13T17:48:30.434 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2021-02-13T17:48:30.487 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2021-02-13T17:48:30.519 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2021-02-13T17:48:30.573 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2021-02-13T17:48:30.595 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2021-02-13T17:48:30.647 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2021-02-13T17:48:30.679 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2021-02-13T17:48:30.732 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2021-02-13T17:48:30.764 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2021-02-13T17:48:30.816 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2021-02-13T17:48:30.838 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2021-02-13T17:48:30.901 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2021-02-13T17:48:30.933 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2021-02-13T17:48:30.986 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2021-02-13T17:48:31.007 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2021-02-13T17:48:31.071 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2021-02-13T17:48:31.093 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2021-02-13T17:48:31.156 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "name": "pranith", "state": "absent"} 2021-02-13T17:48:31.177 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2021-02-13T17:48:31.242 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "name": "dorinda", "state": "absent"} 2021-02-13T17:48:31.253 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "name": "pranith", "state": "absent"} 2021-02-13T17:48:31.337 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "name": "dorinda", "state": "absent"} 2021-02-13T17:48:31.557 INFO:teuthology.task.ansible.out:changed: [gibba025.front.sepia.ceph.com] => (item=zyan) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "zyan", "name": "zyan", "remove": false, "state": "absent"} 2021-02-13T17:48:31.558 INFO:teuthology.task.ansible.out: 2021-02-13T17:48:31.641 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2021-02-13T17:48:31.663 INFO:teuthology.task.ansible.out:changed: [gibba036.front.sepia.ceph.com] => (item=zyan) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "zyan", "name": "zyan", "remove": false, "state": "absent"} 2021-02-13T17:48:31.716 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2021-02-13T17:48:31.737 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2021-02-13T17:48:31.800 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2021-02-13T17:48:31.822 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2021-02-13T17:48:31.885 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2021-02-13T17:48:31.896 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2021-02-13T17:48:31.960 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2021-02-13T17:48:31.982 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2021-02-13T17:48:32.046 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2021-02-13T17:48:32.067 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2021-02-13T17:48:32.120 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2021-02-13T17:48:32.142 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2021-02-13T17:48:32.205 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2021-02-13T17:48:32.226 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2021-02-13T17:48:32.279 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "name": "jbainbri", "state": "absent"} 2021-02-13T17:48:32.312 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2021-02-13T17:48:32.375 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "name": "kdhananj", "state": "absent"} 2021-02-13T17:48:32.395 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "name": "jbainbri", "state": "absent"} 2021-02-13T17:48:32.433 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:32 +0000 (0:00:04.234) 0:00:39.270 ***** 2021-02-13T17:48:32.472 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "name": "kdhananj", "state": "absent"} 2021-02-13T17:48:32.527 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:32 +0000 (0:00:00.094) 0:00:39.364 ***** 2021-02-13T17:48:32.691 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2021-02-13T17:48:32.692 INFO:teuthology.task.ansible.out:changed: [gibba025.front.sepia.ceph.com] => {"changed": true, "checksum": "5ebc9fcf8859a9c716ab10089a7bec7e44d29368", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "ee06ed012f51c2e3764171d4b9180349", "mode": "0644", "owner": "root", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1613238512.457102-105125125253003/source", "state": "file", "uid": 0} 2021-02-13T17:48:32.729 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:32 +0000 (0:00:00.202) 0:00:39.566 ***** 2021-02-13T17:48:32.756 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2021-02-13T17:48:32.758 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => { "msg": "Host gibba025.front.sepia.ceph.com is running Ubuntu 18.04 (bionic)" } TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** changed: [gibba036.front.sepia.ceph.com] => {"changed": true, "checksum": "5ebc9fcf8859a9c716ab10089a7bec7e44d29368", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "ee06ed012f51c2e3764171d4b9180349", "mode": "0644", "owner": "root", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1613238512.549446-56724251094324/source", "state": "file", "uid": 0} 2021-02-13T17:48:32.794 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:32 +0000 (0:00:00.064) 0:00:39.631 ***** 2021-02-13T17:48:32.828 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:32 +0000 (0:00:00.033) 0:00:39.664 ***** 2021-02-13T17:48:32.833 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2021-02-13T17:48:32.833 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2021-02-13T17:48:32.870 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:32 +0000 (0:00:00.042) 0:00:39.707 ***** 2021-02-13T17:48:32.876 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2021-02-13T17:48:32.877 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => { "msg": "Host gibba036.front.sepia.ceph.com is running Ubuntu 18.04 (bionic)" } 2021-02-13T17:48:32.912 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:32 +0000 (0:00:00.042) 0:00:39.749 ***** 2021-02-13T17:48:32.918 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2021-02-13T17:48:32.920 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:32.958 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:32 +0000 (0:00:00.046) 0:00:39.795 ***** 2021-02-13T17:48:32.964 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2021-02-13T17:48:32.965 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2021-02-13T17:48:33.004 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:33 +0000 (0:00:00.045) 0:00:39.841 ***** 2021-02-13T17:48:33.011 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2021-02-13T17:48:33.012 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:33.047 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:33 +0000 (0:00:00.043) 0:00:39.884 ***** 2021-02-13T17:48:33.054 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2021-02-13T17:48:33.055 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:33.091 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:33 +0000 (0:00:00.043) 0:00:39.927 ***** 2021-02-13T17:48:33.097 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2021-02-13T17:48:33.098 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:33.136 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:33 +0000 (0:00:00.044) 0:00:39.972 ***** 2021-02-13T17:48:33.142 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2021-02-13T17:48:33.143 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:33.178 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:33 +0000 (0:00:00.042) 0:00:40.015 ***** 2021-02-13T17:48:33.184 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2021-02-13T17:48:33.186 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:33.224 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:33 +0000 (0:00:00.045) 0:00:40.061 ***** 2021-02-13T17:48:33.230 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2021-02-13T17:48:33.231 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:33.268 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:33 +0000 (0:00:00.044) 0:00:40.105 ***** 2021-02-13T17:48:33.275 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2021-02-13T17:48:33.276 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:33.312 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:33 +0000 (0:00:00.044) 0:00:40.149 ***** 2021-02-13T17:48:33.319 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2021-02-13T17:48:33.321 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:33.356 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:33 +0000 (0:00:00.043) 0:00:40.193 ***** 2021-02-13T17:48:33.362 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2021-02-13T17:48:33.364 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:33.399 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:33 +0000 (0:00:00.042) 0:00:40.236 ***** 2021-02-13T17:48:33.405 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2021-02-13T17:48:33.407 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:33.442 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:33 +0000 (0:00:00.043) 0:00:40.279 ***** 2021-02-13T17:48:33.449 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2021-02-13T17:48:33.449 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:33.487 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:33 +0000 (0:00:00.044) 0:00:40.324 ***** 2021-02-13T17:48:33.494 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2021-02-13T17:48:33.496 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:33.534 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:33 +0000 (0:00:00.046) 0:00:40.370 ***** 2021-02-13T17:48:33.539 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2021-02-13T17:48:33.541 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:33.576 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:33 +0000 (0:00:00.042) 0:00:40.413 ***** 2021-02-13T17:48:33.585 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2021-02-13T17:48:33.586 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:33.622 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:33 +0000 (0:00:00.045) 0:00:40.458 ***** 2021-02-13T17:48:33.628 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2021-02-13T17:48:33.629 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-02-13T17:48:33.630 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-02-13T17:48:33.666 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:33 +0000 (0:00:00.044) 0:00:40.503 ***** 2021-02-13T17:48:33.675 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2021-02-13T17:48:33.676 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:33.710 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:33 +0000 (0:00:00.044) 0:00:40.547 ***** 2021-02-13T17:48:33.717 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2021-02-13T17:48:33.718 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:33.755 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:33 +0000 (0:00:00.044) 0:00:40.592 ***** 2021-02-13T17:48:33.762 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2021-02-13T17:48:33.762 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-02-13T17:48:33.763 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-02-13T17:48:33.798 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:33 +0000 (0:00:00.042) 0:00:40.635 ***** 2021-02-13T17:48:33.804 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2021-02-13T17:48:33.805 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:33.843 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:33 +0000 (0:00:00.044) 0:00:40.680 ***** 2021-02-13T17:48:33.850 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2021-02-13T17:48:33.851 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:33.886 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:33 +0000 (0:00:00.042) 0:00:40.722 ***** 2021-02-13T17:48:33.891 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2021-02-13T17:48:33.893 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-02-13T17:48:33.930 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:33 +0000 (0:00:00.044) 0:00:40.767 ***** 2021-02-13T17:48:33.937 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2021-02-13T17:48:33.939 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:33.975 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:33 +0000 (0:00:00.044) 0:00:40.811 ***** 2021-02-13T17:48:33.981 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2021-02-13T17:48:33.981 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:34.018 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:34 +0000 (0:00:00.043) 0:00:40.855 ***** 2021-02-13T17:48:34.025 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2021-02-13T17:48:34.025 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-02-13T17:48:34.061 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:34 +0000 (0:00:00.043) 0:00:40.898 ***** 2021-02-13T17:48:34.068 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2021-02-13T17:48:34.068 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-02-13T17:48:34.105 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:34 +0000 (0:00:00.043) 0:00:40.942 ***** 2021-02-13T17:48:34.111 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2021-02-13T17:48:34.113 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:34.148 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:34 +0000 (0:00:00.042) 0:00:40.984 ***** 2021-02-13T17:48:34.153 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2021-02-13T17:48:34.155 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:34.190 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:34 +0000 (0:00:00.041) 0:00:41.026 ***** 2021-02-13T17:48:34.198 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2021-02-13T17:48:34.199 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-02-13T17:48:34.236 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:34 +0000 (0:00:00.045) 0:00:41.072 ***** 2021-02-13T17:48:34.242 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2021-02-13T17:48:34.243 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:34.279 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:34 +0000 (0:00:00.043) 0:00:41.116 ***** 2021-02-13T17:48:34.286 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2021-02-13T17:48:34.287 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:34.323 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:34 +0000 (0:00:00.043) 0:00:41.160 ***** 2021-02-13T17:48:34.329 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2021-02-13T17:48:34.330 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:34.366 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:34 +0000 (0:00:00.042) 0:00:41.203 ***** 2021-02-13T17:48:34.372 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2021-02-13T17:48:34.373 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:34.408 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:34 +0000 (0:00:00.042) 0:00:41.245 ***** 2021-02-13T17:48:34.414 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2021-02-13T17:48:34.414 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:34.455 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:34 +0000 (0:00:00.046) 0:00:41.291 ***** 2021-02-13T17:48:34.461 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2021-02-13T17:48:34.463 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:34.498 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:34 +0000 (0:00:00.043) 0:00:41.335 ***** 2021-02-13T17:48:34.505 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2021-02-13T17:48:34.507 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-02-13T17:48:34.542 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:34 +0000 (0:00:00.044) 0:00:41.379 ***** 2021-02-13T17:48:34.548 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2021-02-13T17:48:34.550 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:34.585 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:34 +0000 (0:00:00.042) 0:00:41.422 ***** 2021-02-13T17:48:34.591 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-02-13T17:48:34.592 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:34.626 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:34 +0000 (0:00:00.041) 0:00:41.463 ***** 2021-02-13T17:48:34.632 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2021-02-13T17:48:34.633 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-02-13T17:48:34.667 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:34 +0000 (0:00:00.041) 0:00:41.504 ***** 2021-02-13T17:48:34.673 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2021-02-13T17:48:34.674 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:34.709 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:34 +0000 (0:00:00.042) 0:00:41.546 ***** 2021-02-13T17:48:34.715 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-02-13T17:48:34.717 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:34.751 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:34 +0000 (0:00:00.041) 0:00:41.588 ***** 2021-02-13T17:48:34.758 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2021-02-13T17:48:34.759 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:34.793 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:34 +0000 (0:00:00.041) 0:00:41.630 ***** 2021-02-13T17:48:34.799 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2021-02-13T17:48:34.801 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:34.837 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:34 +0000 (0:00:00.043) 0:00:41.674 ***** 2021-02-13T17:48:34.843 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2021-02-13T17:48:34.844 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:34.879 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:34 +0000 (0:00:00.042) 0:00:41.716 ***** 2021-02-13T17:48:34.885 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2021-02-13T17:48:34.887 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:34.922 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:34 +0000 (0:00:00.042) 0:00:41.758 ***** 2021-02-13T17:48:34.927 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2021-02-13T17:48:34.929 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:34.964 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:34 +0000 (0:00:00.042) 0:00:41.801 ***** 2021-02-13T17:48:34.972 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2021-02-13T17:48:34.973 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:35.010 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:35 +0000 (0:00:00.045) 0:00:41.847 ***** 2021-02-13T17:48:35.017 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2021-02-13T17:48:35.018 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:35.053 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:35 +0000 (0:00:00.043) 0:00:41.890 ***** 2021-02-13T17:48:35.066 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2021-02-13T17:48:35.068 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:35.101 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:35 +0000 (0:00:00.047) 0:00:41.938 ***** 2021-02-13T17:48:35.107 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2021-02-13T17:48:35.108 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-02-13T17:48:35.144 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:35 +0000 (0:00:00.042) 0:00:41.981 ***** 2021-02-13T17:48:35.150 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2021-02-13T17:48:35.152 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:35.186 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:35 +0000 (0:00:00.042) 0:00:42.023 ***** 2021-02-13T17:48:35.192 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2021-02-13T17:48:35.193 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:35.232 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:35 +0000 (0:00:00.045) 0:00:42.069 ***** 2021-02-13T17:48:35.239 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2021-02-13T17:48:35.240 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-02-13T17:48:35.282 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:35 +0000 (0:00:00.049) 0:00:42.119 ***** 2021-02-13T17:48:35.290 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2021-02-13T17:48:35.290 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:35.338 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:35 +0000 (0:00:00.055) 0:00:42.175 ***** 2021-02-13T17:48:35.344 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2021-02-13T17:48:35.345 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:35.389 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:35 +0000 (0:00:00.050) 0:00:42.225 ***** 2021-02-13T17:48:35.396 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2021-02-13T17:48:35.398 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:35.431 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:35 +0000 (0:00:00.042) 0:00:42.268 ***** 2021-02-13T17:48:35.438 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:35.476 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:35 +0000 (0:00:00.045) 0:00:42.313 ***** 2021-02-13T17:48:35.482 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2021-02-13T17:48:35.483 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:35.484 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:35.531 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:35 +0000 (0:00:00.054) 0:00:42.367 ***** 2021-02-13T17:48:35.537 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2021-02-13T17:48:35.538 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:35.580 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:35 +0000 (0:00:00.049) 0:00:42.417 ***** 2021-02-13T17:48:35.586 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2021-02-13T17:48:35.588 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} skipping: [gibba025.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2021-02-13T17:48:35.642 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:35 +0000 (0:00:00.062) 0:00:42.479 ***** 2021-02-13T17:48:35.651 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** skipping: [gibba036.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:35.652 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:35.690 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:35 +0000 (0:00:00.047) 0:00:42.527 ***** 2021-02-13T17:48:35.900 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Saturday 13 February 2021 17:48:35 +0000 (0:00:00.046) 0:00:42.573 ***** TASK [common : Configure local epel mirrorlists] ******************************* skipping: [gibba036.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} skipping: [gibba036.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} Saturday 13 February 2021 17:48:35 +0000 (0:00:00.068) 0:00:42.642 ***** TASK [common : Clean yum cache] ************************************************ skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Get the current timezone] *************************************** ok: [gibba025.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.005047", "end": "2021-02-13 17:48:35.894469", "rc": 0, "start": "2021-02-13 17:48:35.889422", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} Saturday 13 February 2021 17:48:35 +0000 (0:00:00.065) 0:00:42.708 ***** 2021-02-13T17:48:35.907 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:35 +0000 (0:00:00.036) 0:00:42.744 ***** 2021-02-13T17:48:35.920 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2021-02-13T17:48:35.922 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:35.966 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:35 +0000 (0:00:00.058) 0:00:42.803 ***** 2021-02-13T17:48:36.004 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:36.042 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:36 +0000 (0:00:00.075) 0:00:42.878 ***** 2021-02-13T17:48:36.048 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-02-13T17:48:36.049 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.004876", "end": "2021-02-13 17:48:36.213971", "rc": 0, "start": "2021-02-13 17:48:36.209095", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2021-02-13T17:48:36.087 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:36 +0000 (0:00:00.045) 0:00:42.924 ***** 2021-02-13T17:48:36.093 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** 2021-02-13T17:48:36.093 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item=sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "sleep.target", "skip_reason": "Conditional result was False"} 2021-02-13T17:48:36.095 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item=suspend.target) => {"ansible_loop_var": "item", "changed": false, "item": "suspend.target", "skip_reason": "Conditional result was False"} skipping: [gibba025.front.sepia.ceph.com] => (item=hibernate.target) => {"ansible_loop_var": "item", "changed": false, "item": "hibernate.target", "skip_reason": "Conditional result was False"} 2021-02-13T17:48:36.095 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item=hybrid-sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "hybrid-sleep.target", "skip_reason": "Conditional result was False"} 2021-02-13T17:48:36.131 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:36 +0000 (0:00:00.044) 0:00:42.968 ***** 2021-02-13T17:48:36.138 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2021-02-13T17:48:36.140 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:36.174 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:36 +0000 (0:00:00.042) 0:00:43.011 ***** 2021-02-13T17:48:36.180 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-02-13T17:48:36.180 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:36.217 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:36 +0000 (0:00:00.043) 0:00:43.054 ***** 2021-02-13T17:48:36.223 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2021-02-13T17:48:36.224 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:36.259 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:36 +0000 (0:00:00.041) 0:00:43.096 ***** 2021-02-13T17:48:36.265 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2021-02-13T17:48:36.266 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:36.305 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:36 +0000 (0:00:00.045) 0:00:43.142 ***** 2021-02-13T17:48:36.312 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** 2021-02-13T17:48:36.313 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item=sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "sleep.target", "skip_reason": "Conditional result was False"} skipping: [gibba036.front.sepia.ceph.com] => (item=suspend.target) => {"ansible_loop_var": "item", "changed": false, "item": "suspend.target", "skip_reason": "Conditional result was False"} skipping: [gibba036.front.sepia.ceph.com] => (item=hibernate.target) => {"ansible_loop_var": "item", "changed": false, "item": "hibernate.target", "skip_reason": "Conditional result was False"} 2021-02-13T17:48:36.325 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item=hybrid-sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "hybrid-sleep.target", "skip_reason": "Conditional result was False"} 2021-02-13T17:48:36.326 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2021-02-13T17:48:36.328 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:36.362 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:36 +0000 (0:00:00.057) 0:00:43.199 ***** 2021-02-13T17:48:36.398 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:36 +0000 (0:00:00.035) 0:00:43.235 ***** 2021-02-13T17:48:36.404 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2021-02-13T17:48:36.405 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:36.440 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:36 +0000 (0:00:00.042) 0:00:43.277 ***** 2021-02-13T17:48:36.446 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-02-13T17:48:36.448 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:36.483 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:36 +0000 (0:00:00.042) 0:00:43.319 ***** 2021-02-13T17:48:36.489 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2021-02-13T17:48:36.490 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:36.525 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:36 +0000 (0:00:00.042) 0:00:43.362 ***** 2021-02-13T17:48:36.532 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2021-02-13T17:48:36.533 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:36.570 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:36 +0000 (0:00:00.044) 0:00:43.407 ***** 2021-02-13T17:48:36.596 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2021-02-13T17:48:36.597 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:36.632 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:36 +0000 (0:00:00.061) 0:00:43.468 ***** 2021-02-13T17:48:36.657 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2021-02-13T17:48:36.659 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:36.692 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:36 +0000 (0:00:00.060) 0:00:43.529 ***** 2021-02-13T17:48:36.718 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2021-02-13T17:48:36.719 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:36.753 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:36 +0000 (0:00:00.060) 0:00:43.590 ***** 2021-02-13T17:48:37.308 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2021-02-13T17:48:37.309 INFO:teuthology.task.ansible.out:changed: [gibba036.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.475634", "end": "2021-02-13 17:48:37.506540", "rc": 0, "start": "2021-02-13 17:48:37.030906", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-13T17:48:37.344 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:37 +0000 (0:00:00.591) 0:00:44.181 ***** 2021-02-13T17:48:37.371 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:37.407 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:37 +0000 (0:00:00.062) 0:00:44.244 ***** 2021-02-13T17:48:37.455 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2021-02-13T17:48:37.456 INFO:teuthology.task.ansible.out:changed: [gibba025.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.843604", "end": "2021-02-13 17:48:37.504835", "rc": 0, "start": "2021-02-13 17:48:36.661231", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-13T17:48:37.495 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:37 +0000 (0:00:00.088) 0:00:44.332 ***** 2021-02-13T17:48:37.523 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2021-02-13T17:48:37.525 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:37.560 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:37 +0000 (0:00:00.064) 0:00:44.397 ***** 2021-02-13T17:48:37.577 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2021-02-13T17:48:37.578 INFO:teuthology.task.ansible.out:[WARNING]: Consider using the apt module rather than running 'apt-get'. If you need to use command because apt is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. 2021-02-13T17:48:37.581 INFO:teuthology.task.ansible.out:changed: [gibba036.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.046766", "end": "2021-02-13 17:48:37.768376", "rc": 0, "start": "2021-02-13 17:48:37.721610", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-13T17:48:37.618 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:37 +0000 (0:00:00.057) 0:00:44.454 ***** 2021-02-13T17:48:37.720 INFO:teuthology.task.ansible.out:changed: [gibba025.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.046021", "end": "2021-02-13 17:48:37.759527", "rc": 0, "start": "2021-02-13 17:48:37.713506", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-13T17:48:37.757 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:37 +0000 (0:00:00.139) 0:00:44.594 ***** 2021-02-13T17:48:40.664 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2021-02-13T17:48:40.666 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1613238280, "cache_updated": false, "changed": false} 2021-02-13T17:48:40.702 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:40 +0000 (0:00:02.945) 0:00:47.539 ***** 2021-02-13T17:48:40.843 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1613238310, "cache_updated": false, "changed": false} 2021-02-13T17:48:40.884 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:40 +0000 (0:00:00.182) 0:00:47.721 ***** 2021-02-13T17:48:41.273 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2021-02-13T17:48:41.275 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => {"cache_update_time": 1613238280, "cache_updated": false, "changed": false} 2021-02-13T17:48:41.310 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:41 +0000 (0:00:00.425) 0:00:48.147 ***** 2021-02-13T17:48:41.337 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2021-02-13T17:48:41.337 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:41.373 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:41 +0000 (0:00:00.062) 0:00:48.210 ***** 2021-02-13T17:48:41.374 INFO:teuthology.task.ansible.out: 2021-02-13T17:48:41.453 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2021-02-13T17:48:41.453 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => {"cache_update_time": 1613238310, "cache_updated": false, "changed": false} 2021-02-13T17:48:41.490 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:41 +0000 (0:00:00.116) 0:00:48.327 ***** 2021-02-13T17:48:41.517 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2021-02-13T17:48:41.519 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:41.561 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:41 +0000 (0:00:00.071) 0:00:48.398 ***** 2021-02-13T17:48:41.926 INFO:teuthology.task.ansible.out: 2021-02-13T17:48:41.926 INFO:teuthology.task.ansible.out:TASK [common : Add krb5 config file] ******************************************* 2021-02-13T17:48:41.928 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2021-02-13T17:48:41.965 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:41 +0000 (0:00:00.403) 0:00:48.802 ***** 2021-02-13T17:48:41.972 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2021-02-13T17:48:42.013 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:42 +0000 (0:00:00.048) 0:00:48.850 ***** 2021-02-13T17:48:42.531 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2021-02-13T17:48:42.533 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => {"cache_update_time": 1613238310, "cache_updated": false, "changed": false} 2021-02-13T17:48:42.569 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:42 +0000 (0:00:00.555) 0:00:49.406 ***** 2021-02-13T17:48:42.627 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => {"cache_update_time": 1613238280, "cache_updated": false, "changed": false} 2021-02-13T17:48:42.664 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:42 +0000 (0:00:00.095) 0:00:49.501 ***** 2021-02-13T17:48:42.818 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** ok: [gibba036.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2021-02-13T17:48:42.913 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2021-02-13T17:48:42.998 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2021-02-13T17:48:43.286 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2021-02-13T17:48:43.288 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2021-02-13T17:48:43.325 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:43 +0000 (0:00:00.661) 0:00:50.162 ***** 2021-02-13T17:48:43.396 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2021-02-13T17:48:43.437 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:43 +0000 (0:00:00.112) 0:00:50.274 ***** 2021-02-13T17:48:43.445 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2021-02-13T17:48:43.447 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2021-02-13T17:48:43.485 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:43 +0000 (0:00:00.047) 0:00:50.322 ***** 2021-02-13T17:48:43.522 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2021-02-13T17:48:43.560 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:43 +0000 (0:00:00.074) 0:00:50.396 ***** 2021-02-13T17:48:43.722 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-02-13T17:48:43.724 INFO:teuthology.task.ansible.out:changed: [gibba036.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": true, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "md5sum": "14041bf2666d8f8d277567958c7e9f69", "mode": "0755", "owner": "root", "size": 13355, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1613238523.507584-138884087181421/source", "state": "file", "uid": 0} 2021-02-13T17:48:43.808 INFO:teuthology.task.ansible.out:changed: [gibba025.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": true, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "md5sum": "14041bf2666d8f8d277567958c7e9f69", "mode": "0755", "owner": "root", "size": 13355, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1613238523.5916219-33190905518888/source", "state": "file", "uid": 0} 2021-02-13T17:48:43.894 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2021-02-13T17:48:43.988 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2021-02-13T17:48:44.062 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "size": 3605, "state": "file", "uid": 0} 2021-02-13T17:48:44.100 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:44 +0000 (0:00:00.540) 0:00:50.937 ***** 2021-02-13T17:48:44.137 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2021-02-13T17:48:44.138 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2021-02-13T17:48:44.173 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:44 +0000 (0:00:00.072) 0:00:51.009 ***** 2021-02-13T17:48:44.179 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-02-13T17:48:44.179 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "size": 3605, "state": "file", "uid": 0} 2021-02-13T17:48:44.218 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:44 +0000 (0:00:00.045) 0:00:51.055 ***** 2021-02-13T17:48:44.224 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2021-02-13T17:48:44.225 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:44.261 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:44 +0000 (0:00:00.043) 0:00:51.098 ***** 2021-02-13T17:48:44.267 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2021-02-13T17:48:44.269 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2021-02-13T17:48:44.304 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:44 +0000 (0:00:00.043) 0:00:51.141 ***** 2021-02-13T17:48:44.310 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2021-02-13T17:48:44.311 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-02-13T17:48:44.346 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:44 +0000 (0:00:00.041) 0:00:51.183 ***** 2021-02-13T17:48:44.359 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2021-02-13T17:48:44.360 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:44.398 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:44 +0000 (0:00:00.052) 0:00:51.235 ***** 2021-02-13T17:48:44.406 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2021-02-13T17:48:44.407 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [gibba036.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-02-13T17:48:44.407 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-02-13T17:48:44.408 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-02-13T17:48:44.472 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:44 +0000 (0:00:00.073) 0:00:51.309 ***** 2021-02-13T17:48:44.480 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2021-02-13T17:48:44.481 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-02-13T17:48:44.517 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:44 +0000 (0:00:00.044) 0:00:51.354 ***** 2021-02-13T17:48:44.518 INFO:teuthology.task.ansible.out: 2021-02-13T17:48:44.524 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2021-02-13T17:48:44.525 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:44.574 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:44 +0000 (0:00:00.056) 0:00:51.410 ***** 2021-02-13T17:48:44.580 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2021-02-13T17:48:44.581 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-02-13T17:48:44.582 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-02-13T17:48:44.593 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-02-13T17:48:44.594 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-02-13T17:48:44.639 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:44 +0000 (0:00:00.065) 0:00:51.476 ***** 2021-02-13T17:48:44.666 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2021-02-13T17:48:44.667 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:44.702 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:44 +0000 (0:00:00.063) 0:00:51.539 ***** 2021-02-13T17:48:45.224 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2021-02-13T17:48:45.226 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => {"cache_update_time": 1613238310, "cache_updated": false, "changed": false} 2021-02-13T17:48:45.270 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:45 +0000 (0:00:00.568) 0:00:52.107 ***** 2021-02-13T17:48:45.276 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => {"cache_update_time": 1613238280, "cache_updated": false, "changed": false} 2021-02-13T17:48:45.316 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:45 +0000 (0:00:00.045) 0:00:52.152 ***** 2021-02-13T17:48:45.491 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2021-02-13T17:48:45.492 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2021-02-13T17:48:45.545 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:45 +0000 (0:00:00.228) 0:00:52.381 ***** 2021-02-13T17:48:45.551 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2021-02-13T17:48:45.591 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:45 +0000 (0:00:00.046) 0:00:52.427 ***** 2021-02-13T17:48:45.756 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2021-02-13T17:48:45.757 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2021-02-13T17:48:45.799 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:45 +0000 (0:00:00.208) 0:00:52.636 ***** 2021-02-13T17:48:45.805 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2021-02-13T17:48:45.857 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:45 +0000 (0:00:00.057) 0:00:52.694 ***** 2021-02-13T17:48:45.895 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-02-13T17:48:45.897 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "DAEMON_OPTS", "msg": ""} 2021-02-13T17:48:45.959 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "DAEMON_OPTS", "msg": ""} 2021-02-13T17:48:45.981 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "NRPE_OPTS", "msg": ""} 2021-02-13T17:48:46.022 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:46 +0000 (0:00:00.165) 0:00:52.859 ***** 2021-02-13T17:48:46.041 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "NRPE_OPTS", "msg": ""} 2021-02-13T17:48:46.078 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:46 +0000 (0:00:00.056) 0:00:52.915 ***** 2021-02-13T17:48:46.084 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2021-02-13T17:48:46.086 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:46.124 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:46 +0000 (0:00:00.045) 0:00:52.961 ***** 2021-02-13T17:48:46.132 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:46.169 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:46 +0000 (0:00:00.044) 0:00:53.005 ***** 2021-02-13T17:48:46.176 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2021-02-13T17:48:46.178 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-02-13T17:48:46.214 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:46 +0000 (0:00:00.045) 0:00:53.051 ***** 2021-02-13T17:48:46.220 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-02-13T17:48:46.257 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:46 +0000 (0:00:00.043) 0:00:53.094 ***** 2021-02-13T17:48:46.264 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2021-02-13T17:48:46.265 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:46.303 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:46 +0000 (0:00:00.046) 0:00:53.140 ***** 2021-02-13T17:48:46.311 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:46.358 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:46 +0000 (0:00:00.054) 0:00:53.195 ***** 2021-02-13T17:48:46.520 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2021-02-13T17:48:46.522 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => {"changed": false, "checksum": "a0ee4c31e844cf26108115f6af99f92f904eafbf", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1176, "state": "file", "uid": 0} 2021-02-13T17:48:46.563 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:46 +0000 (0:00:00.204) 0:00:53.400 ***** 2021-02-13T17:48:46.582 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => {"changed": false, "checksum": "a0ee4c31e844cf26108115f6af99f92f904eafbf", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1176, "state": "file", "uid": 0} 2021-02-13T17:48:46.636 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:46 +0000 (0:00:00.072) 0:00:53.472 ***** 2021-02-13T17:48:47.077 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2021-02-13T17:48:47.078 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Sat 2021-02-13 17:47:44 UTC", "ActiveEnterTimestampMonotonic": "17996128", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "sysinit.target time-sync.target systemd-tmpfiles-setup.service system.slice nss-lookup.target network.target var-run.mount systemd-journald.socket basic.target remote-fs.target -.mount local-fs.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Sat 2021-02-13 17:47:44 UTC", "AssertTimestampMonotonic": "17995577", "Before": "plymouth-quit.service multi-user.target xdm.service shutdown.target getty@tty1.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Sat 2021-02-13 17:47:44 UTC", "ConditionTimestampMonotonic": "17995577", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target nrpe.socket", "ControlGroup": "/system.slice/nagios-nrpe-serv 2021-02-13T17:48:47.079 INFO:teuthology.task.ansible.out:er.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EnvironmentFile": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1372", "ExecMainStartTimestamp": "Sat 2021-02-13 17:47:44 UTC", "ExecMainStartTimestampMonotonic": "17996096", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[Sat 2021-02-13 17:47:44 UTC] ; stop_time=[n/a] ; pid=1372 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GID": "118", "Group": "nagios", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Sat 2021-02-13 17:47:44 UTC", "InactiveExitTimestampMonotonic": "17996128", "InvocationID": "b107ea0984964ddb9f7909e2a1abfd54", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "in 2021-02-13T17:48:47.081 INFO:teuthology.task.ansible.out:finity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128079", "LimitNPROCSoft": "128079", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128079", "LimitSIGPENDINGSoft": "128079", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1372", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nagios/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target -.mount", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "on-abort", "RestartUSec": "100ms", 2021-02-13T17:48:47.082 INFO:teuthology.task.ansible.out:"RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Sat 2021-02-13 17:47:44 UTC", "StateChangeTimestampMonotonic": "17996128", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "109", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Sat 2021-02-13 17:47:44 UTC", "WatchdogTimestampMonotonic": "17996127", "WatchdogUSec": "0"}} 2021-02-13T17:48:47.117 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:47 +0000 (0:00:00.481) 0:00:53.954 ***** 2021-02-13T17:48:47.118 INFO:teuthology.task.ansible.out: 2021-02-13T17:48:47.127 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Sat 2021-02-13 17:47:38 UTC", "ActiveEnterTimestampMonotonic": "18191285", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-journald.socket basic.target systemd-tmpfiles-setup.service remote-fs.target time-sync.target system.slice sysinit.target local-fs.target network.target nss-lookup.target -.mount var-run.mount", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Sat 2021-02-13 17:47:38 UTC", "AssertTimestampMonotonic": "18190615", "Before": "getty@tty1.service xdm.service plymouth-quit.service shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Sat 2021-02-13 17:47:38 UTC", "ConditionTimestampMonotonic": "18190615", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target nrpe.socket", "ControlGroup": "/system.slice/nagios-nrpe-serv 2021-02-13T17:48:47.128 INFO:teuthology.task.ansible.out:er.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EnvironmentFile": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1427", "ExecMainStartTimestamp": "Sat 2021-02-13 17:47:38 UTC", "ExecMainStartTimestampMonotonic": "18191266", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[Sat 2021-02-13 17:47:38 UTC] ; stop_time=[n/a] ; pid=1427 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GID": "118", "Group": "nagios", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Sat 2021-02-13 17:47:38 UTC", "InactiveExitTimestampMonotonic": "18191285", "InvocationID": "3180826c4b474b2c8256a006db41ee8f", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "in 2021-02-13T17:48:47.131 INFO:teuthology.task.ansible.out:finity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128079", "LimitNPROCSoft": "128079", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128079", "LimitSIGPENDINGSoft": "128079", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1427", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nagios/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount system.slice sysinit.target", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "on-abort", "RestartUSec": "100ms", 2021-02-13T17:48:47.132 INFO:teuthology.task.ansible.out:"RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Sat 2021-02-13 17:47:38 UTC", "StateChangeTimestampMonotonic": "18191285", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "109", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Sat 2021-02-13 17:47:38 UTC", "WatchdogTimestampMonotonic": "18191284", "WatchdogUSec": "0"}} 2021-02-13T17:48:47.166 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:47 +0000 (0:00:00.048) 0:00:54.002 ***** 2021-02-13T17:48:47.172 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2021-02-13T17:48:47.173 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:47.208 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:47 +0000 (0:00:00.042) 0:00:54.045 ***** 2021-02-13T17:48:47.215 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:47.254 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:47 +0000 (0:00:00.045) 0:00:54.090 ***** 2021-02-13T17:48:47.260 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2021-02-13T17:48:47.261 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:47.297 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:47 +0000 (0:00:00.043) 0:00:54.134 ***** 2021-02-13T17:48:47.303 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:47.340 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:47 +0000 (0:00:00.042) 0:00:54.176 ***** 2021-02-13T17:48:47.346 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2021-02-13T17:48:47.347 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:47.381 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:47 +0000 (0:00:00.041) 0:00:54.218 ***** 2021-02-13T17:48:47.388 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:47.424 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:47 +0000 (0:00:00.043) 0:00:54.261 ***** 2021-02-13T17:48:47.431 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2021-02-13T17:48:47.432 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:47.467 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:47 +0000 (0:00:00.042) 0:00:54.304 ***** 2021-02-13T17:48:47.478 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:47.514 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:47 +0000 (0:00:00.047) 0:00:54.351 ***** 2021-02-13T17:48:47.520 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2021-02-13T17:48:47.522 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:47.558 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:47 +0000 (0:00:00.043) 0:00:54.395 ***** 2021-02-13T17:48:47.564 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:47.606 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:47 +0000 (0:00:00.048) 0:00:54.443 ***** 2021-02-13T17:48:47.612 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2021-02-13T17:48:47.614 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:47.649 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:47 +0000 (0:00:00.042) 0:00:54.485 ***** 2021-02-13T17:48:47.655 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:47.695 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:47 +0000 (0:00:00.046) 0:00:54.532 ***** 2021-02-13T17:48:47.701 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2021-02-13T17:48:47.703 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:47.739 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:47 +0000 (0:00:00.043) 0:00:54.575 ***** 2021-02-13T17:48:47.745 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:47.791 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:47 +0000 (0:00:00.052) 0:00:54.628 ***** 2021-02-13T17:48:47.799 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2021-02-13T17:48:47.800 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:47.836 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:47 +0000 (0:00:00.044) 0:00:54.673 ***** 2021-02-13T17:48:47.841 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:47.889 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:47 +0000 (0:00:00.052) 0:00:54.725 ***** 2021-02-13T17:48:47.898 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2021-02-13T17:48:47.899 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:47.935 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:47 +0000 (0:00:00.046) 0:00:54.772 ***** 2021-02-13T17:48:47.941 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:47.978 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:47 +0000 (0:00:00.042) 0:00:54.815 ***** 2021-02-13T17:48:47.984 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2021-02-13T17:48:47.985 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:48.021 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:48 +0000 (0:00:00.043) 0:00:54.858 ***** 2021-02-13T17:48:48.027 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:48.065 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:48 +0000 (0:00:00.043) 0:00:54.902 ***** 2021-02-13T17:48:48.072 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2021-02-13T17:48:48.073 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} 2021-02-13T17:48:48.110 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:48 +0000 (0:00:00.044) 0:00:54.947 ***** 2021-02-13T17:48:48.116 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} 2021-02-13T17:48:48.155 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:48 +0000 (0:00:00.045) 0:00:54.992 ***** 2021-02-13T17:48:48.160 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2021-02-13T17:48:48.161 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "collectl", "blktrace", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2021-02-13T17:48:48.199 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:48 +0000 (0:00:00.044) 0:00:55.036 ***** 2021-02-13T17:48:48.206 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "collectl", "blktrace", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2021-02-13T17:48:48.244 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:48 +0000 (0:00:00.044) 0:00:55.081 ***** 2021-02-13T17:48:48.250 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2021-02-13T17:48:48.251 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3", "libssl1.0.0"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "python-virtualenv", "python-configobj", "python-gevent", "python-numpy", "python-matplotlib", "python-nose", "btrfs-tools", "lttng-tools", "libtool-bin", "docker.io", "python3-nose"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml"} 2021-02-13T17:48:48.291 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:48 +0000 (0:00:00.046) 0:00:55.128 ***** 2021-02-13T17:48:48.298 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3", "libssl1.0.0"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "python-virtualenv", "python-configobj", "python-gevent", "python-numpy", "python-matplotlib", "python-nose", "btrfs-tools", "lttng-tools", "libtool-bin", "docker.io", "python3-nose"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml"} 2021-02-13T17:48:48.335 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:48 +0000 (0:00:00.043) 0:00:55.172 ***** 2021-02-13T17:48:48.341 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2021-02-13T17:48:48.343 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-02-13T17:48:48.380 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:48 +0000 (0:00:00.044) 0:00:55.217 ***** 2021-02-13T17:48:48.386 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-02-13T17:48:48.425 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:48 +0000 (0:00:00.045) 0:00:55.262 ***** 2021-02-13T17:48:48.464 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2021-02-13T17:48:48.466 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-02-13T17:48:48.501 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:48 +0000 (0:00:00.075) 0:00:55.338 ***** 2021-02-13T17:48:48.518 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-02-13T17:48:48.555 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:48 +0000 (0:00:00.053) 0:00:55.392 ***** 2021-02-13T17:48:48.602 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2021-02-13T17:48:48.604 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => {"changed": false, "gid": 1234, "name": "ubuntu", "state": "present", "system": false} 2021-02-13T17:48:48.640 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:48 +0000 (0:00:00.084) 0:00:55.477 ***** 2021-02-13T17:48:48.646 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => {"changed": false, "gid": 1234, "name": "ubuntu", "state": "present", "system": false} 2021-02-13T17:48:48.682 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:48 +0000 (0:00:00.042) 0:00:55.519 ***** 2021-02-13T17:48:48.688 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2021-02-13T17:48:48.690 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:48.724 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:48 +0000 (0:00:00.041) 0:00:55.561 ***** 2021-02-13T17:48:48.730 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:48.767 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:48 +0000 (0:00:00.042) 0:00:55.603 ***** 2021-02-13T17:48:48.773 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2021-02-13T17:48:48.774 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:48.809 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:48 +0000 (0:00:00.042) 0:00:55.646 ***** 2021-02-13T17:48:48.815 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:48.851 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:48 +0000 (0:00:00.042) 0:00:55.688 ***** 2021-02-13T17:48:48.909 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2021-02-13T17:48:48.910 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} 2021-02-13T17:48:48.946 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:48 +0000 (0:00:00.094) 0:00:55.783 ***** 2021-02-13T17:48:48.963 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} 2021-02-13T17:48:49.010 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:49 +0000 (0:00:00.063) 0:00:55.846 ***** 2021-02-13T17:48:49.215 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2021-02-13T17:48:49.217 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2021-02-13T17:48:49.252 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:49 +0000 (0:00:00.242) 0:00:56.089 ***** 2021-02-13T17:48:49.278 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2021-02-13T17:48:49.280 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "gibba036"}, "changed": false} 2021-02-13T17:48:49.313 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:49 +0000 (0:00:00.060) 0:00:56.150 ***** 2021-02-13T17:48:49.329 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2021-02-13T17:48:49.331 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2021-02-13T17:48:49.370 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:49 +0000 (0:00:00.056) 0:00:56.206 ***** 2021-02-13T17:48:49.399 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2021-02-13T17:48:49.400 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "gibba025"}, "changed": false} 2021-02-13T17:48:49.440 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:49 +0000 (0:00:00.070) 0:00:56.277 ***** 2021-02-13T17:48:50.122 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2021-02-13T17:48:50.123 INFO:teuthology.task.ansible.out:changed: [gibba036.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "gibba036.front.sepia.ceph.com", "ansible_hostname": "gibba036", "ansible_nodename": "gibba036"}, "changed": true, "name": "gibba036"} 2021-02-13T17:48:50.158 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:50 +0000 (0:00:00.718) 0:00:56.995 ***** 2021-02-13T17:48:50.164 INFO:teuthology.task.ansible.out:changed: [gibba025.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "gibba025.front.sepia.ceph.com", "ansible_hostname": "gibba025", "ansible_nodename": "gibba025"}, "changed": true, "name": "gibba025"} 2021-02-13T17:48:50.201 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:50 +0000 (0:00:00.042) 0:00:57.038 ***** 2021-02-13T17:48:50.362 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2021-02-13T17:48:50.364 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2021-02-13T17:48:50.405 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:50 +0000 (0:00:00.203) 0:00:57.241 ***** 2021-02-13T17:48:50.412 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2021-02-13T17:48:50.454 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:50 +0000 (0:00:00.049) 0:00:57.291 ***** 2021-02-13T17:48:50.608 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2021-02-13T17:48:50.609 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} 2021-02-13T17:48:50.649 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:50 +0000 (0:00:00.194) 0:00:57.486 ***** 2021-02-13T17:48:50.656 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} 2021-02-13T17:48:50.694 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:50 +0000 (0:00:00.044) 0:00:57.531 ***** 2021-02-13T17:48:51.046 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2021-02-13T17:48:51.047 INFO:teuthology.task.ansible.out:changed: [gibba036.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2021-02-13T17:48:51.091 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:51 +0000 (0:00:00.396) 0:00:57.927 ***** 2021-02-13T17:48:51.097 INFO:teuthology.task.ansible.out:changed: [gibba025.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2021-02-13T17:48:51.134 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:51 +0000 (0:00:00.043) 0:00:57.971 ***** 2021-02-13T17:48:51.140 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2021-02-13T17:48:51.142 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:51.178 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:51 +0000 (0:00:00.043) 0:00:58.015 ***** 2021-02-13T17:48:51.184 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:51.221 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:51 +0000 (0:00:00.043) 0:00:58.058 ***** 2021-02-13T17:48:51.227 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-02-13T17:48:51.229 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:51.265 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:51 +0000 (0:00:00.043) 0:00:58.101 ***** 2021-02-13T17:48:51.271 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:51.307 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:51 +0000 (0:00:00.042) 0:00:58.144 ***** 2021-02-13T17:48:51.316 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-02-13T17:48:51.317 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:51.352 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:51 +0000 (0:00:00.044) 0:00:58.189 ***** 2021-02-13T17:48:51.358 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:51.396 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:51 +0000 (0:00:00.043) 0:00:58.233 ***** 2021-02-13T17:48:51.402 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-02-13T17:48:51.403 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:51.440 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:51 +0000 (0:00:00.044) 0:00:58.277 ***** 2021-02-13T17:48:51.446 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:51.482 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:51 +0000 (0:00:00.042) 0:00:58.319 ***** 2021-02-13T17:48:51.488 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-02-13T17:48:51.489 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:51.525 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:51 +0000 (0:00:00.042) 0:00:58.362 ***** 2021-02-13T17:48:51.531 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:51.571 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:51 +0000 (0:00:00.045) 0:00:58.407 ***** 2021-02-13T17:48:51.577 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-02-13T17:48:51.578 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:51.612 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:51 +0000 (0:00:00.041) 0:00:58.449 ***** 2021-02-13T17:48:51.619 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:51.655 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:51 +0000 (0:00:00.042) 0:00:58.492 ***** 2021-02-13T17:48:51.661 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-02-13T17:48:51.661 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:51.698 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:51 +0000 (0:00:00.042) 0:00:58.534 ***** 2021-02-13T17:48:51.703 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:51.740 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:51 +0000 (0:00:00.042) 0:00:58.577 ***** 2021-02-13T17:48:51.746 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2021-02-13T17:48:51.747 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:51.786 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:51 +0000 (0:00:00.046) 0:00:58.623 ***** 2021-02-13T17:48:51.794 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:51.835 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:51 +0000 (0:00:00.048) 0:00:58.672 ***** 2021-02-13T17:48:51.843 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2021-02-13T17:48:51.884 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:51 +0000 (0:00:00.048) 0:00:58.720 ***** 2021-02-13T17:48:51.932 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:51 +0000 (0:00:00.048) 0:00:58.769 ***** 2021-02-13T17:48:51.942 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2021-02-13T17:48:51.980 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:51 +0000 (0:00:00.047) 0:00:58.816 ***** 2021-02-13T17:48:52.021 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:52 +0000 (0:00:00.041) 0:00:58.858 ***** 2021-02-13T17:48:52.027 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2021-02-13T17:48:52.063 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:52 +0000 (0:00:00.041) 0:00:58.900 ***** 2021-02-13T17:48:52.105 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:52 +0000 (0:00:00.041) 0:00:58.942 ***** 2021-02-13T17:48:52.111 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2021-02-13T17:48:52.112 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:52.147 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:52 +0000 (0:00:00.041) 0:00:58.984 ***** 2021-02-13T17:48:52.153 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:52.192 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:52 +0000 (0:00:00.045) 0:00:59.029 ***** 2021-02-13T17:48:52.198 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2021-02-13T17:48:52.199 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [gibba036.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2021-02-13T17:48:52.237 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:52 +0000 (0:00:00.044) 0:00:59.074 ***** 2021-02-13T17:48:52.242 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2021-02-13T17:48:52.243 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2021-02-13T17:48:52.280 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:52 +0000 (0:00:00.042) 0:00:59.116 ***** 2021-02-13T17:48:52.285 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2021-02-13T17:48:52.287 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:52.323 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:52 +0000 (0:00:00.043) 0:00:59.159 ***** 2021-02-13T17:48:52.329 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:52.366 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:52 +0000 (0:00:00.043) 0:00:59.203 ***** 2021-02-13T17:48:52.372 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-02-13T17:48:52.373 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:52.409 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:52 +0000 (0:00:00.042) 0:00:59.245 ***** 2021-02-13T17:48:52.414 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:52.451 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:52 +0000 (0:00:00.041) 0:00:59.287 ***** 2021-02-13T17:48:52.456 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2021-02-13T17:48:52.457 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:52.498 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:52 +0000 (0:00:00.047) 0:00:59.335 ***** 2021-02-13T17:48:52.504 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:52.540 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:52 +0000 (0:00:00.042) 0:00:59.377 ***** 2021-02-13T17:48:52.546 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2021-02-13T17:48:52.547 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:52.583 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:52 +0000 (0:00:00.042) 0:00:59.420 ***** 2021-02-13T17:48:52.590 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:52.627 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:52 +0000 (0:00:00.043) 0:00:59.464 ***** 2021-02-13T17:48:52.633 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2021-02-13T17:48:52.634 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:52.669 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:52 +0000 (0:00:00.041) 0:00:59.505 ***** 2021-02-13T17:48:52.674 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:52.711 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:52 +0000 (0:00:00.041) 0:00:59.547 ***** 2021-02-13T17:48:52.716 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2021-02-13T17:48:52.718 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:52.753 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:52 +0000 (0:00:00.042) 0:00:59.590 ***** 2021-02-13T17:48:52.759 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:52.799 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:52 +0000 (0:00:00.046) 0:00:59.636 ***** 2021-02-13T17:48:52.806 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-02-13T17:48:52.807 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:52.843 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:52 +0000 (0:00:00.043) 0:00:59.680 ***** 2021-02-13T17:48:52.850 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:52.886 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:52 +0000 (0:00:00.043) 0:00:59.723 ***** 2021-02-13T17:48:52.892 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-02-13T17:48:52.894 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:52.929 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:52 +0000 (0:00:00.042) 0:00:59.766 ***** 2021-02-13T17:48:52.935 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:52.973 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:52 +0000 (0:00:00.043) 0:00:59.810 ***** 2021-02-13T17:48:52.980 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-02-13T17:48:52.981 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:53.019 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:53 +0000 (0:00:00.046) 0:00:59.856 ***** 2021-02-13T17:48:53.026 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:53.064 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:53 +0000 (0:00:00.044) 0:00:59.901 ***** 2021-02-13T17:48:53.070 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2021-02-13T17:48:53.071 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:53.112 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:53 +0000 (0:00:00.048) 0:00:59.949 ***** 2021-02-13T17:48:53.119 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:53.155 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:53 +0000 (0:00:00.042) 0:00:59.992 ***** 2021-02-13T17:48:53.163 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-02-13T17:48:53.163 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:53.198 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:53 +0000 (0:00:00.042) 0:01:00.035 ***** 2021-02-13T17:48:53.204 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:53.243 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:53 +0000 (0:00:00.045) 0:01:00.080 ***** 2021-02-13T17:48:53.252 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-02-13T17:48:53.253 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:53.292 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:53 +0000 (0:00:00.049) 0:01:00.129 ***** 2021-02-13T17:48:53.300 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:53.341 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:53 +0000 (0:00:00.048) 0:01:00.178 ***** 2021-02-13T17:48:53.350 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2021-02-13T17:48:53.351 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:53.389 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:53 +0000 (0:00:00.048) 0:01:00.226 ***** 2021-02-13T17:48:53.397 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:53.441 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:53 +0000 (0:00:00.052) 0:01:00.278 ***** 2021-02-13T17:48:53.449 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2021-02-13T17:48:53.451 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:53.490 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:53 +0000 (0:00:00.048) 0:01:00.327 ***** 2021-02-13T17:48:53.500 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:53.561 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:53 +0000 (0:00:00.070) 0:01:00.398 ***** 2021-02-13T17:48:53.569 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2021-02-13T17:48:53.570 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:53.607 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:53 +0000 (0:00:00.045) 0:01:00.444 ***** 2021-02-13T17:48:53.615 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:53.652 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:53 +0000 (0:00:00.045) 0:01:00.489 ***** 2021-02-13T17:48:53.660 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* 2021-02-13T17:48:53.662 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:53.697 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:53 +0000 (0:00:00.045) 0:01:00.534 ***** 2021-02-13T17:48:53.705 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:53.745 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:53 +0000 (0:00:00.047) 0:01:00.581 ***** 2021-02-13T17:48:53.752 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** 2021-02-13T17:48:53.754 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:53.793 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:53 +0000 (0:00:00.047) 0:01:00.629 ***** 2021-02-13T17:48:53.802 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:53.839 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:53 +0000 (0:00:00.046) 0:01:00.676 ***** 2021-02-13T17:48:53.849 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* 2021-02-13T17:48:53.849 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:53.884 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:53 +0000 (0:00:00.044) 0:01:00.721 ***** 2021-02-13T17:48:53.891 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:53.927 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:53 +0000 (0:00:00.043) 0:01:00.764 ***** 2021-02-13T17:48:53.935 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** 2021-02-13T17:48:53.935 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:53.972 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:53 +0000 (0:00:00.044) 0:01:00.809 ***** 2021-02-13T17:48:53.979 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:54.017 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:54 +0000 (0:00:00.044) 0:01:00.853 ***** 2021-02-13T17:48:54.024 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ 2021-02-13T17:48:54.025 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:54.067 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:54 +0000 (0:00:00.050) 0:01:00.904 ***** 2021-02-13T17:48:54.076 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:54.118 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:54 +0000 (0:00:00.050) 0:01:00.954 ***** 2021-02-13T17:48:54.166 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2021-02-13T17:48:54.167 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.001241", "end": "2021-02-13 17:48:54.350682", "rc": 0, "start": "2021-02-13 17:48:54.349441", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-13T17:48:54.203 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:54 +0000 (0:00:00.085) 0:01:01.040 ***** 2021-02-13T17:48:54.230 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.001304", "end": "2021-02-13 17:48:54.274589", "rc": 0, "start": "2021-02-13 17:48:54.273285", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-13T17:48:54.231 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2021-02-13T17:48:54.266 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:54 +0000 (0:00:00.062) 0:01:01.102 ***** 2021-02-13T17:48:54.299 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:54 +0000 (0:00:00.032) 0:01:01.135 ***** 2021-02-13T17:48:54.341 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:54 +0000 (0:00:00.042) 0:01:01.178 ***** 2021-02-13T17:48:54.504 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2021-02-13T17:48:54.506 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} 2021-02-13T17:48:54.541 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:54 +0000 (0:00:00.199) 0:01:01.378 ***** 2021-02-13T17:48:54.568 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2021-02-13T17:48:54.569 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:54.603 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:54 +0000 (0:00:00.062) 0:01:01.440 ***** 2021-02-13T17:48:54.610 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2021-02-13T17:48:54.610 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} 2021-02-13T17:48:54.647 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:54 +0000 (0:00:00.043) 0:01:01.484 ***** 2021-02-13T17:48:54.674 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2021-02-13T17:48:54.676 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:48:54.710 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:54 +0000 (0:00:00.063) 0:01:01.547 ***** 2021-02-13T17:48:55.287 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2021-02-13T17:48:55.288 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} 2021-02-13T17:48:55.298 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} 2021-02-13T17:48:55.657 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2021-02-13T17:48:55.693 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:55 +0000 (0:00:00.982) 0:01:02.530 ***** 2021-02-13T17:48:55.700 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2021-02-13T17:48:55.741 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:55 +0000 (0:00:00.048) 0:01:02.578 ***** 2021-02-13T17:48:56.290 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2021-02-13T17:48:56.291 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => {"cache_update_time": 1613238310, "cache_updated": false, "changed": false} 2021-02-13T17:48:56.328 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:56 +0000 (0:00:00.586) 0:01:03.165 ***** 2021-02-13T17:48:56.345 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => {"cache_update_time": 1613238280, "cache_updated": false, "changed": false} 2021-02-13T17:48:56.381 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:56 +0000 (0:00:00.053) 0:01:03.218 ***** 2021-02-13T17:48:56.387 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2021-02-13T17:48:56.425 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:56 +0000 (0:00:00.043) 0:01:03.261 ***** 2021-02-13T17:48:56.469 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:56 +0000 (0:00:00.044) 0:01:03.306 ***** 2021-02-13T17:48:56.527 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2021-02-13T17:48:56.528 INFO:teuthology.task.ansible.out:[WARNING]: Consider using 'become', 'become_method', and 'become_user' rather than running sudo changed: [gibba036.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.013556", "end": "2021-02-13 17:48:56.711662", "rc": 0, "start": "2021-02-13 17:48:56.698106", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-13T17:48:56.565 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:56 +0000 (0:00:00.096) 0:01:03.402 ***** 2021-02-13T17:48:56.572 INFO:teuthology.task.ansible.out:changed: [gibba025.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.015041", "end": "2021-02-13 17:48:56.616302", "rc": 0, "start": "2021-02-13 17:48:56.601261", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-13T17:48:56.610 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:56 +0000 (0:00:00.044) 0:01:03.447 ***** 2021-02-13T17:48:58.405 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2021-02-13T17:48:58.406 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => {"cache_update_time": 1613238310, "cache_updated": false, "changed": false} 2021-02-13T17:48:58.446 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:58 +0000 (0:00:01.835) 0:01:05.282 ***** 2021-02-13T17:48:58.464 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => {"cache_update_time": 1613238280, "cache_updated": false, "changed": false} 2021-02-13T17:48:58.503 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:48:58 +0000 (0:00:00.057) 0:01:05.340 ***** 2021-02-13T17:49:05.477 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2021-02-13T17:49:05.478 INFO:teuthology.task.ansible.out:changed: [gibba036.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0\n libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1\n libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0\n libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0\n libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3\n libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0\n libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5\n libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 82 not upgraded.\nAfter this operation, 47.6 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 137602 files and directories 2021-02-13T17:49:05.479 INFO:teuthology.task.ansible.out: currently installed.)\r\nRemoving qemu-utils (1:2.11+dfsg-1ubuntu7.33) ...\r\nRemoving qemu-system-x86 (1:2.11+dfsg-1ubuntu7.33) ...\r\nRemoving qemu-system-common (1:2.11+dfsg-1ubuntu7.33) ...\r\nRemoving qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.33) ...\r\nRemoving librbd1 (12.2.13-0ubuntu0.18.04.4) ...\r\nRemoving librados2 (12.2.13-0ubuntu0.18.04.4) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\nProcessing triggers for libc-bin (2.27-3ubuntu1.3) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0", " libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1", " libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0", " libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0", " libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3", " libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0", " libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5", " libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 82 not upgraded.", "After this operation, 47.6 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Readi 2021-02-13T17:49:05.480 INFO:teuthology.task.ansible.out:ng database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 137602 files and directories currently installed.)", "Removing qemu-utils (1:2.11+dfsg-1ubuntu7.33) ...", "Removing qemu-system-x86 (1:2.11+dfsg-1ubuntu7.33) ...", "Removing qemu-system-common (1:2.11+dfsg-1ubuntu7.33) ...", "Removing qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.33) ...", "Removing librbd1 (12.2.13-0ubuntu0.18.04.4) ...", "Removing librados2 (12.2.13-0ubuntu0.18.04.4) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1.3) ..."]} 2021-02-13T17:49:05.515 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:05 +0000 (0:00:07.011) 0:01:12.351 ***** 2021-02-13T17:49:05.849 INFO:teuthology.task.ansible.out:changed: [gibba025.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0\n libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1\n libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0\n libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0\n libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3\n libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0\n libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5\n libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 82 not upgraded.\nAfter this operation, 47.6 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 137602 files and directories 2021-02-13T17:49:06.043 INFO:teuthology.task.ansible.out: currently installed.)\r\nRemoving qemu-utils (1:2.11+dfsg-1ubuntu7.33) ...\r\nRemoving qemu-system-x86 (1:2.11+dfsg-1ubuntu7.33) ...\r\nRemoving qemu-system-common (1:2.11+dfsg-1ubuntu7.33) ...\r\nRemoving qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.33) ...\r\nRemoving librbd1 (12.2.13-0ubuntu0.18.04.4) ...\r\nRemoving librados2 (12.2.13-0ubuntu0.18.04.4) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\nProcessing triggers for libc-bin (2.27-3ubuntu1.3) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0", " libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1", " libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0", " libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0", " libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3", " libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0", " libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5", " libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 82 not upgraded.", "After this operation, 47.6 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Readi 2021-02-13T17:49:06.045 INFO:teuthology.task.ansible.out:ng database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 137602 files and directories currently installed.)", "Removing qemu-utils (1:2.11+dfsg-1ubuntu7.33) ...", "Removing qemu-system-x86 (1:2.11+dfsg-1ubuntu7.33) ...", "Removing qemu-system-common (1:2.11+dfsg-1ubuntu7.33) ...", "Removing qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.33) ...", "Removing librbd1 (12.2.13-0ubuntu0.18.04.4) ...", "Removing librados2 (12.2.13-0ubuntu0.18.04.4) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1.3) ..."]} Saturday 13 February 2021 17:49:05 +0000 (0:00:00.383) 0:01:12.735 ***** 2021-02-13T17:49:12.057 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-02-13T17:49:12.058 INFO:teuthology.task.ansible.out:changed: [gibba036.front.sepia.ceph.com] => {"cache_update_time": 1613238310, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0\n libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1\n libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0\n libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0\n libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3\n libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0\n libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5\n libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following additional packages will be installed:\n apt-utils libapt-pkg5.0\nSuggested packages:\n apt-doc aptitude | synaptic | wajig\nThe following packages will be upgraded:\n apt apt-utils libapt-pkg5.0\n3 upgraded, 0 newly installed, 0 to remove and 79 not upgraded.\nNeed to get 2214 kB of archives.\nAfter this operation, 0 B of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libapt-pkg5.0 amd64 1.6.12ubuntu0.2 [806 kB]\nGet:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 apt amd64 1.6.12ubuntu0.2 [1201 kB]\nGet:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 apt-utils amd64 1.6.12ubuntu0.2 [207 kB]\nFetched 2214 kB in 1s (2624 kB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 1 2021-02-13T17:49:12.059 INFO:teuthology.task.ansible.out:0%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 137460 files and directories currently installed.)\r\nPreparing to unpack .../libapt-pkg5.0_1.6.12ubuntu0.2_amd64.deb ...\r\nUnpacking libapt-pkg5.0:amd64 (1.6.12ubuntu0.2) over (1.6.12ubuntu0.1) ...\r\nSetting up libapt-pkg5.0:amd64 (1.6.12ubuntu0.2) ...\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 137460 files and directories currently installed.)\r\nPreparing to unpack .../apt_1.6.12ubuntu0.2_amd64.deb ...\r\nUnpacking apt (1.6.12ubuntu0.2) over (1.6.12ubuntu0.1) ...\r\nSetting up apt (1.6.12ubuntu0.2) ...\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75 2021-02-13T17:49:12.060 INFO:teuthology.task.ansible.out:%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 137460 files and directories currently installed.)\r\nPreparing to unpack .../apt-utils_1.6.12ubuntu0.2_amd64.deb ...\r\nUnpacking apt-utils (1.6.12ubuntu0.2) over (1.6.12ubuntu0.1) ...\r\nSetting up apt-utils (1.6.12ubuntu0.2) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\nProcessing triggers for libc-bin (2.27-3ubuntu1.3) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0", " libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1", " libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0", " libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0", " libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3", " libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0", " libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5", " libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following additional packages will be installed:", " apt-utils libapt-pkg5.0", "Suggested packages:", " apt-doc aptitude | synaptic | wajig", "The following packages will be upgraded:", " apt apt-utils libapt-pkg5.0", "3 upgraded, 0 newly installed, 0 to remove and 79 not upgraded.", "Need to get 2214 kB of archives.", "After this operation, 0 B of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libapt-pkg5.0 amd64 1.6.12ubuntu0.2 [806 kB]", "Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 apt am 2021-02-13T17:49:12.062 INFO:teuthology.task.ansible.out:d64 1.6.12ubuntu0.2 [1201 kB]", "Get:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 apt-utils amd64 1.6.12ubuntu0.2 [207 kB]", "Fetched 2214 kB in 1s (2624 kB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 137460 files and directories currently installed.)", "Preparing to unpack .../libapt-pkg5.0_1.6.12ubuntu0.2_amd64.deb ...", "Unpacking libapt-pkg5.0:amd64 (1.6.12ubuntu0.2) over (1.6.12ubuntu0.1) ...", "Setting up libapt-pkg5.0:amd64 (1.6.12ubuntu0.2) ...", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 137460 files and directories currently installed.)", "Preparing to unpack .../apt_1.6.12ubuntu0.2_amd64.deb ...", "Unpacking apt (1.6.12ubuntu0.2) over (1.6.12ubuntu0.1) ...", "Setting up apt (1.6.12ubuntu0.2) ...", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Readi 2021-02-13T17:49:12.063 INFO:teuthology.task.ansible.out:ng database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 137460 files and directories currently installed.)", "Preparing to unpack .../apt-utils_1.6.12ubuntu0.2_amd64.deb ...", "Unpacking apt-utils (1.6.12ubuntu0.2) over (1.6.12ubuntu0.1) ...", "Setting up apt-utils (1.6.12ubuntu0.2) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1.3) ..."]} 2021-02-13T17:49:12.095 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:12 +0000 (0:00:06.196) 0:01:18.932 ***** 2021-02-13T17:49:12.127 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2021-02-13T17:49:12.129 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:12.164 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:12 +0000 (0:00:00.068) 0:01:19.001 ***** 2021-02-13T17:49:12.446 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-02-13T17:49:12.446 INFO:teuthology.task.ansible.out:changed: [gibba025.front.sepia.ceph.com] => {"cache_update_time": 1613238280, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0\n libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1\n libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0\n libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0\n libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3\n libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0\n libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5\n libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following additional packages will be installed:\n apt-utils libapt-pkg5.0\nSuggested packages:\n apt-doc aptitude | synaptic | wajig\nThe following packages will be upgraded:\n apt apt-utils libapt-pkg5.0\n3 upgraded, 0 newly installed, 0 to remove and 79 not upgraded.\nNeed to get 2214 kB of archives.\nAfter this operation, 0 B of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libapt-pkg5.0 amd64 1.6.12ubuntu0.2 [806 kB]\nGet:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 apt amd64 1.6.12ubuntu0.2 [1201 kB]\nGet:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 apt-utils amd64 1.6.12ubuntu0.2 [207 kB]\nFetched 2214 kB in 1s (2622 kB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 1 2021-02-13T17:49:12.448 INFO:teuthology.task.ansible.out:0%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 137460 files and directories currently installed.)\r\nPreparing to unpack .../libapt-pkg5.0_1.6.12ubuntu0.2_amd64.deb ...\r\nUnpacking libapt-pkg5.0:amd64 (1.6.12ubuntu0.2) over (1.6.12ubuntu0.1) ...\r\nSetting up libapt-pkg5.0:amd64 (1.6.12ubuntu0.2) ...\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 137460 files and directories currently installed.)\r\nPreparing to unpack .../apt_1.6.12ubuntu0.2_amd64.deb ...\r\nUnpacking apt (1.6.12ubuntu0.2) over (1.6.12ubuntu0.1) ...\r\nSetting up apt (1.6.12ubuntu0.2) ...\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75 2021-02-13T17:49:12.449 INFO:teuthology.task.ansible.out:%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 137460 files and directories currently installed.)\r\nPreparing to unpack .../apt-utils_1.6.12ubuntu0.2_amd64.deb ...\r\nUnpacking apt-utils (1.6.12ubuntu0.2) over (1.6.12ubuntu0.1) ...\r\nSetting up apt-utils (1.6.12ubuntu0.2) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\nProcessing triggers for libc-bin (2.27-3ubuntu1.3) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0", " libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1", " libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0", " libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0", " libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3", " libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0", " libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5", " libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following additional packages will be installed:", " apt-utils libapt-pkg5.0", "Suggested packages:", " apt-doc aptitude | synaptic | wajig", "The following packages will be upgraded:", " apt apt-utils libapt-pkg5.0", "3 upgraded, 0 newly installed, 0 to remove and 79 not upgraded.", "Need to get 2214 kB of archives.", "After this operation, 0 B of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libapt-pkg5.0 amd64 1.6.12ubuntu0.2 [806 kB]", "Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 apt am 2021-02-13T17:49:12.450 INFO:teuthology.task.ansible.out:d64 1.6.12ubuntu0.2 [1201 kB]", "Get:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 apt-utils amd64 1.6.12ubuntu0.2 [207 kB]", "Fetched 2214 kB in 1s (2622 kB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 137460 files and directories currently installed.)", "Preparing to unpack .../libapt-pkg5.0_1.6.12ubuntu0.2_amd64.deb ...", "Unpacking libapt-pkg5.0:amd64 (1.6.12ubuntu0.2) over (1.6.12ubuntu0.1) ...", "Setting up libapt-pkg5.0:amd64 (1.6.12ubuntu0.2) ...", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 137460 files and directories currently installed.)", "Preparing to unpack .../apt_1.6.12ubuntu0.2_amd64.deb ...", "Unpacking apt (1.6.12ubuntu0.2) over (1.6.12ubuntu0.1) ...", "Setting up apt (1.6.12ubuntu0.2) ...", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Readi 2021-02-13T17:49:12.451 INFO:teuthology.task.ansible.out:ng database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 137460 files and directories currently installed.)", "Preparing to unpack .../apt-utils_1.6.12ubuntu0.2_amd64.deb ...", "Unpacking apt-utils (1.6.12ubuntu0.2) over (1.6.12ubuntu0.1) ...", "Setting up apt-utils (1.6.12ubuntu0.2) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1.3) ..."]} 2021-02-13T17:49:12.483 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:12 +0000 (0:00:00.318) 0:01:19.320 ***** 2021-02-13T17:49:12.521 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2021-02-13T17:49:12.522 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:12.559 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:12 +0000 (0:00:00.076) 0:01:19.396 ***** 2021-02-13T17:49:19.411 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-02-13T17:49:19.412 INFO:teuthology.task.ansible.out:changed: [gibba025.front.sepia.ceph.com] => {"cache_update_time": 1613238280, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\ngit is already the newest version (1:2.17.1-1ubuntu0.7).\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils\nSuggested packages:\n samba vde2 sgabios ovmf debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 6 newly installed, 0 to remove and 79 not upgraded.\nNeed to get 10.4 MB of archives.\nAfter this operation, 47.6 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librados2 amd64 12.2.13-0ubuntu0.18.04.6 [2724 kB]\nGet:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librbd1 amd64 12.2.13-0ubuntu0.18.04.6 [925 kB]\nGet:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-block-extra amd64 1:2.11+dfsg-1ubuntu7.35 [40.5 kB]\nGet:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-common amd64 1:2.11+dfsg-1ubuntu7.35 [672 kB]\nGet:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-x86 amd64 1:2.11+dfsg-1ubuntu7.35 [5194 kB]\nGet:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-utils amd64 1:2.11+dfsg-1ubuntu7.35 [868 kB]\nFetched 10.4 MB in 1s (9992 kB/s)\nSelecting previously unselected package librados2.\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 2021-02-13T17:49:19.413 INFO:teuthology.task.ansible.out: 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 137460 files and directories currently installed.)\r\nPreparing to unpack .../0-librados2_12.2.13-0ubuntu0.18.04.6_amd64.deb ...\r\nUnpacking librados2 (12.2.13-0ubuntu0.18.04.6) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../1-librbd1_12.2.13-0ubuntu0.18.04.6_amd64.deb ...\r\nUnpacking librbd1 (12.2.13-0ubuntu0.18.04.6) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../2-qemu-block-extra_1%3a2.11+dfsg-1ubuntu7.35_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.35) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../3-qemu-system-common_1%3a2.11+dfsg-1ubuntu7.35_amd64.deb ...\r\nUnpacking qemu-system-common (1:2.11+dfsg-1ubuntu7.35) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../4-qemu-system-x86_1%3a2.11+dfsg-1ubuntu7.35_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:2.11+dfsg-1ubuntu7.35) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../5-qemu-utils_1%3a2.11+dfsg-1ubuntu7.35_amd64.deb ...\r\nUnpacking qemu-utils (1:2.11+dfsg-1ubuntu7.35) ...\r\nSetting up librados2 (12.2.13-0ubuntu0.18.04.6) ...\r\nSetting up librbd1 (12.2.13-0ubuntu0.18.04.6) ...\r\nSetting up qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.35) ...\r\nSetting up qemu-utils (1:2.11+dfsg-1ubuntu7.35) ...\r\nSetting up qemu-system-common (1:2.11+dfsg-1ubuntu7.35) ...\r\nSetting up qemu-system-x86 (1:2.11+dfsg-1ubuntu7.35) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\nProcessing triggers for libc-bin (2.27-3ubuntu 2021-02-13T17:49:19.414 INFO:teuthology.task.ansible.out:1.3) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "git is already the newest version (1:2.17.1-1ubuntu0.7).", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils", "Suggested packages:", " samba vde2 sgabios ovmf debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 6 newly installed, 0 to remove and 79 not upgraded.", "Need to get 10.4 MB of archives.", "After this operation, 47.6 MB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librados2 amd64 12.2.13-0ubuntu0.18.04.6 [2724 kB]", "Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librbd1 amd64 12.2.13-0ubuntu0.18.04.6 [925 kB]", "Get:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-block-extra amd64 1:2.11+dfsg-1ubuntu7.35 [40.5 kB]", "Get:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-common amd64 1:2.11+dfsg-1ubuntu7.35 [672 kB]", "Get:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-x86 amd64 1:2.11+dfsg-1ubuntu7.35 [5194 kB]", "Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-utils amd64 1:2.11+dfsg-1ubuntu7.35 [868 kB]", "Fetched 10.4 MB in 1s (9992 kB/s)", "Selecting previously unselected package librados2.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Re 2021-02-13T17:49:19.416 INFO:teuthology.task.ansible.out:ading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 137460 files and directories currently installed.)", "Preparing to unpack .../0-librados2_12.2.13-0ubuntu0.18.04.6_amd64.deb ...", "Unpacking librados2 (12.2.13-0ubuntu0.18.04.6) ...", "Selecting previously unselected package librbd1.", "Preparing to unpack .../1-librbd1_12.2.13-0ubuntu0.18.04.6_amd64.deb ...", "Unpacking librbd1 (12.2.13-0ubuntu0.18.04.6) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../2-qemu-block-extra_1%3a2.11+dfsg-1ubuntu7.35_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.35) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../3-qemu-system-common_1%3a2.11+dfsg-1ubuntu7.35_amd64.deb ...", "Unpacking qemu-system-common (1:2.11+dfsg-1ubuntu7.35) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../4-qemu-system-x86_1%3a2.11+dfsg-1ubuntu7.35_amd64.deb ...", "Unpacking qemu-system-x86 (1:2.11+dfsg-1ubuntu7.35) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../5-qemu-utils_1%3a2.11+dfsg-1ubuntu7.35_amd64.deb ...", "Unpacking qemu-utils (1:2.11+dfsg-1ubuntu7.35) ...", "Setting up librados2 (12.2.13-0ubuntu0.18.04.6) ...", "Setting up librbd1 (12.2.13-0ubuntu0.18.04.6) ...", "Setting up qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.35) ...", "Setting up qemu-utils (1:2.11+dfsg-1ubuntu7.35) ...", "Setting up qemu-system-common (1:2.11+dfsg-1ubuntu7.35) ...", "Setting up qemu-system-x86 (1:2.11+dfsg-1ubuntu7.35) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1.3) ..."]} 2021-02-13T17:49:19.449 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:19 +0000 (0:00:06.889) 0:01:26.285 ***** 2021-02-13T17:49:19.489 INFO:teuthology.task.ansible.out:changed: [gibba036.front.sepia.ceph.com] => {"cache_update_time": 1613238310, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\ngit is already the newest version (1:2.17.1-1ubuntu0.7).\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils\nSuggested packages:\n samba vde2 sgabios ovmf debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 6 newly installed, 0 to remove and 79 not upgraded.\nNeed to get 10.4 MB of archives.\nAfter this operation, 47.6 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librados2 amd64 12.2.13-0ubuntu0.18.04.6 [2724 kB]\nGet:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librbd1 amd64 12.2.13-0ubuntu0.18.04.6 [925 kB]\nGet:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-block-extra amd64 1:2.11+dfsg-1ubuntu7.35 [40.5 kB]\nGet:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-common amd64 1:2.11+dfsg-1ubuntu7.35 [672 kB]\nGet:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-x86 amd64 1:2.11+dfsg-1ubuntu7.35 [5194 kB]\nGet:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-utils amd64 1:2.11+dfsg-1ubuntu7.35 [868 kB]\nFetched 10.4 MB in 1s (9325 kB/s)\nSelecting previously unselected package librados2.\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 2021-02-13T17:49:19.490 INFO:teuthology.task.ansible.out: 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 137460 files and directories currently installed.)\r\nPreparing to unpack .../0-librados2_12.2.13-0ubuntu0.18.04.6_amd64.deb ...\r\nUnpacking librados2 (12.2.13-0ubuntu0.18.04.6) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../1-librbd1_12.2.13-0ubuntu0.18.04.6_amd64.deb ...\r\nUnpacking librbd1 (12.2.13-0ubuntu0.18.04.6) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../2-qemu-block-extra_1%3a2.11+dfsg-1ubuntu7.35_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.35) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../3-qemu-system-common_1%3a2.11+dfsg-1ubuntu7.35_amd64.deb ...\r\nUnpacking qemu-system-common (1:2.11+dfsg-1ubuntu7.35) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../4-qemu-system-x86_1%3a2.11+dfsg-1ubuntu7.35_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:2.11+dfsg-1ubuntu7.35) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../5-qemu-utils_1%3a2.11+dfsg-1ubuntu7.35_amd64.deb ...\r\nUnpacking qemu-utils (1:2.11+dfsg-1ubuntu7.35) ...\r\nSetting up librados2 (12.2.13-0ubuntu0.18.04.6) ...\r\nSetting up librbd1 (12.2.13-0ubuntu0.18.04.6) ...\r\nSetting up qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.35) ...\r\nSetting up qemu-utils (1:2.11+dfsg-1ubuntu7.35) ...\r\nSetting up qemu-system-common (1:2.11+dfsg-1ubuntu7.35) ...\r\nSetting up qemu-system-x86 (1:2.11+dfsg-1ubuntu7.35) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\nProcessing triggers for libc-bin (2.27-3ubuntu 2021-02-13T17:49:19.492 INFO:teuthology.task.ansible.out:1.3) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "git is already the newest version (1:2.17.1-1ubuntu0.7).", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils", "Suggested packages:", " samba vde2 sgabios ovmf debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 6 newly installed, 0 to remove and 79 not upgraded.", "Need to get 10.4 MB of archives.", "After this operation, 47.6 MB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librados2 amd64 12.2.13-0ubuntu0.18.04.6 [2724 kB]", "Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librbd1 amd64 12.2.13-0ubuntu0.18.04.6 [925 kB]", "Get:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-block-extra amd64 1:2.11+dfsg-1ubuntu7.35 [40.5 kB]", "Get:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-common amd64 1:2.11+dfsg-1ubuntu7.35 [672 kB]", "Get:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-x86 amd64 1:2.11+dfsg-1ubuntu7.35 [5194 kB]", "Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-utils amd64 1:2.11+dfsg-1ubuntu7.35 [868 kB]", "Fetched 10.4 MB in 1s (9325 kB/s)", "Selecting previously unselected package librados2.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Re 2021-02-13T17:49:19.493 INFO:teuthology.task.ansible.out:ading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 137460 files and directories currently installed.)", "Preparing to unpack .../0-librados2_12.2.13-0ubuntu0.18.04.6_amd64.deb ...", "Unpacking librados2 (12.2.13-0ubuntu0.18.04.6) ...", "Selecting previously unselected package librbd1.", "Preparing to unpack .../1-librbd1_12.2.13-0ubuntu0.18.04.6_amd64.deb ...", "Unpacking librbd1 (12.2.13-0ubuntu0.18.04.6) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../2-qemu-block-extra_1%3a2.11+dfsg-1ubuntu7.35_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.35) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../3-qemu-system-common_1%3a2.11+dfsg-1ubuntu7.35_amd64.deb ...", "Unpacking qemu-system-common (1:2.11+dfsg-1ubuntu7.35) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../4-qemu-system-x86_1%3a2.11+dfsg-1ubuntu7.35_amd64.deb ...", "Unpacking qemu-system-x86 (1:2.11+dfsg-1ubuntu7.35) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../5-qemu-utils_1%3a2.11+dfsg-1ubuntu7.35_amd64.deb ...", "Unpacking qemu-utils (1:2.11+dfsg-1ubuntu7.35) ...", "Setting up librados2 (12.2.13-0ubuntu0.18.04.6) ...", "Setting up librbd1 (12.2.13-0ubuntu0.18.04.6) ...", "Setting up qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.35) ...", "Setting up qemu-utils (1:2.11+dfsg-1ubuntu7.35) ...", "Setting up qemu-system-common (1:2.11+dfsg-1ubuntu7.35) ...", "Setting up qemu-system-x86 (1:2.11+dfsg-1ubuntu7.35) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1.3) ..."]} 2021-02-13T17:49:19.532 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:19 +0000 (0:00:00.083) 0:01:26.369 ***** 2021-02-13T17:49:20.036 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2021-02-13T17:49:20.036 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => {"cache_update_time": 1613238280, "cache_updated": false, "changed": false} 2021-02-13T17:49:20.086 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:20 +0000 (0:00:00.552) 0:01:26.922 ***** 2021-02-13T17:49:20.165 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => {"cache_update_time": 1613238310, "cache_updated": false, "changed": false} 2021-02-13T17:49:20.202 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:20 +0000 (0:00:00.116) 0:01:27.039 ***** 2021-02-13T17:49:20.209 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** ok: [gibba025.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2021-02-13T17:49:20.248 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:20 +0000 (0:00:00.046) 0:01:27.085 ***** 2021-02-13T17:49:20.250 INFO:teuthology.task.ansible.out: 2021-02-13T17:49:20.276 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2021-02-13T17:49:20.277 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:20.315 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:20 +0000 (0:00:00.066) 0:01:27.152 ***** 2021-02-13T17:49:20.322 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2021-02-13T17:49:20.322 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2021-02-13T17:49:20.362 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:20 +0000 (0:00:00.047) 0:01:27.199 ***** 2021-02-13T17:49:20.390 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2021-02-13T17:49:20.391 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:20.427 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:20 +0000 (0:00:00.064) 0:01:27.264 ***** 2021-02-13T17:49:20.434 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2021-02-13T17:49:20.435 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} 2021-02-13T17:49:20.472 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:20 +0000 (0:00:00.044) 0:01:27.308 ***** 2021-02-13T17:49:20.522 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} 2021-02-13T17:49:20.558 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:20 +0000 (0:00:00.086) 0:01:27.395 ***** 2021-02-13T17:49:20.690 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2021-02-13T17:49:20.691 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} 2021-02-13T17:49:20.730 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:20 +0000 (0:00:00.171) 0:01:27.567 ***** 2021-02-13T17:49:20.779 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} 2021-02-13T17:49:20.818 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:20 +0000 (0:00:00.086) 0:01:27.654 ***** 2021-02-13T17:49:20.834 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2021-02-13T17:49:20.834 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1234, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2021-02-13T17:49:20.873 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:20 +0000 (0:00:00.055) 0:01:27.709 ***** 2021-02-13T17:49:20.922 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1234, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2021-02-13T17:49:20.960 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:20 +0000 (0:00:00.086) 0:01:27.796 ***** 2021-02-13T17:49:20.977 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2021-02-13T17:49:20.978 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-02-13T17:49:21.017 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:21 +0000 (0:00:00.057) 0:01:27.854 ***** 2021-02-13T17:49:21.056 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-02-13T17:49:21.094 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:21 +0000 (0:00:00.076) 0:01:27.931 ***** 2021-02-13T17:49:21.208 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2021-02-13T17:49:21.211 INFO:teuthology.task.ansible.out:changed: [gibba025.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Sat 2021-02-13 17:47:38 UTC", "ActiveEnterTimestampMonotonic": "18431724", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "system.slice systemd-tmpfiles-setup.service basic.target -.mount nss-lookup.target remote-fs.target sysinit.target systemd-journald.socket network.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Sat 2021-02-13 17:47:38 UTC", "AssertTimestampMonotonic": "18190055", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Sat 2021-02-13 17:47:38 UTC", "ConditionTimestampMonotonic": "18190055", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", "D 2021-02-13T17:49:21.212 INFO:teuthology.task.ansible.out:ropInPaths": "/lib/systemd/system/apache2.service.d/apache2-systemd.conf", "DynamicUser": "no", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1517", "ExecMainStartTimestamp": "Sat 2021-02-13 17:47:38 UTC", "ExecMainStartTimestampMonotonic": "18431716", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Sat 2021-02-13 17:47:38 UTC", "InactiveExitTimestampMonotonic": "18190590", "InvocationID": "eb80e000344d43ef9f7b2d2c5d84a91f", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft 2021-02-13T17:49:21.213 INFO:teuthology.task.ansible.out:": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128079", "LimitNPROCSoft": "128079", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128079", "LimitSIGPENDINGSoft": "128079", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1517", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount sysinit.target system.slice", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGH 2021-02-13T17:49:21.215 INFO:teuthology.task.ansible.out:UP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Sat 2021-02-13 17:47:38 UTC", "StateChangeTimestampMonotonic": "18431724", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Sat 2021-02-13 17:47:38 UTC", "WatchdogTimestampMonotonic": "18431723", "WatchdogUSec": "0"}} 2021-02-13T17:49:21.248 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:21 +0000 (0:00:00.153) 0:01:28.085 ***** 2021-02-13T17:49:21.278 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-02-13T17:49:21.280 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:21.320 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:21 +0000 (0:00:00.071) 0:01:28.157 ***** 2021-02-13T17:49:21.328 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2021-02-13T17:49:21.329 INFO:teuthology.task.ansible.out:changed: [gibba036.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Sat 2021-02-13 17:47:44 UTC", "ActiveEnterTimestampMonotonic": "18330098", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "remote-fs.target basic.target -.mount nss-lookup.target systemd-tmpfiles-setup.service sysinit.target system.slice network.target systemd-journald.socket", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Sat 2021-02-13 17:47:44 UTC", "AssertTimestampMonotonic": "17996211", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Sat 2021-02-13 17:47:44 UTC", "ConditionTimestampMonotonic": "17996211", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", "D 2021-02-13T17:49:21.331 INFO:teuthology.task.ansible.out:ropInPaths": "/lib/systemd/system/apache2.service.d/apache2-systemd.conf", "DynamicUser": "no", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1457", "ExecMainStartTimestamp": "Sat 2021-02-13 17:47:44 UTC", "ExecMainStartTimestampMonotonic": "18330090", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Sat 2021-02-13 17:47:44 UTC", "InactiveExitTimestampMonotonic": "17997146", "InvocationID": "473a183b37e74a03968f0d0e5f449b0c", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft 2021-02-13T17:49:21.332 INFO:teuthology.task.ansible.out:": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128079", "LimitNPROCSoft": "128079", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128079", "LimitSIGPENDINGSoft": "128079", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1457", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice -.mount", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGH 2021-02-13T17:49:21.333 INFO:teuthology.task.ansible.out:UP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Sat 2021-02-13 17:47:44 UTC", "StateChangeTimestampMonotonic": "18330098", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Sat 2021-02-13 17:47:44 UTC", "WatchdogTimestampMonotonic": "18330096", "WatchdogUSec": "0"}} 2021-02-13T17:49:21.369 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:21 +0000 (0:00:00.049) 0:01:28.206 ***** 2021-02-13T17:49:21.375 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-02-13T17:49:21.377 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:21.413 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:21 +0000 (0:00:00.043) 0:01:28.250 ***** 2021-02-13T17:49:21.421 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-02-13T17:49:21.423 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:21.459 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:21 +0000 (0:00:00.045) 0:01:28.295 ***** 2021-02-13T17:49:21.465 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-02-13T17:49:21.466 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:21.503 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:21 +0000 (0:00:00.044) 0:01:28.340 ***** 2021-02-13T17:49:21.510 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-02-13T17:49:21.511 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:21.548 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:21 +0000 (0:00:00.044) 0:01:28.385 ***** 2021-02-13T17:49:21.554 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-02-13T17:49:21.556 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:21.592 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:21 +0000 (0:00:00.043) 0:01:28.428 ***** 2021-02-13T17:49:21.599 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-02-13T17:49:21.600 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:21.636 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:21 +0000 (0:00:00.044) 0:01:28.473 ***** 2021-02-13T17:49:21.643 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:21.681 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:21 +0000 (0:00:00.044) 0:01:28.517 ***** 2021-02-13T17:49:21.688 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-02-13T17:49:21.689 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:21.727 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:21 +0000 (0:00:00.046) 0:01:28.564 ***** 2021-02-13T17:49:21.735 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-02-13T17:49:21.737 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:21.777 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:21 +0000 (0:00:00.049) 0:01:28.614 ***** 2021-02-13T17:49:21.784 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-02-13T17:49:21.785 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:21.824 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:21 +0000 (0:00:00.047) 0:01:28.661 ***** 2021-02-13T17:49:21.832 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-02-13T17:49:21.833 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:21.870 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:21 +0000 (0:00:00.046) 0:01:28.707 ***** 2021-02-13T17:49:21.877 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-02-13T17:49:21.878 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:21.916 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:21 +0000 (0:00:00.045) 0:01:28.753 ***** 2021-02-13T17:49:21.922 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-02-13T17:49:21.923 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:21.966 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:21 +0000 (0:00:00.050) 0:01:28.803 ***** 2021-02-13T17:49:21.975 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-02-13T17:49:21.976 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:22.012 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:22 +0000 (0:00:00.045) 0:01:28.849 ***** 2021-02-13T17:49:22.019 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-02-13T17:49:22.020 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:22.057 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:22 +0000 (0:00:00.044) 0:01:28.894 ***** 2021-02-13T17:49:22.065 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-02-13T17:49:22.066 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:22.103 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:22 +0000 (0:00:00.045) 0:01:28.940 ***** 2021-02-13T17:49:22.109 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-02-13T17:49:22.109 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:22.149 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:22 +0000 (0:00:00.046) 0:01:28.986 ***** 2021-02-13T17:49:22.156 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-02-13T17:49:22.157 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:22.196 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:22 +0000 (0:00:00.046) 0:01:29.033 ***** 2021-02-13T17:49:22.203 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-02-13T17:49:22.203 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:22.241 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:22 +0000 (0:00:00.045) 0:01:29.078 ***** 2021-02-13T17:49:22.249 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-02-13T17:49:22.250 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:22.289 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:22 +0000 (0:00:00.047) 0:01:29.126 ***** 2021-02-13T17:49:22.296 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-02-13T17:49:22.297 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:22.335 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:22 +0000 (0:00:00.045) 0:01:29.172 ***** 2021-02-13T17:49:22.343 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-02-13T17:49:22.344 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:22.380 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:22 +0000 (0:00:00.045) 0:01:29.217 ***** 2021-02-13T17:49:22.387 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-02-13T17:49:22.389 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:22.425 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:22 +0000 (0:00:00.044) 0:01:29.261 ***** 2021-02-13T17:49:22.431 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-02-13T17:49:22.432 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:22.474 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:22 +0000 (0:00:00.049) 0:01:29.311 ***** 2021-02-13T17:49:22.483 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-02-13T17:49:22.484 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:22.527 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:22 +0000 (0:00:00.052) 0:01:29.364 ***** 2021-02-13T17:49:22.533 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-02-13T17:49:22.534 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:22.570 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:22 +0000 (0:00:00.042) 0:01:29.407 ***** 2021-02-13T17:49:22.576 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-02-13T17:49:22.577 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:22.615 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:22 +0000 (0:00:00.045) 0:01:29.452 ***** 2021-02-13T17:49:22.623 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-02-13T17:49:22.623 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:22.659 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:22 +0000 (0:00:00.043) 0:01:29.496 ***** 2021-02-13T17:49:22.666 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-02-13T17:49:22.667 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:22.702 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:22 +0000 (0:00:00.043) 0:01:29.539 ***** 2021-02-13T17:49:22.709 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-02-13T17:49:22.710 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:22.745 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:22 +0000 (0:00:00.042) 0:01:29.582 ***** 2021-02-13T17:49:22.752 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-02-13T17:49:22.753 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:22.790 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:22 +0000 (0:00:00.044) 0:01:29.626 ***** 2021-02-13T17:49:22.796 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-02-13T17:49:22.797 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:22.833 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:22 +0000 (0:00:00.043) 0:01:29.670 ***** 2021-02-13T17:49:22.839 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-02-13T17:49:22.841 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:22.876 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:22 +0000 (0:00:00.042) 0:01:29.713 ***** 2021-02-13T17:49:22.882 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-02-13T17:49:22.884 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:22.919 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:22 +0000 (0:00:00.042) 0:01:29.756 ***** 2021-02-13T17:49:22.925 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-02-13T17:49:22.925 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:22.961 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:22 +0000 (0:00:00.042) 0:01:29.798 ***** 2021-02-13T17:49:22.968 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-02-13T17:49:22.970 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:23.005 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:22 +0000 (0:00:00.043) 0:01:29.841 ***** 2021-02-13T17:49:23.011 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-02-13T17:49:23.012 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:23.048 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:23 +0000 (0:00:00.043) 0:01:29.885 ***** 2021-02-13T17:49:23.055 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-02-13T17:49:23.056 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:23.092 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:23 +0000 (0:00:00.043) 0:01:29.928 ***** 2021-02-13T17:49:23.098 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-02-13T17:49:23.099 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:23.135 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:23 +0000 (0:00:00.043) 0:01:29.972 ***** 2021-02-13T17:49:23.142 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-02-13T17:49:23.143 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:23.178 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:23 +0000 (0:00:00.042) 0:01:30.015 ***** 2021-02-13T17:49:23.185 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-02-13T17:49:23.185 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:23.225 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:23 +0000 (0:00:00.047) 0:01:30.062 ***** 2021-02-13T17:49:23.233 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-02-13T17:49:23.234 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:23.271 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:23 +0000 (0:00:00.045) 0:01:30.108 ***** 2021-02-13T17:49:23.278 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-02-13T17:49:23.280 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:23.315 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:23 +0000 (0:00:00.043) 0:01:30.152 ***** 2021-02-13T17:49:23.321 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-02-13T17:49:23.323 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:23.364 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:23 +0000 (0:00:00.048) 0:01:30.200 ***** 2021-02-13T17:49:23.371 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-02-13T17:49:23.373 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:23.410 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:23 +0000 (0:00:00.046) 0:01:30.247 ***** 2021-02-13T17:49:23.416 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-02-13T17:49:23.418 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:23.453 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:23 +0000 (0:00:00.043) 0:01:30.290 ***** 2021-02-13T17:49:23.459 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-02-13T17:49:23.460 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:23.495 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:23 +0000 (0:00:00.042) 0:01:30.332 ***** 2021-02-13T17:49:23.502 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-02-13T17:49:23.503 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:23.539 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:23 +0000 (0:00:00.043) 0:01:30.376 ***** 2021-02-13T17:49:23.546 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2021-02-13T17:49:23.546 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:23.584 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:23 +0000 (0:00:00.045) 0:01:30.421 ***** 2021-02-13T17:49:23.591 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-02-13T17:49:23.593 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:23.629 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:23 +0000 (0:00:00.045) 0:01:30.466 ***** 2021-02-13T17:49:23.656 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2021-02-13T17:49:23.658 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:23.707 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:23 +0000 (0:00:00.077) 0:01:30.544 ***** 2021-02-13T17:49:23.713 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2021-02-13T17:49:23.713 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} 2021-02-13T17:49:23.752 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:23 +0000 (0:00:00.044) 0:01:30.588 ***** 2021-02-13T17:49:23.811 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} 2021-02-13T17:49:23.854 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:23 +0000 (0:00:00.102) 0:01:30.691 ***** 2021-02-13T17:49:23.971 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-02-13T17:49:23.973 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} 2021-02-13T17:49:24.008 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:24 +0000 (0:00:00.154) 0:01:30.845 ***** 2021-02-13T17:49:24.046 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-02-13T17:49:24.047 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:24.088 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:24 +0000 (0:00:00.079) 0:01:30.925 ***** 2021-02-13T17:49:24.095 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-02-13T17:49:24.095 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} 2021-02-13T17:49:24.134 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:24 +0000 (0:00:00.045) 0:01:30.971 ***** 2021-02-13T17:49:24.160 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-02-13T17:49:24.162 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:24.197 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:24 +0000 (0:00:00.062) 0:01:31.034 ***** 2021-02-13T17:49:24.310 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2021-02-13T17:49:24.312 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} 2021-02-13T17:49:24.347 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:24 +0000 (0:00:00.150) 0:01:31.184 ***** 2021-02-13T17:49:24.416 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} 2021-02-13T17:49:24.453 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:24 +0000 (0:00:00.105) 0:01:31.290 ***** 2021-02-13T17:49:24.564 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2021-02-13T17:49:24.565 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} 2021-02-13T17:49:24.604 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:24 +0000 (0:00:00.151) 0:01:31.441 ***** 2021-02-13T17:49:24.684 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} 2021-02-13T17:49:24.723 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:24 +0000 (0:00:00.118) 0:01:31.560 ***** 2021-02-13T17:49:24.805 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2021-02-13T17:49:24.806 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} 2021-02-13T17:49:24.852 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:24 +0000 (0:00:00.129) 0:01:31.689 ***** 2021-02-13T17:49:24.934 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} 2021-02-13T17:49:24.969 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:24 +0000 (0:00:00.117) 0:01:31.806 ***** 2021-02-13T17:49:24.975 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2021-02-13T17:49:24.977 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-02-13T17:49:25.013 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:25 +0000 (0:00:00.043) 0:01:31.850 ***** 2021-02-13T17:49:25.040 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2021-02-13T17:49:25.041 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:25.076 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:25 +0000 (0:00:00.062) 0:01:31.912 ***** 2021-02-13T17:49:25.082 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2021-02-13T17:49:25.083 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-02-13T17:49:25.126 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:25 +0000 (0:00:00.050) 0:01:31.963 ***** 2021-02-13T17:49:25.135 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2021-02-13T17:49:25.136 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:25.175 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:25 +0000 (0:00:00.048) 0:01:32.012 ***** 2021-02-13T17:49:25.183 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2021-02-13T17:49:25.184 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:25.225 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:25 +0000 (0:00:00.049) 0:01:32.061 ***** 2021-02-13T17:49:25.232 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2021-02-13T17:49:25.234 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:25.270 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:25 +0000 (0:00:00.045) 0:01:32.107 ***** 2021-02-13T17:49:25.278 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2021-02-13T17:49:25.278 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:25.320 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:25 +0000 (0:00:00.050) 0:01:32.157 ***** 2021-02-13T17:49:25.327 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2021-02-13T17:49:25.328 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:25.370 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:25 +0000 (0:00:00.049) 0:01:32.207 ***** 2021-02-13T17:49:25.380 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2021-02-13T17:49:25.380 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:25.420 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:25 +0000 (0:00:00.050) 0:01:32.257 ***** 2021-02-13T17:49:25.426 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2021-02-13T17:49:25.427 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:25.463 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:25 +0000 (0:00:00.042) 0:01:32.300 ***** 2021-02-13T17:49:25.470 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2021-02-13T17:49:25.472 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:25.507 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:25 +0000 (0:00:00.044) 0:01:32.344 ***** 2021-02-13T17:49:25.513 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-02-13T17:49:25.514 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2021-02-13T17:49:25.551 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:25 +0000 (0:00:00.043) 0:01:32.388 ***** 2021-02-13T17:49:25.558 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2021-02-13T17:49:25.560 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:25.598 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:25 +0000 (0:00:00.046) 0:01:32.434 ***** 2021-02-13T17:49:25.605 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2021-02-13T17:49:25.605 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} 2021-02-13T17:49:25.607 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2021-02-13T17:49:25.607 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} 2021-02-13T17:49:25.619 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} 2021-02-13T17:49:25.630 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2021-02-13T17:49:25.630 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-02-13T17:49:25.631 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2021-02-13T17:49:25.675 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:25 +0000 (0:00:00.076) 0:01:32.511 ***** 2021-02-13T17:49:25.687 INFO:teuthology.task.ansible.out: 2021-02-13T17:49:25.689 INFO:teuthology.task.ansible.out:TASK [testnode : Check for NVMe drive] ***************************************** skipping: [gibba025.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2021-02-13T17:49:25.691 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2021-02-13T17:49:25.692 INFO:teuthology.task.ansible.out: skipping: [gibba025.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} 2021-02-13T17:49:25.694 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} 2021-02-13T17:49:25.695 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2021-02-13T17:49:25.696 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} skipping: [gibba025.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} skipping: [gibba025.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2021-02-13T17:49:25.698 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} 2021-02-13T17:49:25.709 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2021-02-13T17:49:25.753 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:25 +0000 (0:00:00.078) 0:01:32.590 ***** 2021-02-13T17:49:25.761 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} 2021-02-13T17:49:25.761 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2021-02-13T17:49:25.762 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} skipping: [gibba036.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} 2021-02-13T17:49:25.763 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2021-02-13T17:49:25.764 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2021-02-13T17:49:25.775 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2021-02-13T17:49:25.776 INFO:teuthology.task.ansible.out: 2021-02-13T17:49:25.786 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} 2021-02-13T17:49:25.788 INFO:teuthology.task.ansible.out: skipping: [gibba036.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} 2021-02-13T17:49:25.798 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2021-02-13T17:49:25.809 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} 2021-02-13T17:49:25.809 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} 2021-02-13T17:49:25.820 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2021-02-13T17:49:25.831 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} 2021-02-13T17:49:25.832 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2021-02-13T17:49:25.879 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:25 +0000 (0:00:00.126) 0:01:32.716 ***** 2021-02-13T17:49:25.959 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2021-02-13T17:49:25.961 INFO:teuthology.task.ansible.out:changed: [gibba025.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.004525", "end": "2021-02-13 17:49:25.930479", "rc": 0, "start": "2021-02-13 17:49:25.925954", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_87d40f79d7da6caf6da06c190938773bf745140c/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_87d40f79d7da6caf6da06c190938773bf745140c/virtualenv/bin/teuthology-lock"]} 2021-02-13T17:49:26.001 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:25 +0000 (0:00:00.121) 0:01:32.838 ***** 2021-02-13T17:49:26.039 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2021-02-13T17:49:26.040 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:26.079 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:26 +0000 (0:00:00.077) 0:01:32.915 ***** 2021-02-13T17:49:26.084 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2021-02-13T17:49:26.085 INFO:teuthology.task.ansible.out:changed: [gibba036.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003539", "end": "2021-02-13 17:49:26.057903", "rc": 0, "start": "2021-02-13 17:49:26.054364", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_87d40f79d7da6caf6da06c190938773bf745140c/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_87d40f79d7da6caf6da06c190938773bf745140c/virtualenv/bin/teuthology-lock"]} 2021-02-13T17:49:26.127 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:26 +0000 (0:00:00.047) 0:01:32.963 ***** 2021-02-13T17:49:26.132 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2021-02-13T17:49:26.134 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:26.170 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:26 +0000 (0:00:00.043) 0:01:33.007 ***** 2021-02-13T17:49:26.177 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2021-02-13T17:49:26.178 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:26.217 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:26 +0000 (0:00:00.047) 0:01:33.054 ***** 2021-02-13T17:49:26.223 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2021-02-13T17:49:26.224 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:26.261 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:26 +0000 (0:00:00.043) 0:01:33.098 ***** 2021-02-13T17:49:26.267 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2021-02-13T17:49:26.269 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:26.320 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:26 +0000 (0:00:00.058) 0:01:33.157 ***** 2021-02-13T17:49:26.358 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2021-02-13T17:49:26.359 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:26.394 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:26 +0000 (0:00:00.073) 0:01:33.231 ***** 2021-02-13T17:49:26.906 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2021-02-13T17:49:26.908 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => {"cache_update_time": 1613238280, "cache_updated": false, "changed": false} 2021-02-13T17:49:26.949 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:26 +0000 (0:00:00.555) 0:01:33.786 ***** 2021-02-13T17:49:26.979 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => {"cache_update_time": 1613238310, "cache_updated": false, "changed": false} 2021-02-13T17:49:27.019 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:27 +0000 (0:00:00.069) 0:01:33.856 ***** 2021-02-13T17:49:27.025 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2021-02-13T17:49:27.027 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:27.072 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:27 +0000 (0:00:00.053) 0:01:33.909 ***** 2021-02-13T17:49:27.079 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:27.122 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:27 +0000 (0:00:00.049) 0:01:33.959 ***** 2021-02-13T17:49:27.128 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-02-13T17:49:27.129 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item={'block_used': 13757936, 'uuid': '544fff2a-e246-4637-96d0-94b4cd4bcfea', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226337172, 'size_available': 927077056512, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 149516, 'block_size': 4096, 'inode_available': 60905460}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226337172, "block_size": 4096, "block_total": 240095108, "block_used": 13757936, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60905460, "inode_total": 61054976, "inode_used": 149516, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927077056512, "size_total": 983429562368, "uuid": "544fff2a-e246-4637-96d0-94b4cd4bcfea"}} 2021-02-13T17:49:27.170 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:27 +0000 (0:00:00.047) 0:01:34.007 ***** 2021-02-13T17:49:27.178 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item={'block_used': 13757936, 'uuid': '544fff2a-e246-4637-96d0-94b4cd4bcfea', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226337172, 'size_available': 927077056512, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 149516, 'block_size': 4096, 'inode_available': 60905460}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226337172, "block_size": 4096, "block_total": 240095108, "block_used": 13757936, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60905460, "inode_total": 61054976, "inode_used": 149516, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927077056512, "size_total": 983429562368, "uuid": "544fff2a-e246-4637-96d0-94b4cd4bcfea"}} 2021-02-13T17:49:27.215 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:27 +0000 (0:00:00.045) 0:01:34.052 ***** 2021-02-13T17:49:27.265 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2021-02-13T17:49:27.265 INFO:teuthology.task.ansible.out:changed: [gibba025.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.002441", "end": "2021-02-13 17:49:27.288895", "rc": 0, "start": "2021-02-13 17:49:27.286454", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-13T17:49:27.308 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:27 +0000 (0:00:00.092) 0:01:34.145 ***** 2021-02-13T17:49:27.327 INFO:teuthology.task.ansible.out:changed: [gibba036.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.002470", "end": "2021-02-13 17:49:27.489010", "rc": 0, "start": "2021-02-13 17:49:27.486540", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-13T17:49:27.370 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:27 +0000 (0:00:00.062) 0:01:34.207 ***** 2021-02-13T17:49:27.376 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2021-02-13T17:49:27.377 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'block_used': 13757936, 'uuid': '544fff2a-e246-4637-96d0-94b4cd4bcfea', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226337172, 'size_available': 927077056512, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 149516, 'block_size': 4096, 'inode_available': 60905460}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226337172, "block_size": 4096, "block_total": 240095108, "block_used": 13757936, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60905460, "inode_total": 61054976, "inode_used": 149516, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927077056512, "size_total": 983429562368, "uuid": "544fff2a-e246-4637-96d0-94b4cd4bcfea"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:27.416 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:27 +0000 (0:00:00.045) 0:01:34.253 ***** 2021-02-13T17:49:27.424 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'block_used': 13757936, 'uuid': '544fff2a-e246-4637-96d0-94b4cd4bcfea', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226337172, 'size_available': 927077056512, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 149516, 'block_size': 4096, 'inode_available': 60905460}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226337172, "block_size": 4096, "block_total": 240095108, "block_used": 13757936, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60905460, "inode_total": 61054976, "inode_used": 149516, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927077056512, "size_total": 983429562368, "uuid": "544fff2a-e246-4637-96d0-94b4cd4bcfea"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:27.463 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:27 +0000 (0:00:00.046) 0:01:34.299 ***** 2021-02-13T17:49:27.468 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2021-02-13T17:49:27.505 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:27 +0000 (0:00:00.042) 0:01:34.342 ***** 2021-02-13T17:49:27.553 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:27 +0000 (0:00:00.048) 0:01:34.390 ***** 2021-02-13T17:49:27.560 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-02-13T17:49:27.561 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:27.615 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:29.516 INFO:teuthology.task.ansible.out:changed: [gibba036.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-WhJaGBLZ1zXxaNIy0sJgUXjA0PJobOOZo5kJU3CXcZDI7ccUVcWWTR1hvbKCkfr5'], 'uuids': ['bfb5b932-44a1-4bbf-b5a3-f244cee96e19']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.816656", "end": "2021-02-13 17:49:29.682586", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-WhJaGBLZ1zXxaNIy0sJgUXjA0PJobOOZo5kJU3CXcZDI7ccUVcWWTR1hvbKCkfr5"], "labels": [], "masters": [], "uuids": ["bfb5b932-44a1-4bbf-b5a3-f244cee96e19"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-13 17:49:27.865930", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-02-13T17:49:29.527 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:29.538 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:29.560 INFO:teuthology.task.ansible.out:changed: [gibba025.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-h1bbn95VM07YOU0hjIe1DHvRA1gW6E6ZkzVYTyocXHyHBiDgSdco3NmfjB6NGqj2'], 'uuids': ['05632d46-d6c8-431d-be47-a7bfc1999b40']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.916479", "end": "2021-02-13 17:49:29.579254", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-h1bbn95VM07YOU0hjIe1DHvRA1gW6E6ZkzVYTyocXHyHBiDgSdco3NmfjB6NGqj2"], "labels": [], "masters": [], "uuids": ["05632d46-d6c8-431d-be47-a7bfc1999b40"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-13 17:49:27.662775", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-02-13T17:49:29.572 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:29.573 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:30.711 INFO:teuthology.task.ansible.out:changed: [gibba036.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-WhJaGBLZ1zXxaNIy0sJgUXjA0PJobOOZtDtx3PAKO1gI0wz0vHHBgNIqvS7dd6us'], 'uuids': ['c0ba124f-f8f4-453f-948d-ec33541124aa']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.086825", "end": "2021-02-13 17:49:30.871524", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-WhJaGBLZ1zXxaNIy0sJgUXjA0PJobOOZtDtx3PAKO1gI0wz0vHHBgNIqvS7dd6us"], "labels": [], "masters": [], "uuids": ["c0ba124f-f8f4-453f-948d-ec33541124aa"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-13 17:49:29.784699", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-02-13T17:49:30.712 INFO:teuthology.task.ansible.out: 2021-02-13T17:49:30.724 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'cfq', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I6K2L4F6XF', 'wwn-0x50000399ab9813f6'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '544fff2a-e246-4637-96d0-94b4cd4bcfea', 'links': {'masters': [], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I6K2L4F6XF-part1', 'wwn-0x50000399ab9813f6-part1'], 'uuids': ['544fff2a-e246-4637-96d0-94b4cd4bcfea']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x50000399ab9813f6', 'model': 'TOSHIBA MG04ACA1', 'serial': 'Y9I6K2L4F6XF', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)", "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I6K2L4F6XF", "wwn-0x50000399ab9813f6"], "labels": [], "masters": [], "uuids": []}, "model": "TOSHIBA MG04ACA1", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I6K2L4F6XF-part1", "wwn-0x50000399ab9813f6-part1"], "labels": [], "masters": [], "uuids": ["544fff2a-e246-4637-96d0-94b4cd4bcfea"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "544fff2a-e246-4637-96d0-94b4cd4bcfea"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "cfq", "sectors": "1953525168", "sectorsize": "512", "serial": "Y9I6K2L4F6XF", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x50000399ab9813f6"}}, "skip_reason": "Conditional result w 2021-02-13T17:49:30.725 INFO:teuthology.task.ansible.out:as False"} 2021-02-13T17:49:30.736 INFO:teuthology.task.ansible.out:changed: [gibba025.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-h1bbn95VM07YOU0hjIe1DHvRA1gW6E6ZibsVaXNmzF2uljVRHt0vURL4SxH2XVff'], 'uuids': ['8a9762dc-dd26-465e-bc28-2bc4fa84e382']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.074219", "end": "2021-02-13 17:49:30.756326", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-h1bbn95VM07YOU0hjIe1DHvRA1gW6E6ZibsVaXNmzF2uljVRHt0vURL4SxH2XVff"], "labels": [], "masters": [], "uuids": ["8a9762dc-dd26-465e-bc28-2bc4fa84e382"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-13 17:49:29.682107", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-02-13T17:49:30.748 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'cfq', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I8K38IF6XF', 'wwn-0x50000399aba81668'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '544fff2a-e246-4637-96d0-94b4cd4bcfea', 'links': {'masters': [], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I8K38IF6XF-part1', 'wwn-0x50000399aba81668-part1'], 'uuids': ['544fff2a-e246-4637-96d0-94b4cd4bcfea']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x50000399aba81668', 'model': 'TOSHIBA MG04ACA1', 'serial': 'Y9I8K38IF6XF', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)", "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I8K38IF6XF", "wwn-0x50000399aba81668"], "labels": [], "masters": [], "uuids": []}, "model": "TOSHIBA MG04ACA1", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I8K38IF6XF-part1", "wwn-0x50000399aba81668-part1"], "labels": [], "masters": [], "uuids": ["544fff2a-e246-4637-96d0-94b4cd4bcfea"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "544fff2a-e246-4637-96d0-94b4cd4bcfea"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "cfq", "sectors": "1953525168", "sectorsize": "512", "serial": "Y9I8K38IF6XF", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x50000399aba81668"}}, "skip_reason": "Conditional result w 2021-02-13T17:49:30.749 INFO:teuthology.task.ansible.out:as False"} 2021-02-13T17:49:31.936 INFO:teuthology.task.ansible.out:changed: [gibba025.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '732585168', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-lN3fzf-AneU-Iy2u-Y1PL-3m0O-phC6-2AfHWt', 'nvme-INTEL_SSDPEL1K375GA_PHKM92000092375A', 'nvme-nvme.8086-50484b4d393230303030393233373541-494e54454c2053534450454c314b3337354741-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation Optane DC P4800X Series SSD', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEL1K375GA', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '349.32 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.111346", "end": "2021-02-13 17:49:31.959873", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation Optane DC P4800X Series SSD", "links": {"ids": ["lvm-pv-uuid-lN3fzf-AneU-Iy2u-Y1PL-3m0O-phC6-2AfHWt", "nvme-INTEL_SSDPEL1K375GA_PHKM92000092375A", "nvme-nvme.8086-50484b4d393230303030393233373541-494e54454c2053534450454c314b3337354741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEL1K375GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "732585168", "sectorsize": "512", "size": "349.32 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-13 17:49:30.848527", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! You may now parti 2021-02-13T17:49:31.937 INFO:teuthology.task.ansible.out:tion the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-02-13T17:49:31.948 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:31.949 INFO:teuthology.task.ansible.out:changed: [gibba036.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '732585168', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-y0sqkb-sjcq-9lkE-rert-R9zY-ZdMN-iVv9Fi', 'nvme-INTEL_SSDPEL1K375GA_PHKM9200000S375A', 'nvme-nvme.8086-50484b4d393230303030305333373541-494e54454c2053534450454c314b3337354741-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation Optane DC P4800X Series SSD', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEL1K375GA', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '349.32 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.138636", "end": "2021-02-13 17:49:32.103677", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation Optane DC P4800X Series SSD", "links": {"ids": ["lvm-pv-uuid-y0sqkb-sjcq-9lkE-rert-R9zY-ZdMN-iVv9Fi", "nvme-INTEL_SSDPEL1K375GA_PHKM9200000S375A", "nvme-nvme.8086-50484b4d393230303030305333373541-494e54454c2053534450454c314b3337354741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEL1K375GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "732585168", "sectorsize": "512", "size": "349.32 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-13 17:49:30.965041", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! You may now parti 2021-02-13T17:49:31.950 INFO:teuthology.task.ansible.out:tion the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-02-13T17:49:31.950 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:31.951 INFO:teuthology.task.ansible.out: 2021-02-13T17:49:31.963 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:31.965 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:31.966 INFO:teuthology.task.ansible.out: 2021-02-13T17:49:33.134 INFO:teuthology.task.ansible.out:changed: [gibba036.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '27262976', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-WhJaGBLZ1zXxaNIy0sJgUXjA0PJobOOZngumh2TDdKcpnCjhAQTQEP82UJ8tcHVH'], 'uuids': ['08b86d92-b06e-4a37-9385-e8434ebc98da']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '13.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.082803", "end": "2021-02-13 17:49:33.296102", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-WhJaGBLZ1zXxaNIy0sJgUXjA0PJobOOZngumh2TDdKcpnCjhAQTQEP82UJ8tcHVH"], "labels": [], "masters": [], "uuids": ["08b86d92-b06e-4a37-9385-e8434ebc98da"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "27262976", "sectorsize": "512", "size": "13.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-13 17:49:32.213299", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-02-13T17:49:33.147 INFO:teuthology.task.ansible.out:changed: [gibba025.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '27262976', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-h1bbn95VM07YOU0hjIe1DHvRA1gW6E6Z3gZglDZw2wfXRskr3VPR6KO4fPaysRmk'], 'uuids': ['c778c682-01e0-4abb-9f4d-8530aa7df722']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '13.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.079352", "end": "2021-02-13 17:49:33.166053", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-h1bbn95VM07YOU0hjIe1DHvRA1gW6E6Z3gZglDZw2wfXRskr3VPR6KO4fPaysRmk"], "labels": [], "masters": [], "uuids": ["c778c682-01e0-4abb-9f4d-8530aa7df722"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "27262976", "sectorsize": "512", "size": "13.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-13 17:49:32.086701", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-02-13T17:49:33.149 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:33.150 INFO:teuthology.task.ansible.out: 2021-02-13T17:49:33.164 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:33.167 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:33.168 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:34.329 INFO:teuthology.task.ansible.out:changed: [gibba025.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-h1bbn95VM07YOU0hjIe1DHvRA1gW6E6Z4Q5UCJojyVhZubNOKGUqqDcpPDzacfty'], 'uuids': ['c98bedb4-06c1-4702-bd3e-43edceddda0c']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.072746", "end": "2021-02-13 17:49:34.347285", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-h1bbn95VM07YOU0hjIe1DHvRA1gW6E6Z4Q5UCJojyVhZubNOKGUqqDcpPDzacfty"], "labels": [], "masters": [], "uuids": ["c98bedb4-06c1-4702-bd3e-43edceddda0c"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-13 17:49:33.274539", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-02-13T17:49:34.341 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:34.342 INFO:teuthology.task.ansible.out:changed: [gibba036.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-WhJaGBLZ1zXxaNIy0sJgUXjA0PJobOOZLoPelygUTM7nSMLCcEpanIStVv9x1Ndd'], 'uuids': ['e9ff3ab6-a686-4a04-8bdb-30d6b602483d']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.088064", "end": "2021-02-13 17:49:34.503923", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-WhJaGBLZ1zXxaNIy0sJgUXjA0PJobOOZLoPelygUTM7nSMLCcEpanIStVv9x1Ndd"], "labels": [], "masters": [], "uuids": ["e9ff3ab6-a686-4a04-8bdb-30d6b602483d"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-13 17:49:33.415859", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-02-13T17:49:34.354 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:35.508 INFO:teuthology.task.ansible.out:changed: [gibba025.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-h1bbn95VM07YOU0hjIe1DHvRA1gW6E6ZHx8pNFKOJ7TlCsSPHE7W0Dpf0RJGHANM'], 'uuids': ['15ffcaec-8b49-47ab-8a61-819747b5748b']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.083506", "end": "2021-02-13 17:49:35.522085", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-h1bbn95VM07YOU0hjIe1DHvRA1gW6E6ZHx8pNFKOJ7TlCsSPHE7W0Dpf0RJGHANM"], "labels": [], "masters": [], "uuids": ["15ffcaec-8b49-47ab-8a61-819747b5748b"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-13 17:49:34.438579", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-02-13T17:49:35.523 INFO:teuthology.task.ansible.out:changed: [gibba036.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-WhJaGBLZ1zXxaNIy0sJgUXjA0PJobOOZhMWH1Lqy2UTBPvKb4KEeAUUnw1nYaviu'], 'uuids': ['3db51433-27ee-4f6d-b34d-e82c455325c2']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.081149", "end": "2021-02-13 17:49:35.672190", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-WhJaGBLZ1zXxaNIy0sJgUXjA0PJobOOZhMWH1Lqy2UTBPvKb4KEeAUUnw1nYaviu"], "labels": [], "masters": [], "uuids": ["3db51433-27ee-4f6d-b34d-e82c455325c2"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-13 17:49:34.591041", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-02-13T17:49:35.571 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:35 +0000 (0:00:08.018) 0:01:42.408 ***** 2021-02-13T17:49:35.612 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:35 +0000 (0:00:00.040) 0:01:42.448 ***** 2021-02-13T17:49:35.622 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-02-13T17:49:35.623 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:35.657 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:35.773 INFO:teuthology.task.ansible.out:changed: [gibba025.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-h1bbn95VM07YOU0hjIe1DHvRA1gW6E6ZkzVYTyocXHyHBiDgSdco3NmfjB6NGqj2'], 'uuids': ['05632d46-d6c8-431d-be47-a7bfc1999b40']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.076243", "end": "2021-02-13 17:49:35.791067", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-h1bbn95VM07YOU0hjIe1DHvRA1gW6E6ZkzVYTyocXHyHBiDgSdco3NmfjB6NGqj2"], "labels": [], "masters": [], "uuids": ["05632d46-d6c8-431d-be47-a7bfc1999b40"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-13 17:49:35.714824", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0750569 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0750569 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-02-13T17:49:35.775 INFO:teuthology.task.ansible.out: 2021-02-13T17:49:35.786 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:35.797 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:35.819 INFO:teuthology.task.ansible.out:changed: [gibba036.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-WhJaGBLZ1zXxaNIy0sJgUXjA0PJobOOZo5kJU3CXcZDI7ccUVcWWTR1hvbKCkfr5'], 'uuids': ['bfb5b932-44a1-4bbf-b5a3-f244cee96e19']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.076737", "end": "2021-02-13 17:49:35.983446", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-WhJaGBLZ1zXxaNIy0sJgUXjA0PJobOOZo5kJU3CXcZDI7ccUVcWWTR1hvbKCkfr5"], "labels": [], "masters": [], "uuids": ["bfb5b932-44a1-4bbf-b5a3-f244cee96e19"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-13 17:49:35.906709", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0755863 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0755863 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-02-13T17:49:35.831 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:35.843 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:35.959 INFO:teuthology.task.ansible.out:changed: [gibba025.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-h1bbn95VM07YOU0hjIe1DHvRA1gW6E6ZibsVaXNmzF2uljVRHt0vURL4SxH2XVff'], 'uuids': ['8a9762dc-dd26-465e-bc28-2bc4fa84e382']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.077145", "end": "2021-02-13 17:49:35.969772", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-h1bbn95VM07YOU0hjIe1DHvRA1gW6E6ZibsVaXNmzF2uljVRHt0vURL4SxH2XVff"], "labels": [], "masters": [], "uuids": ["8a9762dc-dd26-465e-bc28-2bc4fa84e382"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-13 17:49:35.892627", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0759933 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0759933 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-02-13T17:49:35.960 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'cfq', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I8K38IF6XF', 'wwn-0x50000399aba81668'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '544fff2a-e246-4637-96d0-94b4cd4bcfea', 'links': {'masters': [], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I8K38IF6XF-part1', 'wwn-0x50000399aba81668-part1'], 'uuids': ['544fff2a-e246-4637-96d0-94b4cd4bcfea']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x50000399aba81668', 'model': 'TOSHIBA MG04ACA1', 'serial': 'Y9I8K38IF6XF', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)", "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I8K38IF6XF", "wwn-0x50000399aba81668"], "labels": [], "masters": [], "uuids": []}, "model": "TOSHIBA MG04ACA1", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I8K38IF6XF-part1", "wwn-0x50000399aba81668-part1"], "labels": [], "masters": [], "uuids": ["544fff2a-e246-4637-96d0-94b4cd4bcfea"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "544fff2a-e246-4637-96d0-94b4cd4bcfea"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "cfq", "sectors": "1953525168", "sectorsize": "512", "serial": "Y9I8K38IF6XF", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x50000399aba81668"}}, "skip_reason": "Conditional result w 2021-02-13T17:49:35.961 INFO:teuthology.task.ansible.out:as False"} 2021-02-13T17:49:36.004 INFO:teuthology.task.ansible.out:changed: [gibba036.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-WhJaGBLZ1zXxaNIy0sJgUXjA0PJobOOZtDtx3PAKO1gI0wz0vHHBgNIqvS7dd6us'], 'uuids': ['c0ba124f-f8f4-453f-948d-ec33541124aa']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.076389", "end": "2021-02-13 17:49:36.166154", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-WhJaGBLZ1zXxaNIy0sJgUXjA0PJobOOZtDtx3PAKO1gI0wz0vHHBgNIqvS7dd6us"], "labels": [], "masters": [], "uuids": ["c0ba124f-f8f4-453f-948d-ec33541124aa"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-13 17:49:36.089765", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0751564 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0751564 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-02-13T17:49:36.015 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'cfq', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I6K2L4F6XF', 'wwn-0x50000399ab9813f6'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '544fff2a-e246-4637-96d0-94b4cd4bcfea', 'links': {'masters': [], 'labels': [], 'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I6K2L4F6XF-part1', 'wwn-0x50000399ab9813f6-part1'], 'uuids': ['544fff2a-e246-4637-96d0-94b4cd4bcfea']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x50000399ab9813f6', 'model': 'TOSHIBA MG04ACA1', 'serial': 'Y9I6K2L4F6XF', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)", "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I6K2L4F6XF", "wwn-0x50000399ab9813f6"], "labels": [], "masters": [], "uuids": []}, "model": "TOSHIBA MG04ACA1", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I6K2L4F6XF-part1", "wwn-0x50000399ab9813f6-part1"], "labels": [], "masters": [], "uuids": ["544fff2a-e246-4637-96d0-94b4cd4bcfea"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "544fff2a-e246-4637-96d0-94b4cd4bcfea"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "cfq", "sectors": "1953525168", "sectorsize": "512", "serial": "Y9I6K2L4F6XF", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x50000399ab9813f6"}}, "skip_reason": "Conditional result w 2021-02-13T17:49:36.017 INFO:teuthology.task.ansible.out:as False"} 2021-02-13T17:49:36.059 INFO:teuthology.task.ansible.out:changed: [gibba025.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '732585168', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-lN3fzf-AneU-Iy2u-Y1PL-3m0O-phC6-2AfHWt', 'nvme-INTEL_SSDPEL1K375GA_PHKM92000092375A', 'nvme-nvme.8086-50484b4d393230303030393233373541-494e54454c2053534450454c314b3337354741-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation Optane DC P4800X Series SSD', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEL1K375GA', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '349.32 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.027263", "end": "2021-02-13 17:49:36.083845", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation Optane DC P4800X Series SSD", "links": {"ids": ["lvm-pv-uuid-lN3fzf-AneU-Iy2u-Y1PL-3m0O-phC6-2AfHWt", "nvme-INTEL_SSDPEL1K375GA_PHKM92000092375A", "nvme-nvme.8086-50484b4d393230303030393233373541-494e54454c2053534450454c314b3337354741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEL1K375GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "732585168", "sectorsize": "512", "size": "349.32 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-13 17:49:36.056582", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0260382 s, 4.4 GB/s", "stderr_lines": ["110 2021-02-13T17:49:36.061 INFO:teuthology.task.ansible.out:+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0260382 s, 4.4 GB/s"], "stdout": "", "stdout_lines": []} 2021-02-13T17:49:36.071 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:36.083 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:36.117 INFO:teuthology.task.ansible.out:changed: [gibba036.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '732585168', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-y0sqkb-sjcq-9lkE-rert-R9zY-ZdMN-iVv9Fi', 'nvme-INTEL_SSDPEL1K375GA_PHKM9200000S375A', 'nvme-nvme.8086-50484b4d393230303030305333373541-494e54454c2053534450454c314b3337354741-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation Optane DC P4800X Series SSD', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEL1K375GA', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '349.32 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.027107", "end": "2021-02-13 17:49:36.280489", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation Optane DC P4800X Series SSD", "links": {"ids": ["lvm-pv-uuid-y0sqkb-sjcq-9lkE-rert-R9zY-ZdMN-iVv9Fi", "nvme-INTEL_SSDPEL1K375GA_PHKM9200000S375A", "nvme-nvme.8086-50484b4d393230303030305333373541-494e54454c2053534450454c314b3337354741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEL1K375GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "732585168", "sectorsize": "512", "size": "349.32 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-13 17:49:36.253382", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0258786 s, 4.5 GB/s", "stderr_lines": ["110 2021-02-13T17:49:36.119 INFO:teuthology.task.ansible.out:+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0258786 s, 4.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-02-13T17:49:36.129 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:36.140 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:36.236 INFO:teuthology.task.ansible.out:changed: [gibba025.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '27262976', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-h1bbn95VM07YOU0hjIe1DHvRA1gW6E6Z3gZglDZw2wfXRskr3VPR6KO4fPaysRmk'], 'uuids': ['c778c682-01e0-4abb-9f4d-8530aa7df722']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '13.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.077193", "end": "2021-02-13 17:49:36.258093", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-h1bbn95VM07YOU0hjIe1DHvRA1gW6E6Z3gZglDZw2wfXRskr3VPR6KO4fPaysRmk"], "labels": [], "masters": [], "uuids": ["c778c682-01e0-4abb-9f4d-8530aa7df722"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "27262976", "sectorsize": "512", "size": "13.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-13 17:49:36.180900", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0759695 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0759695 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-02-13T17:49:36.247 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:36.259 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:36.292 INFO:teuthology.task.ansible.out:changed: [gibba036.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '27262976', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-WhJaGBLZ1zXxaNIy0sJgUXjA0PJobOOZngumh2TDdKcpnCjhAQTQEP82UJ8tcHVH'], 'uuids': ['08b86d92-b06e-4a37-9385-e8434ebc98da']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '13.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.075938", "end": "2021-02-13 17:49:36.456481", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-WhJaGBLZ1zXxaNIy0sJgUXjA0PJobOOZngumh2TDdKcpnCjhAQTQEP82UJ8tcHVH"], "labels": [], "masters": [], "uuids": ["08b86d92-b06e-4a37-9385-e8434ebc98da"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "27262976", "sectorsize": "512", "size": "13.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-13 17:49:36.380543", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0747232 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0747232 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-02-13T17:49:36.305 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:36.317 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:36.416 INFO:teuthology.task.ansible.out:changed: [gibba025.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-h1bbn95VM07YOU0hjIe1DHvRA1gW6E6Z4Q5UCJojyVhZubNOKGUqqDcpPDzacfty'], 'uuids': ['c98bedb4-06c1-4702-bd3e-43edceddda0c']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.076445", "end": "2021-02-13 17:49:36.431620", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-h1bbn95VM07YOU0hjIe1DHvRA1gW6E6Z4Q5UCJojyVhZubNOKGUqqDcpPDzacfty"], "labels": [], "masters": [], "uuids": ["c98bedb4-06c1-4702-bd3e-43edceddda0c"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-13 17:49:36.355175", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.07515 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.07515 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-02-13T17:49:36.428 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:36.472 INFO:teuthology.task.ansible.out:changed: [gibba036.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-WhJaGBLZ1zXxaNIy0sJgUXjA0PJobOOZLoPelygUTM7nSMLCcEpanIStVv9x1Ndd'], 'uuids': ['e9ff3ab6-a686-4a04-8bdb-30d6b602483d']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.076994", "end": "2021-02-13 17:49:36.628654", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-WhJaGBLZ1zXxaNIy0sJgUXjA0PJobOOZLoPelygUTM7nSMLCcEpanIStVv9x1Ndd"], "labels": [], "masters": [], "uuids": ["e9ff3ab6-a686-4a04-8bdb-30d6b602483d"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-13 17:49:36.551660", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0757685 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0757685 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-02-13T17:49:36.474 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'none', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:36.582 INFO:teuthology.task.ansible.out:changed: [gibba025.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-h1bbn95VM07YOU0hjIe1DHvRA1gW6E6ZHx8pNFKOJ7TlCsSPHE7W0Dpf0RJGHANM'], 'uuids': ['15ffcaec-8b49-47ab-8a61-819747b5748b']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.076574", "end": "2021-02-13 17:49:36.602574", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-h1bbn95VM07YOU0hjIe1DHvRA1gW6E6ZHx8pNFKOJ7TlCsSPHE7W0Dpf0RJGHANM"], "labels": [], "masters": [], "uuids": ["15ffcaec-8b49-47ab-8a61-819747b5748b"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-13 17:49:36.526000", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.075475 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.075475 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-02-13T17:49:36.647 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:36 +0000 (0:00:01.035) 0:01:43.484 ***** 2021-02-13T17:49:36.655 INFO:teuthology.task.ansible.out:changed: [gibba036.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '176160768', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-WhJaGBLZ1zXxaNIy0sJgUXjA0PJobOOZhMWH1Lqy2UTBPvKb4KEeAUUnw1nYaviu'], 'uuids': ['3db51433-27ee-4f6d-b34d-e82c455325c2']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '84.00 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.076746", "end": "2021-02-13 17:49:36.792815", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-WhJaGBLZ1zXxaNIy0sJgUXjA0PJobOOZhMWH1Lqy2UTBPvKb4KEeAUUnw1nYaviu"], "labels": [], "masters": [], "uuids": ["3db51433-27ee-4f6d-b34d-e82c455325c2"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-13 17:49:36.716069", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0755858 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0755858 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-02-13T17:49:36.703 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:36 +0000 (0:00:00.055) 0:01:43.540 ***** 2021-02-13T17:49:36.876 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2021-02-13T17:49:36.878 INFO:teuthology.task.ansible.out:changed: [gibba025.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.137726", "end": "2021-02-13 17:49:36.899633", "rc": 0, "start": "2021-02-13 17:49:36.761907", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-13T17:49:36.913 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:36 +0000 (0:00:00.209) 0:01:43.750 ***** 2021-02-13T17:49:36.922 INFO:teuthology.task.ansible.out:changed: [gibba036.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.110951", "end": "2021-02-13 17:49:37.078182", "rc": 0, "start": "2021-02-13 17:49:36.967231", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-13T17:49:36.962 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:36 +0000 (0:00:00.048) 0:01:43.799 ***** 2021-02-13T17:49:37.032 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2021-02-13T17:49:37.033 INFO:teuthology.task.ansible.out:changed: [gibba025.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.034541", "end": "2021-02-13 17:49:37.056429", "rc": 0, "start": "2021-02-13 17:49:37.021888", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-13T17:49:37.070 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:37 +0000 (0:00:00.107) 0:01:43.906 ***** 2021-02-13T17:49:37.097 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2021-02-13T17:49:37.098 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2021-02-13T17:49:37.098 INFO:teuthology.task.ansible.out:changed: [gibba036.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.046951", "end": "2021-02-13 17:49:37.264636", "rc": 0, "start": "2021-02-13 17:49:37.217685", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-13T17:49:37.137 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:37 +0000 (0:00:00.067) 0:01:43.974 ***** 2021-02-13T17:49:37.173 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:37 +0000 (0:00:00.035) 0:01:44.010 ***** 2021-02-13T17:49:37.180 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2021-02-13T17:49:37.181 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:37.225 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:37 +0000 (0:00:00.051) 0:01:44.061 ***** 2021-02-13T17:49:37.232 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2021-02-13T17:49:37.275 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:37 +0000 (0:00:00.050) 0:01:44.112 ***** 2021-02-13T17:49:37.282 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2021-02-13T17:49:37.283 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:37.321 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:37 +0000 (0:00:00.045) 0:01:44.158 ***** 2021-02-13T17:49:37.330 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2021-02-13T17:49:37.331 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:37.368 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:37 +0000 (0:00:00.047) 0:01:44.205 ***** 2021-02-13T17:49:37.375 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-02-13T17:49:37.376 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:37.414 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:37 +0000 (0:00:00.045) 0:01:44.251 ***** 2021-02-13T17:49:37.420 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2021-02-13T17:49:37.422 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:37.459 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:37 +0000 (0:00:00.045) 0:01:44.296 ***** 2021-02-13T17:49:37.466 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2021-02-13T17:49:37.467 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:37.503 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:37 +0000 (0:00:00.043) 0:01:44.340 ***** 2021-02-13T17:49:37.510 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-02-13T17:49:37.511 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:37.555 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:37 +0000 (0:00:00.052) 0:01:44.392 ***** 2021-02-13T17:49:37.583 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2021-02-13T17:49:37.584 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ ok: [gibba025.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-02-13T17:49:37.623 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:37 +0000 (0:00:00.067) 0:01:44.459 ***** 2021-02-13T17:49:37.663 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:37 +0000 (0:00:00.040) 0:01:44.500 ***** 2021-02-13T17:49:37.669 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-02-13T17:49:37.670 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'block_used': 13757936, 'uuid': '544fff2a-e246-4637-96d0-94b4cd4bcfea', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226337172, 'size_available': 927077056512, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 149516, 'block_size': 4096, 'inode_available': 60905460}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226337172, "block_size": 4096, "block_total": 240095108, "block_used": 13757936, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60905460, "inode_total": 61054976, "inode_used": 149516, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927077056512, "size_total": 983429562368, "uuid": "544fff2a-e246-4637-96d0-94b4cd4bcfea"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:37.720 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:37 +0000 (0:00:00.056) 0:01:44.557 ***** 2021-02-13T17:49:37.747 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2021-02-13T17:49:37.748 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} TASK [testnode : Combine list of non-root disks] ******************************* skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:37.781 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:37 +0000 (0:00:00.061) 0:01:44.618 ***** 2021-02-13T17:49:37.820 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:37 +0000 (0:00:00.038) 0:01:44.657 ***** 2021-02-13T17:49:37.826 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-02-13T17:49:37.827 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:37.862 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:37 +0000 (0:00:00.042) 0:01:44.699 ***** 2021-02-13T17:49:37.868 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-02-13T17:49:37.869 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'block_used': 13757936, 'uuid': '544fff2a-e246-4637-96d0-94b4cd4bcfea', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226337172, 'size_available': 927077056512, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro,data=ordered', 'device': '/dev/sda1', 'inode_used': 149516, 'block_size': 4096, 'inode_available': 60905460}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226337172, "block_size": 4096, "block_total": 240095108, "block_used": 13757936, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60905460, "inode_total": 61054976, "inode_used": 149516, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927077056512, "size_total": 983429562368, "uuid": "544fff2a-e246-4637-96d0-94b4cd4bcfea"}, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:37.905 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:37 +0000 (0:00:00.042) 0:01:44.742 ***** 2021-02-13T17:49:37.911 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-02-13T17:49:37.912 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:37.946 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:37 +0000 (0:00:00.040) 0:01:44.783 ***** 2021-02-13T17:49:37.952 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2021-02-13T17:49:37.954 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:37.987 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:37 +0000 (0:00:00.040) 0:01:44.824 ***** 2021-02-13T17:49:37.992 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2021-02-13T17:49:37.993 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:38.029 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:38 +0000 (0:00:00.042) 0:01:44.866 ***** 2021-02-13T17:49:38.035 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-02-13T17:49:38.036 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:38.072 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:38 +0000 (0:00:00.042) 0:01:44.909 ***** 2021-02-13T17:49:38.078 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2021-02-13T17:49:38.079 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:38.115 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:38 +0000 (0:00:00.043) 0:01:44.952 ***** 2021-02-13T17:49:38.122 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-02-13T17:49:38.123 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:38.156 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:38 +0000 (0:00:00.040) 0:01:44.993 ***** 2021-02-13T17:49:38.161 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2021-02-13T17:49:38.163 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:38.197 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:38 +0000 (0:00:00.040) 0:01:45.034 ***** 2021-02-13T17:49:38.203 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2021-02-13T17:49:38.205 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:38.240 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:38 +0000 (0:00:00.042) 0:01:45.077 ***** 2021-02-13T17:49:38.267 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2021-02-13T17:49:38.269 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:38.302 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:38 +0000 (0:00:00.062) 0:01:45.139 ***** 2021-02-13T17:49:38.330 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:38.365 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:38 +0000 (0:00:00.062) 0:01:45.202 ***** 2021-02-13T17:49:38.703 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2021-02-13T17:49:38.705 INFO:teuthology.task.ansible.out:changed: [gibba036.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2021-02-13T17:49:38.739 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:38 +0000 (0:00:00.374) 0:01:45.576 ***** 2021-02-13T17:49:38.877 INFO:teuthology.task.ansible.out:changed: [gibba025.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2021-02-13T17:49:38.913 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:38 +0000 (0:00:00.173) 0:01:45.749 ***** 2021-02-13T17:49:39.182 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-02-13T17:49:39.183 INFO:teuthology.task.ansible.out:changed: [gibba025.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-02-13T17:49:39.184 INFO:teuthology.task.ansible.out:changed: [gibba036.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-02-13T17:49:39.321 INFO:teuthology.task.ansible.out:changed: [gibba025.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-02-13T17:49:39.332 INFO:teuthology.task.ansible.out:changed: [gibba036.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-02-13T17:49:39.468 INFO:teuthology.task.ansible.out:changed: [gibba025.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-02-13T17:49:39.479 INFO:teuthology.task.ansible.out:changed: [gibba036.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-02-13T17:49:39.615 INFO:teuthology.task.ansible.out:changed: [gibba025.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-02-13T17:49:39.626 INFO:teuthology.task.ansible.out:changed: [gibba036.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-02-13T17:49:39.751 INFO:teuthology.task.ansible.out:changed: [gibba025.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '13G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "13G", "vg": "vg_nvme"}}, "msg": ""} 2021-02-13T17:49:39.789 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:39 +0000 (0:00:00.876) 0:01:46.626 ***** 2021-02-13T17:49:39.795 INFO:teuthology.task.ansible.out:changed: [gibba036.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '13G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "13G", "vg": "vg_nvme"}}, "msg": ""} 2021-02-13T17:49:39.834 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:39 +0000 (0:00:00.045) 0:01:46.671 ***** 2021-02-13T17:49:39.881 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-02-13T17:49:39.883 INFO:teuthology.task.ansible.out:changed: [gibba025.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2021-02-13T17:49:39.918 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:39 +0000 (0:00:00.083) 0:01:46.754 ***** 2021-02-13T17:49:39.934 INFO:teuthology.task.ansible.out:changed: [gibba036.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2021-02-13T17:49:39.971 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:39 +0000 (0:00:00.053) 0:01:46.808 ***** 2021-02-13T17:49:40.029 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-02-13T17:49:40.031 INFO:teuthology.task.ansible.out:changed: [gibba025.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-02-13T17:49:40.073 INFO:teuthology.task.ansible.out:changed: [gibba036.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-02-13T17:49:40.107 INFO:teuthology.task.ansible.out:changed: [gibba025.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-02-13T17:49:40.150 INFO:teuthology.task.ansible.out:changed: [gibba036.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-02-13T17:49:40.184 INFO:teuthology.task.ansible.out:changed: [gibba025.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-02-13T17:49:40.238 INFO:teuthology.task.ansible.out:changed: [gibba036.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-02-13T17:49:40.261 INFO:teuthology.task.ansible.out:changed: [gibba025.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-02-13T17:49:40.273 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '13G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "13G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:40.314 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:40 +0000 (0:00:00.342) 0:01:47.150 ***** 2021-02-13T17:49:40.321 INFO:teuthology.task.ansible.out:changed: [gibba036.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-02-13T17:49:40.333 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '13G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "13G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:40.371 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:40 +0000 (0:00:00.057) 0:01:47.208 ***** 2021-02-13T17:49:40.377 INFO:teuthology.task.ansible.out: TASK [testnode : Create filesystems] ******************************************* 2021-02-13T17:49:40.379 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:40.416 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:40 +0000 (0:00:00.044) 0:01:47.252 ***** 2021-02-13T17:49:40.429 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:40.465 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:40 +0000 (0:00:00.049) 0:01:47.302 ***** 2021-02-13T17:49:40.472 INFO:teuthology.task.ansible.out: TASK [testnode : Mount filesystems] ******************************************** 2021-02-13T17:49:40.473 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:40.509 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:40 +0000 (0:00:00.044) 0:01:47.346 ***** 2021-02-13T17:49:40.516 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:40.555 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:40 +0000 (0:00:00.045) 0:01:47.391 ***** 2021-02-13T17:49:40.603 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2021-02-13T17:49:40.604 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2021-02-13T17:49:40.641 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:40 +0000 (0:00:00.086) 0:01:47.478 ***** 2021-02-13T17:49:40.658 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2021-02-13T17:49:40.696 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:40 +0000 (0:00:00.054) 0:01:47.533 ***** 2021-02-13T17:49:40.703 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2021-02-13T17:49:40.703 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2021-02-13T17:49:40.742 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:40 +0000 (0:00:00.046) 0:01:47.579 ***** 2021-02-13T17:49:40.749 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2021-02-13T17:49:40.787 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:40 +0000 (0:00:00.044) 0:01:47.624 ***** 2021-02-13T17:49:40.980 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2021-02-13T17:49:40.982 INFO:teuthology.task.ansible.out:changed: [gibba036.front.sepia.ceph.com] => {"changed": true} 2021-02-13T17:49:41.018 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:41 +0000 (0:00:00.231) 0:01:47.855 ***** 2021-02-13T17:49:41.024 INFO:teuthology.task.ansible.out:changed: [gibba025.front.sepia.ceph.com] => {"changed": true} 2021-02-13T17:49:41.062 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:41 +0000 (0:00:00.043) 0:01:47.899 ***** 2021-02-13T17:49:41.277 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2021-02-13T17:49:41.278 INFO:teuthology.task.ansible.out:changed: [gibba025.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2021-02-13T17:49:41.311 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:41 +0000 (0:00:00.249) 0:01:48.148 ***** 2021-02-13T17:49:41.318 INFO:teuthology.task.ansible.out:changed: [gibba036.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2021-02-13T17:49:41.354 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:41 +0000 (0:00:00.042) 0:01:48.191 ***** 2021-02-13T17:49:41.360 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd] ****************************************** 2021-02-13T17:49:41.362 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:41.400 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:41 +0000 (0:00:00.046) 0:01:48.237 ***** 2021-02-13T17:49:41.407 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:41.443 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:41 +0000 (0:00:00.042) 0:01:48.280 ***** 2021-02-13T17:49:41.449 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd conf file] ******************************** 2021-02-13T17:49:41.450 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:41.489 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:41 +0000 (0:00:00.046) 0:01:48.326 ***** 2021-02-13T17:49:41.498 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:41.535 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:41 +0000 (0:00:00.045) 0:01:48.372 ***** 2021-02-13T17:49:41.541 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-02-13T17:49:41.542 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:41.579 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:41 +0000 (0:00:00.044) 0:01:48.416 ***** 2021-02-13T17:49:41.588 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:41.627 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:41 +0000 (0:00:00.048) 0:01:48.464 ***** 2021-02-13T17:49:41.634 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-02-13T17:49:41.635 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:41.672 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:41 +0000 (0:00:00.044) 0:01:48.509 ***** 2021-02-13T17:49:41.678 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:41.718 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:41 +0000 (0:00:00.045) 0:01:48.555 ***** 2021-02-13T17:49:41.777 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2021-02-13T17:49:41.778 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => {"changed": false, "gid": 1234, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2021-02-13T17:49:41.814 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:41 +0000 (0:00:00.096) 0:01:48.651 ***** 2021-02-13T17:49:41.831 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => {"changed": false, "gid": 1234, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2021-02-13T17:49:41.875 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:41 +0000 (0:00:00.060) 0:01:48.712 ***** 2021-02-13T17:49:41.913 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2021-02-13T17:49:41.913 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} 2021-02-13T17:49:41.953 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:41 +0000 (0:00:00.077) 0:01:48.790 ***** 2021-02-13T17:49:41.970 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} 2021-02-13T17:49:42.025 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:42 +0000 (0:00:00.072) 0:01:48.862 ***** 2021-02-13T17:49:42.181 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2021-02-13T17:49:42.183 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1234, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2021-02-13T17:49:42.219 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:42 +0000 (0:00:00.193) 0:01:49.055 ***** 2021-02-13T17:49:42.256 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1234, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2021-02-13T17:49:42.300 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:42 +0000 (0:00:00.081) 0:01:49.137 ***** 2021-02-13T17:49:42.441 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2021-02-13T17:49:42.442 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2021-02-13T17:49:42.479 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:42 +0000 (0:00:00.178) 0:01:49.316 ***** 2021-02-13T17:49:42.522 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2021-02-13T17:49:42.560 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:42 +0000 (0:00:00.080) 0:01:49.396 ***** 2021-02-13T17:49:43.108 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2021-02-13T17:49:43.109 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => {"cache_update_time": 1613238280, "cache_updated": false, "changed": false} 2021-02-13T17:49:43.144 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:43 +0000 (0:00:00.584) 0:01:49.981 ***** 2021-02-13T17:49:43.150 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => {"cache_update_time": 1613238310, "cache_updated": false, "changed": false} 2021-02-13T17:49:43.188 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:43 +0000 (0:00:00.043) 0:01:50.025 ***** 2021-02-13T17:49:43.267 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2021-02-13T17:49:43.268 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.029224", "end": "2021-02-13 17:49:43.290367", "rc": 0, "start": "2021-02-13 17:49:43.261143", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.26.1/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.26.1/Amazon/S3.pm"]} 2021-02-13T17:49:43.303 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:43 +0000 (0:00:00.115) 0:01:50.140 ***** 2021-02-13T17:49:43.310 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.024697", "end": "2021-02-13 17:49:43.468198", "rc": 0, "start": "2021-02-13 17:49:43.443501", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.26.1/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.26.1/Amazon/S3.pm"]} 2021-02-13T17:49:43.347 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:43 +0000 (0:00:00.043) 0:01:50.184 ***** 2021-02-13T17:49:43.353 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2021-02-13T17:49:43.354 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:43.392 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:43 +0000 (0:00:00.044) 0:01:50.229 ***** 2021-02-13T17:49:43.403 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:43.439 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:43 +0000 (0:00:00.046) 0:01:50.275 ***** 2021-02-13T17:49:43.446 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2021-02-13T17:49:43.446 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:43.485 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:43 +0000 (0:00:00.046) 0:01:50.322 ***** 2021-02-13T17:49:43.493 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:43.532 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:43 +0000 (0:00:00.046) 0:01:50.369 ***** 2021-02-13T17:49:44.102 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2021-02-13T17:49:44.103 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => {"cache_update_time": 1613238280, "cache_updated": false, "changed": false} 2021-02-13T17:49:44.144 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:44 +0000 (0:00:00.611) 0:01:50.980 ***** 2021-02-13T17:49:44.151 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => {"cache_update_time": 1613238310, "cache_updated": false, "changed": false} 2021-02-13T17:49:44.191 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:44 +0000 (0:00:00.048) 0:01:51.028 ***** 2021-02-13T17:49:44.198 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2021-02-13T17:49:44.199 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:44.236 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:44 +0000 (0:00:00.045) 0:01:51.073 ***** 2021-02-13T17:49:44.243 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:44.286 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:44 +0000 (0:00:00.049) 0:01:51.122 ***** 2021-02-13T17:49:44.453 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2021-02-13T17:49:44.455 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} 2021-02-13T17:49:44.495 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:44 +0000 (0:00:00.209) 0:01:51.332 ***** 2021-02-13T17:49:44.513 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} 2021-02-13T17:49:44.552 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:44 +0000 (0:00:00.056) 0:01:51.388 ***** 2021-02-13T17:49:44.560 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2021-02-13T17:49:44.560 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:44.606 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:44 +0000 (0:00:00.054) 0:01:51.443 ***** 2021-02-13T17:49:44.617 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:44.654 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:44 +0000 (0:00:00.047) 0:01:51.491 ***** 2021-02-13T17:49:44.744 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2021-02-13T17:49:44.745 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Sat 2021-02-13 17:47:44 UTC", "ActiveEnterTimestampMonotonic": "24466625", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "network.target system.slice systemd-journald.socket sysinit.target -.mount basic.target systemd-tmpfiles-setup.service", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Sat 2021-02-13 17:47:38 UTC", "AssertTimestampMonotonic": "17936660", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Sat 2021-02-13 17:47:38 UTC", "ConditionTimestampMonotonic": "17936660", "ConfigurationDirectoryMode": "0755", "Conflicts": "systemd-timesyncd.service shutdown.target", "ControlGroup": "/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Document 2021-02-13T17:49:44.747 INFO:teuthology.task.ansible.out:ation": "man:ntpd(8)", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1973", "ExecMainStartTimestamp": "Sat 2021-02-13 17:47:44 UTC", "ExecMainStartTimestampMonotonic": "24466587", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Sat 2021-02-13 17:47:38 UTC", "InactiveExitTimestampMonotonic": "17937181", "InvocationID": "a21a4923e34345b695a516cbc9ddd668", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128079", "LimitNPROCSoft": "128079", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "Limit 2021-02-13T17:49:44.748 INFO:teuthology.task.ansible.out:RTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128079", "LimitSIGPENDINGSoft": "128079", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1973", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice -.mount sysinit.target", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Sat 2021-02-13 17:47:44 UTC", "St 2021-02-13T17:49:44.749 INFO:teuthology.task.ansible.out:ateChangeTimestampMonotonic": "24466625", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Sat 2021-02-13 17:47:44 UTC", "WatchdogTimestampMonotonic": "24466622", "WatchdogUSec": "0"}} 2021-02-13T17:49:44.785 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:44 +0000 (0:00:00.130) 0:01:51.622 ***** 2021-02-13T17:49:44.804 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Sat 2021-02-13 17:47:50 UTC", "ActiveEnterTimestampMonotonic": "23673202", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "-.mount systemd-journald.socket system.slice systemd-tmpfiles-setup.service network.target basic.target sysinit.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Sat 2021-02-13 17:47:44 UTC", "AssertTimestampMonotonic": "17696102", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Sat 2021-02-13 17:47:44 UTC", "ConditionTimestampMonotonic": "17696102", "ConfigurationDirectoryMode": "0755", "Conflicts": "systemd-timesyncd.service shutdown.target", "ControlGroup": "/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Document 2021-02-13T17:49:44.805 INFO:teuthology.task.ansible.out:ation": "man:ntpd(8)", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "2069", "ExecMainStartTimestamp": "Sat 2021-02-13 17:47:50 UTC", "ExecMainStartTimestampMonotonic": "23673162", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Sat 2021-02-13 17:47:44 UTC", "InactiveExitTimestampMonotonic": "17696636", "InvocationID": "827c5016f40e4bb19da6b682e83c1412", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128079", "LimitNPROCSoft": "128079", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "Limit 2021-02-13T17:49:44.807 INFO:teuthology.task.ansible.out:RTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128079", "LimitSIGPENDINGSoft": "128079", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "2069", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount sysinit.target system.slice", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Sat 2021-02-13 17:47:50 UTC", "St 2021-02-13T17:49:44.808 INFO:teuthology.task.ansible.out:ateChangeTimestampMonotonic": "23673202", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Sat 2021-02-13 17:47:50 UTC", "WatchdogTimestampMonotonic": "23673198", "WatchdogUSec": "0"}} TASK [testnode : set_fact] ***************************************************** ok: [gibba025.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2021-02-13T17:49:44.841 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:44 +0000 (0:00:00.055) 0:01:51.678 ***** 2021-02-13T17:49:44.874 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:44 +0000 (0:00:00.032) 0:01:51.710 ***** 2021-02-13T17:49:44.879 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-02-13T17:49:44.879 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:44.915 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:44 +0000 (0:00:00.041) 0:01:51.752 ***** 2021-02-13T17:49:44.921 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-02-13T17:49:44.922 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2021-02-13T17:49:44.962 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:44 +0000 (0:00:00.046) 0:01:51.799 ***** 2021-02-13T17:49:44.967 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2021-02-13T17:49:44.968 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:45.004 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:44 +0000 (0:00:00.042) 0:01:51.841 ***** 2021-02-13T17:49:45.011 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-02-13T17:49:45.013 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:45.048 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:45 +0000 (0:00:00.044) 0:01:51.885 ***** 2021-02-13T17:49:45.075 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2021-02-13T17:49:45.077 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:45.111 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:45 +0000 (0:00:00.062) 0:01:51.948 ***** 2021-02-13T17:49:45.591 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2021-02-13T17:49:45.593 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => {"cache_update_time": 1613238280, "cache_updated": false, "changed": false} 2021-02-13T17:49:45.630 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:45 +0000 (0:00:00.519) 0:01:52.467 ***** 2021-02-13T17:49:45.657 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:45.692 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:45 +0000 (0:00:00.062) 0:01:52.529 ***** 2021-02-13T17:49:45.730 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2021-02-13T17:49:45.731 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => {"cache_update_time": 1613238310, "cache_updated": false, "changed": false} 2021-02-13T17:49:45.784 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:45 +0000 (0:00:00.091) 0:01:52.621 ***** 2021-02-13T17:49:45.800 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2021-02-13T17:49:45.802 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => {"changed": false, "gid": 1234, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2021-02-13T17:49:45.839 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:45 +0000 (0:00:00.055) 0:01:52.676 ***** 2021-02-13T17:49:45.847 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2021-02-13T17:49:45.848 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:45.888 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:45 +0000 (0:00:00.048) 0:01:52.725 ***** 2021-02-13T17:49:45.988 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2021-02-13T17:49:45.990 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => {"changed": false, "gid": 1234, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2021-02-13T17:49:46.024 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:46 +0000 (0:00:00.135) 0:01:52.861 ***** 2021-02-13T17:49:46.071 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2021-02-13T17:49:46.072 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1234, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2021-02-13T17:49:46.108 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:46 +0000 (0:00:00.083) 0:01:52.944 ***** 2021-02-13T17:49:46.251 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1234, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2021-02-13T17:49:46.297 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:46 +0000 (0:00:00.189) 0:01:53.134 ***** 2021-02-13T17:49:46.766 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2021-02-13T17:49:46.767 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python2.7/dist-packages\nRequirement already satisfied: execnet in /usr/local/lib/python2.7/dist-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python2.7/dist-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python2.7/dist-packages", "Requirement already satisfied: execnet in /usr/local/lib/python2.7/dist-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python2.7/dist-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2021-02-13T17:49:46.803 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:46 +0000 (0:00:00.505) 0:01:53.639 ***** 2021-02-13T17:49:46.830 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python2.7/dist-packages\nRequirement already satisfied: execnet in /usr/local/lib/python2.7/dist-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python2.7/dist-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python2.7/dist-packages", "Requirement already satisfied: execnet in /usr/local/lib/python2.7/dist-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python2.7/dist-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2021-02-13T17:49:46.869 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:46 +0000 (0:00:00.065) 0:01:53.705 ***** 2021-02-13T17:49:47.202 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2021-02-13T17:49:47.204 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => {"changed": false} 2021-02-13T17:49:47.239 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:47 +0000 (0:00:00.370) 0:01:54.076 ***** 2021-02-13T17:49:47.246 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => {"changed": false} 2021-02-13T17:49:47.283 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:47 +0000 (0:00:00.043) 0:01:54.120 ***** 2021-02-13T17:49:47.289 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2021-02-13T17:49:47.290 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp1s0f0"}, "changed": false} 2021-02-13T17:49:47.326 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:47 +0000 (0:00:00.042) 0:01:54.162 ***** 2021-02-13T17:49:47.333 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp1s0f0"}, "changed": false} 2021-02-13T17:49:47.370 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:47 +0000 (0:00:00.043) 0:01:54.206 ***** 2021-02-13T17:49:47.418 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2021-02-13T17:49:47.420 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1613238263.3983057, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1613238263.3943076, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 10060, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1613238263.3943076, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 71, "uid": 0, "version": "3104356462", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2021-02-13T17:49:47.456 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:47 +0000 (0:00:00.086) 0:01:54.293 ***** 2021-02-13T17:49:47.474 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1613238256.2422059, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1613238256.2382078, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 10060, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1613238256.2382078, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 71, "uid": 0, "version": "3104356462", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2021-02-13T17:49:47.511 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:47 +0000 (0:00:00.054) 0:01:54.347 ***** 2021-02-13T17:49:47.672 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2021-02-13T17:49:47.674 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => {"changed": false, "msg": ""} ok: [gibba036.front.sepia.ceph.com] => {"changed": false, "msg": ""} 2021-02-13T17:49:47.709 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:47 +0000 (0:00:00.198) 0:01:54.546 ***** 2021-02-13T17:49:47.744 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:47 +0000 (0:00:00.034) 0:01:54.580 ***** 2021-02-13T17:49:47.750 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2021-02-13T17:49:47.751 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-02-13T17:49:47.789 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:47 +0000 (0:00:00.045) 0:01:54.626 ***** 2021-02-13T17:49:47.791 INFO:teuthology.task.ansible.out: 2021-02-13T17:49:47.796 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-02-13T17:49:47.833 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:47 +0000 (0:00:00.043) 0:01:54.669 ***** 2021-02-13T17:49:47.839 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2021-02-13T17:49:47.840 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:47.877 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:47 +0000 (0:00:00.044) 0:01:54.714 ***** 2021-02-13T17:49:47.885 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:47.928 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:47 +0000 (0:00:00.050) 0:01:54.765 ***** 2021-02-13T17:49:47.969 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2021-02-13T17:49:47.970 INFO:teuthology.task.ansible.out:changed: [gibba025.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2021-02-13T17:49:48.008 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:48 +0000 (0:00:00.079) 0:01:54.845 ***** 2021-02-13T17:49:48.025 INFO:teuthology.task.ansible.out:changed: [gibba036.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2021-02-13T17:49:48.063 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:48 +0000 (0:00:00.055) 0:01:54.900 ***** 2021-02-13T17:49:48.093 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2021-02-13T17:49:48.094 INFO:teuthology.task.ansible.out:changed: [gibba025.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2021-02-13T17:49:48.132 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:48 +0000 (0:00:00.068) 0:01:54.969 ***** 2021-02-13T17:49:48.159 INFO:teuthology.task.ansible.out:changed: [gibba036.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2021-02-13T17:49:48.160 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:48.201 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:48 +0000 (0:00:00.069) 0:01:55.038 ***** 2021-02-13T17:49:48.238 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:48 +0000 (0:00:00.036) 0:01:55.074 ***** 2021-02-13T17:49:48.245 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2021-02-13T17:49:48.245 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2021-02-13T17:49:48.247 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} skipping: [gibba025.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} skipping: [gibba025.front.sepia.ceph.com] => (item=enp1s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f1", "skip_reason": "Conditional result was False"} 2021-02-13T17:49:48.259 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item=enp1s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f0", "skip_reason": "Conditional result was False"} 2021-02-13T17:49:48.260 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2021-02-13T17:49:48.261 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:48.297 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:48 +0000 (0:00:00.058) 0:01:55.133 ***** 2021-02-13T17:49:48.333 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:48 +0000 (0:00:00.036) 0:01:55.170 ***** 2021-02-13T17:49:48.339 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2021-02-13T17:49:48.340 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:48.341 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:48.353 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:48.355 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp1s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:48.356 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp1s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:48.410 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:48 +0000 (0:00:00.076) 0:01:55.246 ***** 2021-02-13T17:49:48.416 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2021-02-13T17:49:48.416 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2021-02-13T17:49:48.417 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2021-02-13T17:49:48.419 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item=enp1s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f0", "skip_reason": "Conditional result was False"} skipping: [gibba036.front.sepia.ceph.com] => (item=enp1s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f1", "skip_reason": "Conditional result was False"} 2021-02-13T17:49:48.419 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2021-02-13T17:49:48.458 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:48 +0000 (0:00:00.047) 0:01:55.294 ***** 2021-02-13T17:49:48.464 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-02-13T17:49:48.465 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:48.508 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:48 +0000 (0:00:00.050) 0:01:55.345 ***** 2021-02-13T17:49:48.516 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2021-02-13T17:49:48.516 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:48.518 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:48.529 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp1s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:48.530 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp1s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:48.532 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:48.535 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2021-02-13T17:49:48.536 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:48.578 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:48 +0000 (0:00:00.069) 0:01:55.414 ***** 2021-02-13T17:49:48.617 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:48 +0000 (0:00:00.039) 0:01:55.454 ***** 2021-02-13T17:49:48.624 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2021-02-13T17:49:48.625 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:48.661 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:48 +0000 (0:00:00.044) 0:01:55.498 ***** 2021-02-13T17:49:48.668 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-02-13T17:49:48.670 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:48.706 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:48 +0000 (0:00:00.045) 0:01:55.543 ***** 2021-02-13T17:49:48.712 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2021-02-13T17:49:48.714 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:48.749 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:48 +0000 (0:00:00.042) 0:01:55.586 ***** 2021-02-13T17:49:48.755 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2021-02-13T17:49:48.757 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:48.792 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:48 +0000 (0:00:00.043) 0:01:55.629 ***** 2021-02-13T17:49:48.798 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2021-02-13T17:49:48.800 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:48.836 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:48 +0000 (0:00:00.044) 0:01:55.673 ***** 2021-02-13T17:49:48.843 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2021-02-13T17:49:48.844 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:48.881 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:48 +0000 (0:00:00.044) 0:01:55.718 ***** 2021-02-13T17:49:48.887 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-02-13T17:49:48.888 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:48.925 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:48 +0000 (0:00:00.044) 0:01:55.762 ***** 2021-02-13T17:49:48.932 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2021-02-13T17:49:48.933 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:48.969 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:48 +0000 (0:00:00.043) 0:01:55.806 ***** 2021-02-13T17:49:48.975 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2021-02-13T17:49:48.976 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:49.018 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:49 +0000 (0:00:00.048) 0:01:55.855 ***** 2021-02-13T17:49:49.024 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2021-02-13T17:49:49.026 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:49.063 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:49 +0000 (0:00:00.045) 0:01:55.900 ***** 2021-02-13T17:49:49.070 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-02-13T17:49:49.071 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:49.109 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:49 +0000 (0:00:00.045) 0:01:55.945 ***** 2021-02-13T17:49:49.116 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-02-13T17:49:49.117 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:49.156 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:49 +0000 (0:00:00.047) 0:01:55.993 ***** 2021-02-13T17:49:49.183 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2021-02-13T17:49:49.184 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:49.221 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:49 +0000 (0:00:00.064) 0:01:56.057 ***** 2021-02-13T17:49:49.227 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-02-13T17:49:49.228 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.002243", "end": "2021-02-13 17:49:49.224780", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-02-13 17:49:49.222537", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-13T17:49:49.250 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:49.286 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:49 +0000 (0:00:00.064) 0:01:56.122 ***** 2021-02-13T17:49:49.302 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-02-13T17:49:49.302 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.001343", "end": "2021-02-13 17:49:49.305994", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-02-13 17:49:49.304651", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-13T17:49:49.377 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.001333", "end": "2021-02-13 17:49:49.382573", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-02-13 17:49:49.381240", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2021-02-13T17:49:49.398 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.002181", "end": "2021-02-13 17:49:49.543606", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-02-13 17:49:49.541425", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-13T17:49:49.461 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.001935", "end": "2021-02-13 17:49:49.459051", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-02-13 17:49:49.457116", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-13T17:49:49.500 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:49 +0000 (0:00:00.214) 0:01:56.337 ***** 2021-02-13T17:49:49.508 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.001408", "end": "2021-02-13 17:49:49.622322", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-02-13 17:49:49.620914", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-13T17:49:49.530 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2021-02-13T17:49:49.572 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:49 +0000 (0:00:00.072) 0:01:56.409 ***** 2021-02-13T17:49:49.579 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-02-13T17:49:49.581 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.001317", "end": "2021-02-13 17:49:49.698457", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-02-13 17:49:49.697140", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2021-02-13T17:49:49.623 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.001882", "end": "2021-02-13 17:49:49.777704", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-02-13 17:49:49.775822", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-13T17:49:49.663 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:49 +0000 (0:00:00.091) 0:01:56.500 ***** 2021-02-13T17:49:49.669 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2021-02-13T17:49:49.670 INFO:teuthology.task.ansible.out:changed: [gibba025.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2021-02-13T17:49:49.707 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2021-02-13T17:49:49.764 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:49 +0000 (0:00:00.100) 0:01:56.601 ***** 2021-02-13T17:49:49.857 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2021-02-13T17:49:49.859 INFO:teuthology.task.ansible.out:changed: [gibba036.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2021-02-13T17:49:49.966 INFO:teuthology.task.ansible.out: PLAY [testnodes,senta,vossi,jenkins_slaves] ************************************ 2021-02-13T17:49:50.004 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:49 +0000 (0:00:00.239) 0:01:56.841 ***** 2021-02-13T17:49:50.039 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:50 +0000 (0:00:00.034) 0:01:56.876 ***** 2021-02-13T17:49:50.464 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [gibba025.front.sepia.ceph.com] 2021-02-13T17:49:50.474 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] 2021-02-13T17:49:50.586 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:50 +0000 (0:00:00.546) 0:01:57.423 ***** 2021-02-13T17:49:50.626 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:50 +0000 (0:00:00.039) 0:01:57.462 ***** 2021-02-13T17:49:50.632 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-02-13T17:49:50.632 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "apt"}, "changed": false} 2021-02-13T17:49:50.670 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:50 +0000 (0:00:00.044) 0:01:57.507 ***** 2021-02-13T17:49:50.677 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "apt"}, "changed": false} 2021-02-13T17:49:50.714 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:50 +0000 (0:00:00.043) 0:01:57.551 ***** 2021-02-13T17:49:50.722 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-02-13T17:49:50.723 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:50.760 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:50 +0000 (0:00:00.045) 0:01:57.597 ***** 2021-02-13T17:49:50.766 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:50.806 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:50 +0000 (0:00:00.045) 0:01:57.642 ***** 2021-02-13T17:49:50.812 INFO:teuthology.task.ansible.out: TASK [container-host : Including distro specific variables] ******************** 2021-02-13T17:49:50.812 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml) => {"ansible_facts": {"container_packages": ["docker.io"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"} 2021-02-13T17:49:50.851 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:50 +0000 (0:00:00.045) 0:01:57.688 ***** 2021-02-13T17:49:50.857 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml) => {"ansible_facts": {"container_packages": ["docker.io"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"} 2021-02-13T17:49:50.897 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:50 +0000 (0:00:00.045) 0:01:57.733 ***** 2021-02-13T17:49:59.531 INFO:teuthology.task.ansible.out: TASK [container-host : Install container packages] ***************************** 2021-02-13T17:49:59.532 INFO:teuthology.task.ansible.out:changed: [gibba025.front.sepia.ceph.com] => {"cache_update_time": 1613238280, "cache_updated": false, "changed": true, "stderr": "", "stderr_lines": [], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nSuggested packages:\n aufs-tools debootstrap docker-doc rinse zfs-fuse | zfsutils\nThe following packages will be upgraded:\n docker.io\n1 upgraded, 0 newly installed, 0 to remove and 78 not upgraded.\nNeed to get 39.9 MB of archives.\nAfter this operation, 1024 B of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 docker.io amd64 19.03.6-0ubuntu1~18.04.3 [39.9 MB]\nPreconfiguring packages ...\nFetched 39.9 MB in 2s (21.7 MB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 137603 files and directories currently installed.)\r\nPreparing to unpack .../docker.io_19.03.6-0ubuntu1~18.04.3_amd64.deb ...\r\nUnpacking docker.io (19.03.6-0ubuntu1~18.04.3) over (19.03.6-0ubuntu1~18.04.2) ...\r\nSetting up docker.io (19.03.6-0ubuntu1~18.04.3) ...\r\ndocker.service is a disabled or a static unit, not starting it.\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "Suggested packages:", " aufs-tools debootstrap docker-doc rinse zfs-fuse | zfsutils", "The following packages will be upgraded:", " docker.io", "1 upgraded, 0 newly 2021-02-13T17:49:59.533 INFO:teuthology.task.ansible.out: installed, 0 to remove and 78 not upgraded.", "Need to get 39.9 MB of archives.", "After this operation, 1024 B of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 docker.io amd64 19.03.6-0ubuntu1~18.04.3 [39.9 MB]", "Preconfiguring packages ...", "Fetched 39.9 MB in 2s (21.7 MB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 137603 files and directories currently installed.)", "Preparing to unpack .../docker.io_19.03.6-0ubuntu1~18.04.3_amd64.deb ...", "Unpacking docker.io (19.03.6-0ubuntu1~18.04.3) over (19.03.6-0ubuntu1~18.04.2) ...", "Setting up docker.io (19.03.6-0ubuntu1~18.04.3) ...", "docker.service is a disabled or a static unit, not starting it.", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ..."]} 2021-02-13T17:49:59.571 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:59 +0000 (0:00:08.674) 0:02:06.408 ***** 2021-02-13T17:49:59.599 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-02-13T17:49:59.601 INFO:teuthology.task.ansible.out:skipping: [gibba025.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:59.643 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:59 +0000 (0:00:00.071) 0:02:06.479 ***** 2021-02-13T17:49:59.680 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-02-13T17:49:59.682 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/docker/daemon.json"}, "changed": false} 2021-02-13T17:49:59.717 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:59 +0000 (0:00:00.074) 0:02:06.554 ***** 2021-02-13T17:49:59.724 INFO:teuthology.task.ansible.out: TASK [container-host : Install container packages] ***************************** 2021-02-13T17:49:59.724 INFO:teuthology.task.ansible.out:changed: [gibba036.front.sepia.ceph.com] => {"cache_update_time": 1613238310, "cache_updated": false, "changed": true, "stderr": "", "stderr_lines": [], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nSuggested packages:\n aufs-tools debootstrap docker-doc rinse zfs-fuse | zfsutils\nThe following packages will be upgraded:\n docker.io\n1 upgraded, 0 newly installed, 0 to remove and 78 not upgraded.\nNeed to get 39.9 MB of archives.\nAfter this operation, 1024 B of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 docker.io amd64 19.03.6-0ubuntu1~18.04.3 [39.9 MB]\nPreconfiguring packages ...\nFetched 39.9 MB in 2s (21.6 MB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 137603 files and directories currently installed.)\r\nPreparing to unpack .../docker.io_19.03.6-0ubuntu1~18.04.3_amd64.deb ...\r\nUnpacking docker.io (19.03.6-0ubuntu1~18.04.3) over (19.03.6-0ubuntu1~18.04.2) ...\r\nSetting up docker.io (19.03.6-0ubuntu1~18.04.3) ...\r\ndocker.service is a disabled or a static unit, not starting it.\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "Suggested packages:", " aufs-tools debootstrap docker-doc rinse zfs-fuse | zfsutils", "The following packages will be upgraded:", " docker.io", "1 upgraded, 0 newly 2021-02-13T17:49:59.726 INFO:teuthology.task.ansible.out: installed, 0 to remove and 78 not upgraded.", "Need to get 39.9 MB of archives.", "After this operation, 1024 B of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 docker.io amd64 19.03.6-0ubuntu1~18.04.3 [39.9 MB]", "Preconfiguring packages ...", "Fetched 39.9 MB in 2s (21.6 MB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 137603 files and directories currently installed.)", "Preparing to unpack .../docker.io_19.03.6-0ubuntu1~18.04.3_amd64.deb ...", "Unpacking docker.io (19.03.6-0ubuntu1~18.04.3) over (19.03.6-0ubuntu1~18.04.2) ...", "Setting up docker.io (19.03.6-0ubuntu1~18.04.3) ...", "docker.service is a disabled or a static unit, not starting it.", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ..."]} 2021-02-13T17:49:59.769 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:59 +0000 (0:00:00.051) 0:02:06.605 ***** 2021-02-13T17:49:59.796 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-02-13T17:49:59.797 INFO:teuthology.task.ansible.out:skipping: [gibba036.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-13T17:49:59.836 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:59 +0000 (0:00:00.067) 0:02:06.673 ***** 2021-02-13T17:49:59.863 INFO:teuthology.task.ansible.out: 2021-02-13T17:49:59.865 INFO:teuthology.task.ansible.out:TASK [container-host : set_fact] *********************************************** ok: [gibba036.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/docker/daemon.json"}, "changed": false} 2021-02-13T17:49:59.902 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:59 +0000 (0:00:00.065) 0:02:06.739 ***** 2021-02-13T17:49:59.908 INFO:teuthology.task.ansible.out: TASK [container-host : Create container_mirror_cert_paths] ********************* 2021-02-13T17:49:59.909 INFO:teuthology.task.ansible.out:changed: [gibba025.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-02-13T17:49:59.953 INFO:teuthology.task.ansible.out:changed: [gibba025.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-02-13T17:49:59.996 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:49:59 +0000 (0:00:00.093) 0:02:06.832 ***** 2021-02-13T17:50:00.014 INFO:teuthology.task.ansible.out:changed: [gibba036.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-02-13T17:50:00.089 INFO:teuthology.task.ansible.out:changed: [gibba036.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-02-13T17:50:00.133 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:50:00 +0000 (0:00:00.137) 0:02:06.970 ***** 2021-02-13T17:50:00.256 INFO:teuthology.task.ansible.out: TASK [container-host : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert] *** 2021-02-13T17:50:00.257 INFO:teuthology.task.ansible.out:changed: [gibba025.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1613238600.0406873-252416822666269/source", "state": "file", "uid": 0} 2021-02-13T17:50:00.383 INFO:teuthology.task.ansible.out:changed: [gibba036.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1613238600.1759524-217676388699415/source", "state": "file", "uid": 0} 2021-02-13T17:50:00.467 INFO:teuthology.task.ansible.out:changed: [gibba025.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1613238600.2619402-279880661408860/source", "state": "file", "uid": 0} 2021-02-13T17:50:00.509 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:50:00 +0000 (0:00:00.375) 0:02:07.345 ***** 2021-02-13T17:50:00.599 INFO:teuthology.task.ansible.out:changed: [gibba036.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1613238600.394978-147452195055395/source", "state": "file", "uid": 0} 2021-02-13T17:50:00.640 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:50:00 +0000 (0:00:00.131) 0:02:07.477 ***** 2021-02-13T17:50:03.153 INFO:teuthology.task.ansible.out: TASK [container-host : Install registries-conf-ctl] **************************** 2021-02-13T17:50:03.155 INFO:teuthology.task.ansible.out:changed: [gibba036.front.sepia.ceph.com] => {"changed": true, "cmd": ["/usr/bin/pip2", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": "", "stderr_lines": [], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-rTPM2P-build\nCollecting docopt (from registries-conf-ctl==1.0)\n Downloading https://files.pythonhosted.org/packages/a2/55/8f8cab2afd404cf578136ef2cc5dfb50baa1761b68c9da1fb1e4eed343c9/docopt-0.6.2.tar.gz\nCollecting toml (from registries-conf-ctl==1.0)\n Downloading https://files.pythonhosted.org/packages/44/6f/7120676b6d73228c96e17f1f794d8ab046fc910d781c8d151120c3f1569e/toml-0.10.2-py2.py3-none-any.whl\nCollecting typing (from registries-conf-ctl==1.0)\n Downloading https://files.pythonhosted.org/packages/3b/c0/e44213fcb799eac02881e2485724ba5b0914600bc9df6ed922e364fdc059/typing-3.7.4.3-py2-none-any.whl\nBuilding wheels for collected packages: docopt\n Running setup.py bdist_wheel for docopt: started\n Running setup.py bdist_wheel for docopt: finished with status 'done'\n Stored in directory: /root/.cache/pip/wheels/9b/04/dd/7daf4150b6d9b12949298737de9431a324d4b797ffd63f526e\nSuccessfully built docopt\nInstalling collected packages: docopt, toml, typing, registries-conf-ctl\n Running setup.py install for registries-conf-ctl: started\n Running setup.py install for registries-conf-ctl: finished with status 'done'\nSuccessfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2 typing-3.7.4.3\n", "stdout_lines": ["Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-rTPM2P-build", "Collecting docopt (from registries-conf-ctl==1.0)", " Downloading https://files.pythonhosted.org/package 2021-02-13T17:50:03.156 INFO:teuthology.task.ansible.out:s/a2/55/8f8cab2afd404cf578136ef2cc5dfb50baa1761b68c9da1fb1e4eed343c9/docopt-0.6.2.tar.gz", "Collecting toml (from registries-conf-ctl==1.0)", " Downloading https://files.pythonhosted.org/packages/44/6f/7120676b6d73228c96e17f1f794d8ab046fc910d781c8d151120c3f1569e/toml-0.10.2-py2.py3-none-any.whl", "Collecting typing (from registries-conf-ctl==1.0)", " Downloading https://files.pythonhosted.org/packages/3b/c0/e44213fcb799eac02881e2485724ba5b0914600bc9df6ed922e364fdc059/typing-3.7.4.3-py2-none-any.whl", "Building wheels for collected packages: docopt", " Running setup.py bdist_wheel for docopt: started", " Running setup.py bdist_wheel for docopt: finished with status 'done'", " Stored in directory: /root/.cache/pip/wheels/9b/04/dd/7daf4150b6d9b12949298737de9431a324d4b797ffd63f526e", "Successfully built docopt", "Installing collected packages: docopt, toml, typing, registries-conf-ctl", " Running setup.py install for registries-conf-ctl: started", " Running setup.py install for registries-conf-ctl: finished with status 'done'", "Successfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2 typing-3.7.4.3"], "version": null, "virtualenv": null} 2021-02-13T17:50:03.212 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:50:03 +0000 (0:00:02.571) 0:02:10.049 ***** 2021-02-13T17:50:03.264 INFO:teuthology.task.ansible.out:changed: [gibba025.front.sepia.ceph.com] => {"changed": true, "cmd": ["/usr/bin/pip2", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": "", "stderr_lines": [], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-bVdNkn-build\nCollecting docopt (from registries-conf-ctl==1.0)\n Downloading https://files.pythonhosted.org/packages/a2/55/8f8cab2afd404cf578136ef2cc5dfb50baa1761b68c9da1fb1e4eed343c9/docopt-0.6.2.tar.gz\nCollecting toml (from registries-conf-ctl==1.0)\n Downloading https://files.pythonhosted.org/packages/44/6f/7120676b6d73228c96e17f1f794d8ab046fc910d781c8d151120c3f1569e/toml-0.10.2-py2.py3-none-any.whl\nCollecting typing (from registries-conf-ctl==1.0)\n Downloading https://files.pythonhosted.org/packages/3b/c0/e44213fcb799eac02881e2485724ba5b0914600bc9df6ed922e364fdc059/typing-3.7.4.3-py2-none-any.whl\nBuilding wheels for collected packages: docopt\n Running setup.py bdist_wheel for docopt: started\n Running setup.py bdist_wheel for docopt: finished with status 'done'\n Stored in directory: /root/.cache/pip/wheels/9b/04/dd/7daf4150b6d9b12949298737de9431a324d4b797ffd63f526e\nSuccessfully built docopt\nInstalling collected packages: docopt, toml, typing, registries-conf-ctl\n Running setup.py install for registries-conf-ctl: started\n Running setup.py install for registries-conf-ctl: finished with status 'done'\nSuccessfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2 typing-3.7.4.3\n", "stdout_lines": ["Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-bVdNkn-build", "Collecting docopt (from registries-conf-ctl==1.0)", " Downloading https://files.pythonhosted.org/package 2021-02-13T17:50:03.266 INFO:teuthology.task.ansible.out:s/a2/55/8f8cab2afd404cf578136ef2cc5dfb50baa1761b68c9da1fb1e4eed343c9/docopt-0.6.2.tar.gz", "Collecting toml (from registries-conf-ctl==1.0)", " Downloading https://files.pythonhosted.org/packages/44/6f/7120676b6d73228c96e17f1f794d8ab046fc910d781c8d151120c3f1569e/toml-0.10.2-py2.py3-none-any.whl", "Collecting typing (from registries-conf-ctl==1.0)", " Downloading https://files.pythonhosted.org/packages/3b/c0/e44213fcb799eac02881e2485724ba5b0914600bc9df6ed922e364fdc059/typing-3.7.4.3-py2-none-any.whl", "Building wheels for collected packages: docopt", " Running setup.py bdist_wheel for docopt: started", " Running setup.py bdist_wheel for docopt: finished with status 'done'", " Stored in directory: /root/.cache/pip/wheels/9b/04/dd/7daf4150b6d9b12949298737de9431a324d4b797ffd63f526e", "Successfully built docopt", "Installing collected packages: docopt, toml, typing, registries-conf-ctl", " Running setup.py install for registries-conf-ctl: started", " Running setup.py install for registries-conf-ctl: finished with status 'done'", "Successfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2 typing-3.7.4.3"], "version": null, "virtualenv": null} 2021-02-13T17:50:03.303 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:50:03 +0000 (0:00:00.091) 0:02:10.140 ***** 2021-02-13T17:50:03.320 INFO:teuthology.task.ansible.out: TASK [container-host : Check for docker's daemon.json] ************************* 2021-02-13T17:50:03.322 INFO:teuthology.task.ansible.out:ok: [gibba036.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2021-02-13T17:50:03.363 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:50:03 +0000 (0:00:00.059) 0:02:10.200 ***** 2021-02-13T17:50:03.401 INFO:teuthology.task.ansible.out:ok: [gibba025.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2021-02-13T17:50:03.440 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:50:03 +0000 (0:00:00.077) 0:02:10.277 ***** 2021-02-13T17:50:03.671 INFO:teuthology.task.ansible.out: TASK [container-host : Create /etc/docker/daemon.json if necessary] ************ 2021-02-13T17:50:03.673 INFO:teuthology.task.ansible.out:changed: [gibba036.front.sepia.ceph.com] => {"changed": true, "checksum": "bf21a9e8fbc5a3846fb05b4fa0859e0917b2202f", "dest": "/etc/docker/daemon.json", "gid": 0, "group": "root", "md5sum": "99914b932bd37a50b983c5e7c90ae93b", "mode": "0644", "owner": "root", "size": 2, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1613238603.4182796-85412488153925/source", "state": "file", "uid": 0} 2021-02-13T17:50:03.715 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:50:03 +0000 (0:00:00.274) 0:02:10.552 ***** 2021-02-13T17:50:03.734 INFO:teuthology.task.ansible.out:changed: [gibba025.front.sepia.ceph.com] => {"changed": true, "checksum": "bf21a9e8fbc5a3846fb05b4fa0859e0917b2202f", "dest": "/etc/docker/daemon.json", "gid": 0, "group": "root", "md5sum": "99914b932bd37a50b983c5e7c90ae93b", "mode": "0644", "owner": "root", "size": 2, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1613238603.4744205-412828934320/source", "state": "file", "uid": 0} 2021-02-13T17:50:03.776 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:50:03 +0000 (0:00:00.061) 0:02:10.613 ***** 2021-02-13T17:50:03.901 INFO:teuthology.task.ansible.out: TASK [container-host : Add local docker.io registry mirror] ******************** 2021-02-13T17:50:03.902 INFO:teuthology.task.ansible.out:changed: [gibba036.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.083571", "end": "2021-02-13 17:50:04.051174", "rc": 0, "start": "2021-02-13 17:50:03.967603", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-13T17:50:03.941 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:50:03 +0000 (0:00:00.164) 0:02:10.778 ***** 2021-02-13T17:50:03.960 INFO:teuthology.task.ansible.out:changed: [gibba025.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.079848", "end": "2021-02-13 17:50:03.964181", "rc": 0, "start": "2021-02-13 17:50:03.884333", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-13T17:50:03.998 INFO:teuthology.task.ansible.out:Saturday 13 February 2021 17:50:03 +0000 (0:00:00.057) 0:02:10.835 ***** 2021-02-13T17:50:06.271 INFO:teuthology.task.ansible.out: TASK [container-host : Restart docker service] ********************************* 2021-02-13T17:50:06.272 INFO:teuthology.task.ansible.out:changed: [gibba036.front.sepia.ceph.com] => {"changed": true, "name": "docker", "state": "started", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "basic.target sysinit.target system.slice docker.socket systemd-journald.socket network-online.target firewalld.service containerd.service", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ConsistsOf": "docker.socket", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "yes", "DelegateControllers": "cpu cpuacct io blkio memory devices pids", "Description": "Docker Application Container Engine", "DevicePolicy": "auto", "Documentation": "https://docs.docker.com", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMai 2021-02-13T17:50:06.274 INFO:teuthology.task.ansible.out:nStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/docker.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "docker.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "process", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "infinity", "LimitNOFILESoft": "infinity", "LimitNPROC": "infinity", "LimitNPROCSoft": "infinity", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128079", "LimitSIGPENDINGSoft": "128079 2021-02-13T17:50:06.275 INFO:teuthology.task.ansible.out:", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "docker.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "main", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target docker.socket", "Restart": "always", "RestartUSec": "2s", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "3", "StartLimitIntervalUSec": "1min", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Sat 2021-02-13 17:49:00 UTC", "StateChangeTimestampMonotonic": "94185404", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "Suc 2021-02-13T17:50:06.276 INFO:teuthology.task.ansible.out:cessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "infinity", "TimeoutStartUSec": "infinity", "TimeoutStopUSec": "infinity", "TimerSlackNSec": "50000", "Transient": "no", "TriggeredBy": "docker.socket", "Type": "notify", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "containerd.service network-online.target", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-02-13T17:50:06.366 INFO:teuthology.task.ansible.out:changed: [gibba025.front.sepia.ceph.com] => {"changed": true, "name": "docker", "state": "started", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "firewalld.service containerd.service network-online.target systemd-journald.socket system.slice basic.target sysinit.target docker.socket", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ConsistsOf": "docker.socket", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "yes", "DelegateControllers": "cpu cpuacct io blkio memory devices pids", "Description": "Docker Application Container Engine", "DevicePolicy": "auto", "Documentation": "https://docs.docker.com", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMai 2021-02-13T17:50:06.368 INFO:teuthology.task.ansible.out:nStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/docker.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "docker.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "process", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "infinity", "LimitNOFILESoft": "infinity", "LimitNPROC": "infinity", "LimitNPROCSoft": "infinity", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128079", "LimitSIGPENDINGSoft": "128079 2021-02-13T17:50:06.369 INFO:teuthology.task.ansible.out:", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "docker.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "main", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "docker.socket sysinit.target system.slice", "Restart": "always", "RestartUSec": "2s", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "3", "StartLimitIntervalUSec": "1min", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Sat 2021-02-13 17:49:00 UTC", "StateChangeTimestampMonotonic": "100037449", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "Su 2021-02-13T17:50:06.370 INFO:teuthology.task.ansible.out:ccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "infinity", "TimeoutStartUSec": "infinity", "TimeoutStopUSec": "infinity", "TimerSlackNSec": "50000", "Transient": "no", "TriggeredBy": "docker.socket", "Type": "notify", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "containerd.service network-online.target", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-02-13T17:50:06.466 INFO:teuthology.task.ansible.out: PLAY [cobbler] ***************************************************************** skipping: no hosts matched 2021-02-13T17:50:06.470 INFO:teuthology.task.ansible.out: PLAY [paddles] ***************************************************************** skipping: no hosts matched 2021-02-13T17:50:06.474 INFO:teuthology.task.ansible.out: PLAY [pulpito] ***************************************************************** skipping: no hosts matched 2021-02-13T17:50:06.475 INFO:teuthology.task.ansible.out: PLAY RECAP ********************************************************************* gibba025.front.sepia.ceph.com : ok=126 changed=41 unreachable=0 failed=0 skipped=184 rescued=0 ignored=0 gibba036.front.sepia.ceph.com : ok=126 changed=41 unreachable=0 failed=0 skipped=184 rescued=0 ignored=0 Saturday 13 February 2021 17:50:06 +0000 (0:00:02.476) 0:02:13.311 ***** =============================================================================== users : Create all admin users with sudo access. ----------------------- 14.02s users : Update authorized_keys using the keys repo --------------------- 12.57s container-host : Install container packages ----------------------------- 8.67s testnode : Zap all non-root disks --------------------------------------- 8.02s testnode : Ensure packages are not present. ----------------------------- 7.01s testnode : Install packages --------------------------------------------- 6.89s testnode : Upgrade packages --------------------------------------------- 6.20s users : Remove revoked users -------------------------------------------- 4.23s 2021-02-13T17:50:06.475 INFO:teuthology.task.ansible.out:common : Update apt cache ----------------------------------------------- 2.95s container-host : Install registries-conf-ctl ---------------------------- 2.57s container-host : Restart docker service --------------------------------- 2.48s testnode : Update apt cache. -------------------------------------------- 1.84s Gathering Facts --------------------------------------------------------- 1.35s users : Update authorized_keys for each user with literal keys ---------- 1.31s testnode : Blow away lingering OSD data and FSIDs ----------------------- 1.04s 2021-02-13T17:50:06.476 INFO:teuthology.task.ansible.out:testnode : Install apt keys --------------------------------------------- 0.98s testnode : Create logical volume(s) ------------------------------------- 0.88s users : Clone the keys repo --------------------------------------------- 0.76s testnode : Set the system's hostname ----------- 2021-02-13T17:50:06.477 INFO:teuthology.task.ansible.out:------------------------- 0.72s ansible-managed : Create the cephlab_sudo sudoers.d file. --------------- 0.68s 2021-02-13T17:50:06.795 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@gibba025.front.sepia.ceph.com'), Remote(name='ubuntu@gibba036.front.sepia.ceph.com')] 2021-02-13T17:50:06.796 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-02-13T17:50:06.797 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba025.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-02-13T17:50:06.897 DEBUG:teuthology.orchestra.run.gibba025:> true 2021-02-13T17:50:07.021 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-02-13T17:50:07.021 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba036.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-02-13T17:50:07.081 DEBUG:teuthology.orchestra.run.gibba036:> true 2021-02-13T17:50:07.204 INFO:teuthology.run_tasks:Running task clock... 2021-02-13T17:50:07.216 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2021-02-13T17:50:07.216 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-02-13T17:50:07.217 DEBUG:teuthology.orchestra.run.gibba025:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-02-13T17:50:07.253 INFO:teuthology.orchestra.run.gibba025.stdout:13 Feb 17:50:07 ntpd[10432]: ntpd 4.2.8p10@1.3728-o (1): Starting 2021-02-13T17:50:07.253 INFO:teuthology.orchestra.run.gibba025.stdout:13 Feb 17:50:07 ntpd[10432]: Command line: ntpd -gq 2021-02-13T17:50:07.254 INFO:teuthology.orchestra.run.gibba025.stdout:13 Feb 17:50:07 ntpd[10432]: proto: precision = 0.033 usec (-25) 2021-02-13T17:50:07.254 INFO:teuthology.orchestra.run.gibba025.stdout:13 Feb 17:50:07 ntpd[10432]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-02-13T17:50:07.254 INFO:teuthology.orchestra.run.gibba025.stdout:13 Feb 17:50:07 ntpd[10432]: restrict ::: KOD does nothing without LIMITED. 2021-02-13T17:50:07.255 INFO:teuthology.orchestra.run.gibba025.stdout:13 Feb 17:50:07 ntpd[10432]: Listen and drop on 0 v6wildcard [::]:123 2021-02-13T17:50:07.255 INFO:teuthology.orchestra.run.gibba025.stdout:13 Feb 17:50:07 ntpd[10432]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2021-02-13T17:50:07.255 INFO:teuthology.orchestra.run.gibba025.stdout:13 Feb 17:50:07 ntpd[10432]: Listen normally on 2 lo 127.0.0.1:123 2021-02-13T17:50:07.255 INFO:teuthology.orchestra.run.gibba025.stdout:13 Feb 17:50:07 ntpd[10432]: Listen normally on 3 enp1s0f0 172.21.2.125:123 2021-02-13T17:50:07.255 INFO:teuthology.orchestra.run.gibba025.stdout:13 Feb 17:50:07 ntpd[10432]: Listen normally on 4 lo [::1]:123 2021-02-13T17:50:07.255 INFO:teuthology.orchestra.run.gibba025.stdout:13 Feb 17:50:07 ntpd[10432]: Listen normally on 5 enp1s0f0 [fe80::3eec:efff:fe3d:8e08%2]:123 2021-02-13T17:50:07.255 INFO:teuthology.orchestra.run.gibba025.stdout:13 Feb 17:50:07 ntpd[10432]: Listening on routing socket on fd #22 for interface updates 2021-02-13T17:50:07.255 INFO:teuthology.orchestra.run.gibba025.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-02-13T17:50:07.255 INFO:teuthology.orchestra.run.gibba025.stderr:restrict ::: KOD does nothing without LIMITED. 2021-02-13T17:50:08.254 INFO:teuthology.orchestra.run.gibba025.stderr:13 Feb 17:50:08 ntpd[10432]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-02-13T17:50:08.254 INFO:teuthology.orchestra.run.gibba025.stderr:13 Feb 17:50:08 ntpd[10432]: can't open /var/log/ntpstats/rawstats.20210213: Permission denied 2021-02-13T17:50:08.254 INFO:teuthology.orchestra.run.gibba025.stderr:13 Feb 17:50:08 ntpd[10432]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-02-13T17:50:08.254 INFO:teuthology.orchestra.run.gibba025.stderr:13 Feb 17:50:08 ntpd[10432]: can't open /var/log/ntpstats/peerstats.20210213: Permission denied 2021-02-13T17:50:10.255 INFO:teuthology.orchestra.run.gibba025.stderr:13 Feb 17:50:10 ntpd[10432]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-02-13T17:50:10.256 INFO:teuthology.orchestra.run.gibba025.stderr:13 Feb 17:50:10 ntpd[10432]: can't open /var/log/ntpstats/rawstats.20210213: Permission denied 2021-02-13T17:50:10.256 INFO:teuthology.orchestra.run.gibba025.stderr:13 Feb 17:50:10 ntpd[10432]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-02-13T17:50:10.256 INFO:teuthology.orchestra.run.gibba025.stderr:13 Feb 17:50:10 ntpd[10432]: can't open /var/log/ntpstats/peerstats.20210213: Permission denied 2021-02-13T17:50:11.257 INFO:teuthology.orchestra.run.gibba025.stderr:13 Feb 17:50:11 ntpd[10432]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-02-13T17:50:11.257 INFO:teuthology.orchestra.run.gibba025.stderr:13 Feb 17:50:11 ntpd[10432]: can't open /var/log/ntpstats/rawstats.20210213: Permission denied 2021-02-13T17:50:11.257 INFO:teuthology.orchestra.run.gibba025.stderr:13 Feb 17:50:11 ntpd[10432]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-02-13T17:50:11.257 INFO:teuthology.orchestra.run.gibba025.stderr:13 Feb 17:50:11 ntpd[10432]: can't open /var/log/ntpstats/peerstats.20210213: Permission denied 2021-02-13T17:50:11.257 INFO:teuthology.orchestra.run.gibba025.stderr:13 Feb 17:50:11 ntpd[10432]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-02-13T17:50:11.257 INFO:teuthology.orchestra.run.gibba025.stderr:13 Feb 17:50:11 ntpd[10432]: can't open /var/log/ntpstats/rawstats.20210213: Permission denied 2021-02-13T17:50:11.257 INFO:teuthology.orchestra.run.gibba025.stderr:13 Feb 17:50:11 ntpd[10432]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-02-13T17:50:11.257 INFO:teuthology.orchestra.run.gibba025.stderr:13 Feb 17:50:11 ntpd[10432]: can't open /var/log/ntpstats/peerstats.20210213: Permission denied 2021-02-13T17:50:12.257 INFO:teuthology.orchestra.run.gibba025.stderr:13 Feb 17:50:12 ntpd[10432]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-02-13T17:50:12.257 INFO:teuthology.orchestra.run.gibba025.stderr:13 Feb 17:50:12 ntpd[10432]: can't open /var/log/ntpstats/rawstats.20210213: Permission denied 2021-02-13T17:50:12.257 INFO:teuthology.orchestra.run.gibba025.stderr:13 Feb 17:50:12 ntpd[10432]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-02-13T17:50:12.258 INFO:teuthology.orchestra.run.gibba025.stderr:13 Feb 17:50:12 ntpd[10432]: can't open /var/log/ntpstats/peerstats.20210213: Permission denied 2021-02-13T17:50:12.258 INFO:teuthology.orchestra.run.gibba025.stderr:13 Feb 17:50:12 ntpd[10432]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-02-13T17:50:12.258 INFO:teuthology.orchestra.run.gibba025.stderr:13 Feb 17:50:12 ntpd[10432]: can't open /var/log/ntpstats/rawstats.20210213: Permission denied 2021-02-13T17:50:12.258 INFO:teuthology.orchestra.run.gibba025.stderr:13 Feb 17:50:12 ntpd[10432]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-02-13T17:50:12.258 INFO:teuthology.orchestra.run.gibba025.stderr:13 Feb 17:50:12 ntpd[10432]: can't open /var/log/ntpstats/peerstats.20210213: Permission denied 2021-02-13T17:50:13.257 INFO:teuthology.orchestra.run.gibba025.stderr:13 Feb 17:50:13 ntpd[10432]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-02-13T17:50:13.257 INFO:teuthology.orchestra.run.gibba025.stderr:13 Feb 17:50:13 ntpd[10432]: can't open /var/log/ntpstats/rawstats.20210213: Permission denied 2021-02-13T17:50:13.257 INFO:teuthology.orchestra.run.gibba025.stderr:13 Feb 17:50:13 ntpd[10432]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-02-13T17:50:13.258 INFO:teuthology.orchestra.run.gibba025.stderr:13 Feb 17:50:13 ntpd[10432]: can't open /var/log/ntpstats/peerstats.20210213: Permission denied 2021-02-13T17:50:13.258 INFO:teuthology.orchestra.run.gibba025.stderr:13 Feb 17:50:13 ntpd[10432]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-02-13T17:50:13.258 INFO:teuthology.orchestra.run.gibba025.stderr:13 Feb 17:50:13 ntpd[10432]: can't open /var/log/ntpstats/rawstats.20210213: Permission denied 2021-02-13T17:50:13.258 INFO:teuthology.orchestra.run.gibba025.stderr:13 Feb 17:50:13 ntpd[10432]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-02-13T17:50:13.258 INFO:teuthology.orchestra.run.gibba025.stderr:13 Feb 17:50:13 ntpd[10432]: can't open /var/log/ntpstats/peerstats.20210213: Permission denied 2021-02-13T17:50:14.258 INFO:teuthology.orchestra.run.gibba025.stderr:13 Feb 17:50:14 ntpd[10432]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-02-13T17:50:14.258 INFO:teuthology.orchestra.run.gibba025.stderr:13 Feb 17:50:14 ntpd[10432]: can't open /var/log/ntpstats/rawstats.20210213: Permission denied 2021-02-13T17:50:14.258 INFO:teuthology.orchestra.run.gibba025.stderr:13 Feb 17:50:14 ntpd[10432]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-02-13T17:50:14.258 INFO:teuthology.orchestra.run.gibba025.stderr:13 Feb 17:50:14 ntpd[10432]: can't open /var/log/ntpstats/peerstats.20210213: Permission denied 2021-02-13T17:50:14.258 INFO:teuthology.orchestra.run.gibba025.stderr:13 Feb 17:50:14 ntpd[10432]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-02-13T17:50:14.258 INFO:teuthology.orchestra.run.gibba025.stderr:13 Feb 17:50:14 ntpd[10432]: can't open /var/log/ntpstats/rawstats.20210213: Permission denied 2021-02-13T17:50:14.259 INFO:teuthology.orchestra.run.gibba025.stderr:13 Feb 17:50:14 ntpd[10432]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-02-13T17:50:14.259 INFO:teuthology.orchestra.run.gibba025.stderr:13 Feb 17:50:14 ntpd[10432]: can't open /var/log/ntpstats/peerstats.20210213: Permission denied 2021-02-13T17:50:14.259 INFO:teuthology.orchestra.run.gibba025.stderr:13 Feb 17:50:14 ntpd[10432]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2021-02-13T17:50:14.259 INFO:teuthology.orchestra.run.gibba025.stderr:13 Feb 17:50:14 ntpd[10432]: can't open /var/log/ntpstats/loopstats.20210213: Permission denied 2021-02-13T17:50:14.259 INFO:teuthology.orchestra.run.gibba025.stdout:13 Feb 17:50:14 ntpd[10432]: ntpd: time slew -0.018890 s 2021-02-13T17:50:14.259 INFO:teuthology.orchestra.run.gibba025.stdout:ntpd: time slew -0.018890s 2021-02-13T17:50:14.291 INFO:teuthology.orchestra.run.gibba025.stdout: remote refid st t when poll reach delay offset jitter 2021-02-13T17:50:14.291 INFO:teuthology.orchestra.run.gibba025.stdout:============================================================================== 2021-02-13T17:50:14.291 INFO:teuthology.orchestra.run.gibba025.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-02-13T17:50:14.291 INFO:teuthology.orchestra.run.gibba025.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-02-13T17:50:14.292 INFO:teuthology.orchestra.run.gibba025.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-02-13T17:50:14.292 INFO:teuthology.orchestra.run.gibba025.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-02-13T17:50:14.292 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-02-13T17:50:14.292 DEBUG:teuthology.orchestra.run.gibba036:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-02-13T17:50:14.335 INFO:teuthology.orchestra.run.gibba036.stdout:13 Feb 17:50:14 ntpd[10463]: ntpd 4.2.8p10@1.3728-o (1): Starting 2021-02-13T17:50:14.336 INFO:teuthology.orchestra.run.gibba036.stdout:13 Feb 17:50:14 ntpd[10463]: Command line: ntpd -gq 2021-02-13T17:50:14.336 INFO:teuthology.orchestra.run.gibba036.stdout:13 Feb 17:50:14 ntpd[10463]: proto: precision = 0.043 usec (-24) 2021-02-13T17:50:14.336 INFO:teuthology.orchestra.run.gibba036.stdout:13 Feb 17:50:14 ntpd[10463]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-02-13T17:50:14.336 INFO:teuthology.orchestra.run.gibba036.stdout:13 Feb 17:50:14 ntpd[10463]: restrict ::: KOD does nothing without LIMITED. 2021-02-13T17:50:14.336 INFO:teuthology.orchestra.run.gibba036.stdout:13 Feb 17:50:14 ntpd[10463]: Listen and drop on 0 v6wildcard [::]:123 2021-02-13T17:50:14.336 INFO:teuthology.orchestra.run.gibba036.stdout:13 Feb 17:50:14 ntpd[10463]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2021-02-13T17:50:14.336 INFO:teuthology.orchestra.run.gibba036.stdout:13 Feb 17:50:14 ntpd[10463]: Listen normally on 2 lo 127.0.0.1:123 2021-02-13T17:50:14.336 INFO:teuthology.orchestra.run.gibba036.stdout:13 Feb 17:50:14 ntpd[10463]: Listen normally on 3 enp1s0f0 172.21.2.136:123 2021-02-13T17:50:14.336 INFO:teuthology.orchestra.run.gibba036.stdout:13 Feb 17:50:14 ntpd[10463]: Listen normally on 4 lo [::1]:123 2021-02-13T17:50:14.337 INFO:teuthology.orchestra.run.gibba036.stdout:13 Feb 17:50:14 ntpd[10463]: Listen normally on 5 enp1s0f0 [fe80::3eec:efff:fe3d:8ddc%2]:123 2021-02-13T17:50:14.337 INFO:teuthology.orchestra.run.gibba036.stdout:13 Feb 17:50:14 ntpd[10463]: Listening on routing socket on fd #22 for interface updates 2021-02-13T17:50:14.337 INFO:teuthology.orchestra.run.gibba036.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-02-13T17:50:14.337 INFO:teuthology.orchestra.run.gibba036.stderr:restrict ::: KOD does nothing without LIMITED. 2021-02-13T17:50:16.336 INFO:teuthology.orchestra.run.gibba036.stderr:13 Feb 17:50:16 ntpd[10463]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-02-13T17:50:16.337 INFO:teuthology.orchestra.run.gibba036.stderr:13 Feb 17:50:16 ntpd[10463]: can't open /var/log/ntpstats/rawstats.20210213: Permission denied 2021-02-13T17:50:16.337 INFO:teuthology.orchestra.run.gibba036.stderr:13 Feb 17:50:16 ntpd[10463]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-02-13T17:50:16.337 INFO:teuthology.orchestra.run.gibba036.stderr:13 Feb 17:50:16 ntpd[10463]: can't open /var/log/ntpstats/peerstats.20210213: Permission denied 2021-02-13T17:50:17.337 INFO:teuthology.orchestra.run.gibba036.stderr:13 Feb 17:50:17 ntpd[10463]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-02-13T17:50:17.337 INFO:teuthology.orchestra.run.gibba036.stderr:13 Feb 17:50:17 ntpd[10463]: can't open /var/log/ntpstats/rawstats.20210213: Permission denied 2021-02-13T17:50:17.337 INFO:teuthology.orchestra.run.gibba036.stderr:13 Feb 17:50:17 ntpd[10463]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-02-13T17:50:17.337 INFO:teuthology.orchestra.run.gibba036.stderr:13 Feb 17:50:17 ntpd[10463]: can't open /var/log/ntpstats/peerstats.20210213: Permission denied 2021-02-13T17:50:18.337 INFO:teuthology.orchestra.run.gibba036.stderr:13 Feb 17:50:18 ntpd[10463]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-02-13T17:50:18.338 INFO:teuthology.orchestra.run.gibba036.stderr:13 Feb 17:50:18 ntpd[10463]: can't open /var/log/ntpstats/rawstats.20210213: Permission denied 2021-02-13T17:50:18.338 INFO:teuthology.orchestra.run.gibba036.stderr:13 Feb 17:50:18 ntpd[10463]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-02-13T17:50:18.338 INFO:teuthology.orchestra.run.gibba036.stderr:13 Feb 17:50:18 ntpd[10463]: can't open /var/log/ntpstats/peerstats.20210213: Permission denied 2021-02-13T17:50:19.339 INFO:teuthology.orchestra.run.gibba036.stderr:13 Feb 17:50:19 ntpd[10463]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-02-13T17:50:19.339 INFO:teuthology.orchestra.run.gibba036.stderr:13 Feb 17:50:19 ntpd[10463]: can't open /var/log/ntpstats/rawstats.20210213: Permission denied 2021-02-13T17:50:19.339 INFO:teuthology.orchestra.run.gibba036.stderr:13 Feb 17:50:19 ntpd[10463]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-02-13T17:50:19.340 INFO:teuthology.orchestra.run.gibba036.stderr:13 Feb 17:50:19 ntpd[10463]: can't open /var/log/ntpstats/peerstats.20210213: Permission denied 2021-02-13T17:50:19.340 INFO:teuthology.orchestra.run.gibba036.stderr:13 Feb 17:50:19 ntpd[10463]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-02-13T17:50:19.340 INFO:teuthology.orchestra.run.gibba036.stderr:13 Feb 17:50:19 ntpd[10463]: can't open /var/log/ntpstats/rawstats.20210213: Permission denied 2021-02-13T17:50:19.340 INFO:teuthology.orchestra.run.gibba036.stderr:13 Feb 17:50:19 ntpd[10463]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-02-13T17:50:19.340 INFO:teuthology.orchestra.run.gibba036.stderr:13 Feb 17:50:19 ntpd[10463]: can't open /var/log/ntpstats/peerstats.20210213: Permission denied 2021-02-13T17:50:19.340 INFO:teuthology.orchestra.run.gibba036.stderr:13 Feb 17:50:19 ntpd[10463]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-02-13T17:50:19.340 INFO:teuthology.orchestra.run.gibba036.stderr:13 Feb 17:50:19 ntpd[10463]: can't open /var/log/ntpstats/rawstats.20210213: Permission denied 2021-02-13T17:50:19.340 INFO:teuthology.orchestra.run.gibba036.stderr:13 Feb 17:50:19 ntpd[10463]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-02-13T17:50:19.340 INFO:teuthology.orchestra.run.gibba036.stderr:13 Feb 17:50:19 ntpd[10463]: can't open /var/log/ntpstats/peerstats.20210213: Permission denied 2021-02-13T17:50:20.338 INFO:teuthology.orchestra.run.gibba036.stderr:13 Feb 17:50:20 ntpd[10463]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-02-13T17:50:20.339 INFO:teuthology.orchestra.run.gibba036.stderr:13 Feb 17:50:20 ntpd[10463]: can't open /var/log/ntpstats/rawstats.20210213: Permission denied 2021-02-13T17:50:20.339 INFO:teuthology.orchestra.run.gibba036.stderr:13 Feb 17:50:20 ntpd[10463]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-02-13T17:50:20.339 INFO:teuthology.orchestra.run.gibba036.stderr:13 Feb 17:50:20 ntpd[10463]: can't open /var/log/ntpstats/peerstats.20210213: Permission denied 2021-02-13T17:50:21.340 INFO:teuthology.orchestra.run.gibba036.stderr:13 Feb 17:50:21 ntpd[10463]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-02-13T17:50:21.340 INFO:teuthology.orchestra.run.gibba036.stderr:13 Feb 17:50:21 ntpd[10463]: can't open /var/log/ntpstats/rawstats.20210213: Permission denied 2021-02-13T17:50:21.340 INFO:teuthology.orchestra.run.gibba036.stderr:13 Feb 17:50:21 ntpd[10463]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-02-13T17:50:21.340 INFO:teuthology.orchestra.run.gibba036.stderr:13 Feb 17:50:21 ntpd[10463]: can't open /var/log/ntpstats/peerstats.20210213: Permission denied 2021-02-13T17:50:21.340 INFO:teuthology.orchestra.run.gibba036.stderr:13 Feb 17:50:21 ntpd[10463]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-02-13T17:50:21.340 INFO:teuthology.orchestra.run.gibba036.stderr:13 Feb 17:50:21 ntpd[10463]: can't open /var/log/ntpstats/rawstats.20210213: Permission denied 2021-02-13T17:50:21.340 INFO:teuthology.orchestra.run.gibba036.stderr:13 Feb 17:50:21 ntpd[10463]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-02-13T17:50:21.340 INFO:teuthology.orchestra.run.gibba036.stderr:13 Feb 17:50:21 ntpd[10463]: can't open /var/log/ntpstats/peerstats.20210213: Permission denied 2021-02-13T17:50:21.340 INFO:teuthology.orchestra.run.gibba036.stderr:13 Feb 17:50:21 ntpd[10463]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-02-13T17:50:21.341 INFO:teuthology.orchestra.run.gibba036.stderr:13 Feb 17:50:21 ntpd[10463]: can't open /var/log/ntpstats/rawstats.20210213: Permission denied 2021-02-13T17:50:21.341 INFO:teuthology.orchestra.run.gibba036.stderr:13 Feb 17:50:21 ntpd[10463]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-02-13T17:50:21.341 INFO:teuthology.orchestra.run.gibba036.stderr:13 Feb 17:50:21 ntpd[10463]: can't open /var/log/ntpstats/peerstats.20210213: Permission denied 2021-02-13T17:50:22.340 INFO:teuthology.orchestra.run.gibba036.stderr:13 Feb 17:50:22 ntpd[10463]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-02-13T17:50:22.341 INFO:teuthology.orchestra.run.gibba036.stderr:13 Feb 17:50:22 ntpd[10463]: can't open /var/log/ntpstats/rawstats.20210213: Permission denied 2021-02-13T17:50:22.341 INFO:teuthology.orchestra.run.gibba036.stderr:13 Feb 17:50:22 ntpd[10463]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-02-13T17:50:22.341 INFO:teuthology.orchestra.run.gibba036.stderr:13 Feb 17:50:22 ntpd[10463]: can't open /var/log/ntpstats/peerstats.20210213: Permission denied 2021-02-13T17:50:22.341 INFO:teuthology.orchestra.run.gibba036.stderr:13 Feb 17:50:22 ntpd[10463]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2021-02-13T17:50:22.342 INFO:teuthology.orchestra.run.gibba036.stderr:13 Feb 17:50:22 ntpd[10463]: can't open /var/log/ntpstats/loopstats.20210213: Permission denied 2021-02-13T17:50:22.342 INFO:teuthology.orchestra.run.gibba036.stdout:13 Feb 17:50:22 ntpd[10463]: ntpd: time set -0.156744 s 2021-02-13T17:50:22.342 INFO:teuthology.orchestra.run.gibba036.stdout:ntpd: time set -0.156744s 2021-02-13T17:50:22.370 INFO:teuthology.orchestra.run.gibba036.stdout: remote refid st t when poll reach delay offset jitter 2021-02-13T17:50:22.371 INFO:teuthology.orchestra.run.gibba036.stdout:============================================================================== 2021-02-13T17:50:22.371 INFO:teuthology.orchestra.run.gibba036.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-02-13T17:50:22.371 INFO:teuthology.orchestra.run.gibba036.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-02-13T17:50:22.371 INFO:teuthology.orchestra.run.gibba036.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-02-13T17:50:22.371 INFO:teuthology.orchestra.run.gibba036.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-02-13T17:50:22.372 INFO:teuthology.run_tasks:Running task install... 2021-02-13T17:50:22.392 DEBUG:teuthology.task.install:project ceph 2021-02-13T17:50:22.392 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'sha1': '7194982cc16a1fd51df59ee58e1c54797c4465d1'}} 2021-02-13T17:50:22.392 DEBUG:teuthology.task.install:config {'sha1': '7194982cc16a1fd51df59ee58e1c54797c4465d1'} 2021-02-13T17:50:22.392 INFO:teuthology.task.install:Using flavor: basic 2021-02-13T17:50:22.399 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python-ceph', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-cloud', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-ssh', 'ceph-fuse', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python-ceph', 'rbd-fuse']} 2021-02-13T17:50:22.399 INFO:teuthology.task.install:extra packages: [] 2021-02-13T17:50:22.400 DEBUG:teuthology.orchestra.run.gibba025:> sudo lsb_release -is 2021-02-13T17:50:22.428 INFO:teuthology.orchestra.run.gibba025.stdout:Ubuntu 2021-02-13T17:50:22.431 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-02-13T17:50:22.431 DEBUG:teuthology.orchestra.run.gibba036:> sudo lsb_release -is 2021-02-13T17:50:22.431 DEBUG:teuthology.orchestra.run.gibba025:> sudo apt-key list | grep Ceph 2021-02-13T17:50:22.468 INFO:teuthology.orchestra.run.gibba036.stdout:Ubuntu 2021-02-13T17:50:22.472 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-02-13T17:50:22.473 DEBUG:teuthology.orchestra.run.gibba036:> sudo apt-key list | grep Ceph 2021-02-13T17:50:22.532 INFO:teuthology.orchestra.run.gibba025.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2021-02-13T17:50:22.550 INFO:teuthology.orchestra.run.gibba025.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2021-02-13T17:50:22.550 INFO:teuthology.orchestra.run.gibba025.stdout:uid [ unknown] Ceph.com (release key) 2021-02-13T17:50:22.550 DEBUG:teuthology.orchestra.run.gibba025:> sudo lsb_release -is 2021-02-13T17:50:22.565 INFO:teuthology.orchestra.run.gibba036.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2021-02-13T17:50:22.575 INFO:teuthology.orchestra.run.gibba025.stdout:Ubuntu 2021-02-13T17:50:22.578 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-02-13T17:50:22.579 INFO:teuthology.task.install.deb:Installing packages: ceph, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python-ceph, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2021-02-13T17:50:22.579 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1=7194982cc16a1fd51df59ee58e1c54797c4465d1 2021-02-13T17:50:22.605 INFO:teuthology.orchestra.run.gibba036.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2021-02-13T17:50:22.605 INFO:teuthology.orchestra.run.gibba036.stdout:uid [ unknown] Ceph.com (release key) 2021-02-13T17:50:22.606 DEBUG:teuthology.orchestra.run.gibba036:> sudo lsb_release -is 2021-02-13T17:50:22.643 INFO:teuthology.orchestra.run.gibba036.stdout:Ubuntu 2021-02-13T17:50:22.648 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-02-13T17:50:22.648 INFO:teuthology.task.install.deb:Installing packages: ceph, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python-ceph, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2021-02-13T17:50:22.648 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1=7194982cc16a1fd51df59ee58e1c54797c4465d1 2021-02-13T17:50:22.756 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default/ 2021-02-13T17:50:22.756 INFO:teuthology.task.install.deb:Package version is 14.2.16-285-g7194982c-1bionic 2021-02-13T17:50:22.812 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default/ 2021-02-13T17:50:22.812 INFO:teuthology.task.install.deb:Package version is 14.2.16-285-g7194982c-1bionic 2021-02-13T17:50:22.887 DEBUG:teuthology.orchestra.run.gibba025:> set -ex 2021-02-13T17:50:22.887 DEBUG:teuthology.orchestra.run.gibba025:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2021-02-13T17:50:22.934 DEBUG:teuthology.orchestra.run.gibba025:> sudo apt-get update 2021-02-13T17:50:22.936 DEBUG:teuthology.orchestra.run.gibba036:> set -ex 2021-02-13T17:50:22.937 DEBUG:teuthology.orchestra.run.gibba036:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2021-02-13T17:50:22.948 DEBUG:teuthology.orchestra.run.gibba036:> sudo apt-get update 2021-02-13T17:50:23.059 INFO:teuthology.orchestra.run.gibba025.stdout:Hit:1 http://security.ubuntu.com/ubuntu bionic-security InRelease 2021-02-13T17:50:23.129 INFO:teuthology.orchestra.run.gibba025.stdout:Ign:2 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic InRelease 2021-02-13T17:50:23.133 INFO:teuthology.orchestra.run.gibba036.stdout:Ign:1 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic InRelease 2021-02-13T17:50:23.151 INFO:teuthology.orchestra.run.gibba025.stdout:Get:3 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic Release [7,663 B] 2021-02-13T17:50:23.157 INFO:teuthology.orchestra.run.gibba036.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic Release [7,663 B] 2021-02-13T17:50:23.173 INFO:teuthology.orchestra.run.gibba025.stdout:Hit:4 http://archive.ubuntu.com/ubuntu bionic InRelease 2021-02-13T17:50:23.174 INFO:teuthology.orchestra.run.gibba025.stdout:Ign:5 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic Release.gpg 2021-02-13T17:50:23.183 INFO:teuthology.orchestra.run.gibba036.stdout:Ign:3 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic Release.gpg 2021-02-13T17:50:23.197 INFO:teuthology.orchestra.run.gibba036.stdout:Hit:4 http://archive.ubuntu.com/ubuntu bionic InRelease 2021-02-13T17:50:23.197 INFO:teuthology.orchestra.run.gibba036.stdout:Hit:5 http://security.ubuntu.com/ubuntu bionic-security InRelease 2021-02-13T17:50:23.198 INFO:teuthology.orchestra.run.gibba025.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main i386 Packages [2,585 B] 2021-02-13T17:50:23.206 INFO:teuthology.orchestra.run.gibba036.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main i386 Packages [2,585 B] 2021-02-13T17:50:23.224 INFO:teuthology.orchestra.run.gibba025.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 Packages [15.7 kB] 2021-02-13T17:50:23.233 INFO:teuthology.orchestra.run.gibba036.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 Packages [15.7 kB] 2021-02-13T17:50:23.252 INFO:teuthology.orchestra.run.gibba025.stdout:Hit:8 http://archive.ubuntu.com/ubuntu bionic-updates InRelease 2021-02-13T17:50:23.268 INFO:teuthology.orchestra.run.gibba036.stdout:Hit:8 http://archive.ubuntu.com/ubuntu bionic-updates InRelease 2021-02-13T17:50:23.332 INFO:teuthology.orchestra.run.gibba025.stdout:Hit:9 http://archive.ubuntu.com/ubuntu bionic-backports InRelease 2021-02-13T17:50:23.346 INFO:teuthology.orchestra.run.gibba036.stdout:Hit:9 http://archive.ubuntu.com/ubuntu bionic-backports InRelease 2021-02-13T17:50:23.409 INFO:teuthology.orchestra.run.gibba025.stdout:Fetched 26.0 kB in 0s (72.7 kB/s) 2021-02-13T17:50:23.619 INFO:teuthology.orchestra.run.gibba036.stdout:Fetched 26.0 kB in 1s (51.5 kB/s) 2021-02-13T17:50:24.292 INFO:teuthology.orchestra.run.gibba025.stdout:Reading package lists... 2021-02-13T17:50:24.317 DEBUG:teuthology.orchestra.run.gibba025:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=14.2.16-285-g7194982c-1bionic ceph-mds=14.2.16-285-g7194982c-1bionic ceph-mgr=14.2.16-285-g7194982c-1bionic ceph-common=14.2.16-285-g7194982c-1bionic ceph-fuse=14.2.16-285-g7194982c-1bionic ceph-test=14.2.16-285-g7194982c-1bionic radosgw=14.2.16-285-g7194982c-1bionic python-ceph=14.2.16-285-g7194982c-1bionic libcephfs2=14.2.16-285-g7194982c-1bionic libcephfs-dev=14.2.16-285-g7194982c-1bionic librados2=14.2.16-285-g7194982c-1bionic librbd1=14.2.16-285-g7194982c-1bionic rbd-fuse=14.2.16-285-g7194982c-1bionic 2021-02-13T17:50:24.367 INFO:teuthology.orchestra.run.gibba025.stdout:Reading package lists... 2021-02-13T17:50:24.452 INFO:teuthology.orchestra.run.gibba036.stdout:Reading package lists... 2021-02-13T17:50:24.477 DEBUG:teuthology.orchestra.run.gibba036:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=14.2.16-285-g7194982c-1bionic ceph-mds=14.2.16-285-g7194982c-1bionic ceph-mgr=14.2.16-285-g7194982c-1bionic ceph-common=14.2.16-285-g7194982c-1bionic ceph-fuse=14.2.16-285-g7194982c-1bionic ceph-test=14.2.16-285-g7194982c-1bionic radosgw=14.2.16-285-g7194982c-1bionic python-ceph=14.2.16-285-g7194982c-1bionic libcephfs2=14.2.16-285-g7194982c-1bionic libcephfs-dev=14.2.16-285-g7194982c-1bionic librados2=14.2.16-285-g7194982c-1bionic librbd1=14.2.16-285-g7194982c-1bionic rbd-fuse=14.2.16-285-g7194982c-1bionic 2021-02-13T17:50:24.523 INFO:teuthology.orchestra.run.gibba036.stdout:Reading package lists... 2021-02-13T17:50:24.563 INFO:teuthology.orchestra.run.gibba025.stdout:Building dependency tree... 2021-02-13T17:50:24.563 INFO:teuthology.orchestra.run.gibba025.stdout:Reading state information... 2021-02-13T17:50:24.683 INFO:teuthology.orchestra.run.gibba025.stdout:The following additional packages will be installed: 2021-02-13T17:50:24.683 INFO:teuthology.orchestra.run.gibba025.stdout: ceph-base ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2021-02-13T17:50:24.683 INFO:teuthology.orchestra.run.gibba025.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-rook ceph-mgr-ssh 2021-02-13T17:50:24.683 INFO:teuthology.orchestra.run.gibba025.stdout: ceph-mon ceph-osd formencode-i18n jq libjq1 libjs-sphinxdoc libjs-underscore 2021-02-13T17:50:24.683 INFO:teuthology.orchestra.run.gibba025.stdout: libleveldb1v5 liblttng-ust0 liboath0 libonig4 librabbitmq4 libradosstriper1 2021-02-13T17:50:24.683 INFO:teuthology.orchestra.run.gibba025.stdout: librgw2 libsnappy1v5 libxslt1.1 nvme-cli python-attr python-bcrypt 2021-02-13T17:50:24.683 INFO:teuthology.orchestra.run.gibba025.stdout: python-bs4 python-ceph-argparse python-cephfs python-certifi python-chardet 2021-02-13T17:50:24.683 INFO:teuthology.orchestra.run.gibba025.stdout: python-cherrypy3 python-decorator python-dnspython python-fasteners 2021-02-13T17:50:24.684 INFO:teuthology.orchestra.run.gibba025.stdout: python-formencode python-funcsigs python-html5lib python-httplib2 2021-02-13T17:50:24.684 INFO:teuthology.orchestra.run.gibba025.stdout: python-joblib python-jwt python-kubernetes python-logutils python-lxml 2021-02-13T17:50:24.684 INFO:teuthology.orchestra.run.gibba025.stdout: python-mako python-markupsafe python-monotonic python-oauth2client 2021-02-13T17:50:24.684 INFO:teuthology.orchestra.run.gibba025.stdout: python-openid python-openssl python-paste python-pastedeploy 2021-02-13T17:50:24.684 INFO:teuthology.orchestra.run.gibba025.stdout: python-pastedeploy-tpl python-pastescript python-pecan python-pluggy 2021-02-13T17:50:24.684 INFO:teuthology.orchestra.run.gibba025.stdout: python-prettytable python-py python-pyasn1 python-pyasn1-modules 2021-02-13T17:50:24.684 INFO:teuthology.orchestra.run.gibba025.stdout: python-pyinotify python-pytest python-rados python-rbd python-repoze.lru 2021-02-13T17:50:24.684 INFO:teuthology.orchestra.run.gibba025.stdout: python-requests python-rgw python-routes python-rsa python-scgi python-scipy 2021-02-13T17:50:24.684 INFO:teuthology.orchestra.run.gibba025.stdout: python-simplegeneric python-simplejson python-singledispatch python-sklearn 2021-02-13T17:50:24.684 INFO:teuthology.orchestra.run.gibba025.stdout: python-sklearn-lib python-sqlalchemy python-sqlalchemy-ext python-tempita 2021-02-13T17:50:24.684 INFO:teuthology.orchestra.run.gibba025.stdout: python-uritemplate python-urllib3 python-waitress python-webencodings 2021-02-13T17:50:24.684 INFO:teuthology.orchestra.run.gibba025.stdout: python-webob python-websocket python-webtest python-werkzeug python-yaml 2021-02-13T17:50:24.685 INFO:teuthology.orchestra.run.gibba025.stdout: socat xmlstarlet 2021-02-13T17:50:24.685 INFO:teuthology.orchestra.run.gibba025.stdout:Suggested packages: 2021-02-13T17:50:24.685 INFO:teuthology.orchestra.run.gibba025.stdout: python-influxdb python-attr-doc python-egenix-mxdatetime python-funcsigs-doc 2021-02-13T17:50:24.685 INFO:teuthology.orchestra.run.gibba025.stdout: python-genshi python-lxml-dbg python-lxml-doc python-beaker python-mako-doc 2021-02-13T17:50:24.685 INFO:teuthology.orchestra.run.gibba025.stdout: python-openssl-doc python-openssl-dbg httpd-wsgi libapache2-mod-python 2021-02-13T17:50:24.685 INFO:teuthology.orchestra.run.gibba025.stdout: libapache2-mod-scgi libjs-mochikit python-pastewebkit python-cheetah 2021-02-13T17:50:24.685 INFO:teuthology.orchestra.run.gibba025.stdout: python-cherrypy python-flup python-pecan-doc subversion python-pytest-xdist 2021-02-13T17:50:24.685 INFO:teuthology.orchestra.run.gibba025.stdout: python-pyinotify-doc python-mock python-socks python-scipy-doc python-dap 2021-02-13T17:50:24.685 INFO:teuthology.orchestra.run.gibba025.stdout: python-scikits-optimization python-sklearn-doc ipython python-sqlalchemy-doc 2021-02-13T17:50:24.685 INFO:teuthology.orchestra.run.gibba025.stdout: python-psycopg2 python-pymysql python-fdb python-pymssql python-ntlm 2021-02-13T17:50:24.685 INFO:teuthology.orchestra.run.gibba025.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-pyquery 2021-02-13T17:50:24.685 INFO:teuthology.orchestra.run.gibba025.stdout: python-redis python-pylibmc | python-memcache python-termcolor 2021-02-13T17:50:24.685 INFO:teuthology.orchestra.run.gibba025.stdout: python-watchdog python-werkzeug-doc 2021-02-13T17:50:24.690 INFO:teuthology.orchestra.run.gibba036.stdout:Building dependency tree... 2021-02-13T17:50:24.690 INFO:teuthology.orchestra.run.gibba036.stdout:Reading state information... 2021-02-13T17:50:24.733 INFO:teuthology.orchestra.run.gibba025.stdout:The following NEW packages will be installed: 2021-02-13T17:50:24.733 INFO:teuthology.orchestra.run.gibba025.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-dashboard 2021-02-13T17:50:24.734 INFO:teuthology.orchestra.run.gibba025.stdout: ceph-mgr-diskprediction-cloud ceph-mgr-diskprediction-local 2021-02-13T17:50:24.734 INFO:teuthology.orchestra.run.gibba025.stdout: ceph-mgr-k8sevents ceph-mgr-rook ceph-mgr-ssh ceph-mon ceph-osd ceph-test 2021-02-13T17:50:24.734 INFO:teuthology.orchestra.run.gibba025.stdout: formencode-i18n jq libcephfs-dev libcephfs2 libjq1 libjs-sphinxdoc 2021-02-13T17:50:24.734 INFO:teuthology.orchestra.run.gibba025.stdout: libjs-underscore libleveldb1v5 liblttng-ust0 liboath0 libonig4 librabbitmq4 2021-02-13T17:50:24.734 INFO:teuthology.orchestra.run.gibba025.stdout: libradosstriper1 librgw2 libsnappy1v5 libxslt1.1 nvme-cli python-attr 2021-02-13T17:50:24.734 INFO:teuthology.orchestra.run.gibba025.stdout: python-bcrypt python-bs4 python-ceph python-ceph-argparse python-cephfs 2021-02-13T17:50:24.734 INFO:teuthology.orchestra.run.gibba025.stdout: python-certifi python-chardet python-cherrypy3 python-decorator 2021-02-13T17:50:24.734 INFO:teuthology.orchestra.run.gibba025.stdout: python-dnspython python-fasteners python-formencode python-funcsigs 2021-02-13T17:50:24.734 INFO:teuthology.orchestra.run.gibba025.stdout: python-html5lib python-httplib2 python-joblib python-jwt python-kubernetes 2021-02-13T17:50:24.734 INFO:teuthology.orchestra.run.gibba025.stdout: python-logutils python-lxml python-mako python-markupsafe python-monotonic 2021-02-13T17:50:24.734 INFO:teuthology.orchestra.run.gibba025.stdout: python-oauth2client python-openid python-openssl python-paste 2021-02-13T17:50:24.734 INFO:teuthology.orchestra.run.gibba025.stdout: python-pastedeploy python-pastedeploy-tpl python-pastescript python-pecan 2021-02-13T17:50:24.735 INFO:teuthology.orchestra.run.gibba025.stdout: python-pluggy python-prettytable python-py python-pyasn1 2021-02-13T17:50:24.735 INFO:teuthology.orchestra.run.gibba025.stdout: python-pyasn1-modules python-pyinotify python-pytest python-rados python-rbd 2021-02-13T17:50:24.735 INFO:teuthology.orchestra.run.gibba025.stdout: python-repoze.lru python-requests python-rgw python-routes python-rsa 2021-02-13T17:50:24.735 INFO:teuthology.orchestra.run.gibba025.stdout: python-scgi python-scipy python-simplegeneric python-simplejson 2021-02-13T17:50:24.735 INFO:teuthology.orchestra.run.gibba025.stdout: python-singledispatch python-sklearn python-sklearn-lib python-sqlalchemy 2021-02-13T17:50:24.735 INFO:teuthology.orchestra.run.gibba025.stdout: python-sqlalchemy-ext python-tempita python-uritemplate python-urllib3 2021-02-13T17:50:24.735 INFO:teuthology.orchestra.run.gibba025.stdout: python-waitress python-webencodings python-webob python-websocket 2021-02-13T17:50:24.735 INFO:teuthology.orchestra.run.gibba025.stdout: python-webtest python-werkzeug python-yaml radosgw rbd-fuse socat xmlstarlet 2021-02-13T17:50:24.735 INFO:teuthology.orchestra.run.gibba025.stdout:The following packages will be upgraded: 2021-02-13T17:50:24.736 INFO:teuthology.orchestra.run.gibba025.stdout: librados2 librbd1 2021-02-13T17:50:24.789 INFO:teuthology.orchestra.run.gibba036.stdout:The following additional packages will be installed: 2021-02-13T17:50:24.789 INFO:teuthology.orchestra.run.gibba036.stdout: ceph-base ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2021-02-13T17:50:24.789 INFO:teuthology.orchestra.run.gibba036.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-rook ceph-mgr-ssh 2021-02-13T17:50:24.789 INFO:teuthology.orchestra.run.gibba036.stdout: ceph-mon ceph-osd formencode-i18n jq libjq1 libjs-sphinxdoc libjs-underscore 2021-02-13T17:50:24.789 INFO:teuthology.orchestra.run.gibba036.stdout: libleveldb1v5 liblttng-ust0 liboath0 libonig4 librabbitmq4 libradosstriper1 2021-02-13T17:50:24.789 INFO:teuthology.orchestra.run.gibba036.stdout: librgw2 libsnappy1v5 libxslt1.1 nvme-cli python-attr python-bcrypt 2021-02-13T17:50:24.789 INFO:teuthology.orchestra.run.gibba036.stdout: python-bs4 python-ceph-argparse python-cephfs python-certifi python-chardet 2021-02-13T17:50:24.789 INFO:teuthology.orchestra.run.gibba036.stdout: python-cherrypy3 python-decorator python-dnspython python-fasteners 2021-02-13T17:50:24.789 INFO:teuthology.orchestra.run.gibba036.stdout: python-formencode python-funcsigs python-html5lib python-httplib2 2021-02-13T17:50:24.789 INFO:teuthology.orchestra.run.gibba036.stdout: python-joblib python-jwt python-kubernetes python-logutils python-lxml 2021-02-13T17:50:24.790 INFO:teuthology.orchestra.run.gibba036.stdout: python-mako python-markupsafe python-monotonic python-oauth2client 2021-02-13T17:50:24.790 INFO:teuthology.orchestra.run.gibba036.stdout: python-openid python-openssl python-paste python-pastedeploy 2021-02-13T17:50:24.790 INFO:teuthology.orchestra.run.gibba036.stdout: python-pastedeploy-tpl python-pastescript python-pecan python-pluggy 2021-02-13T17:50:24.790 INFO:teuthology.orchestra.run.gibba036.stdout: python-prettytable python-py python-pyasn1 python-pyasn1-modules 2021-02-13T17:50:24.790 INFO:teuthology.orchestra.run.gibba036.stdout: python-pyinotify python-pytest python-rados python-rbd python-repoze.lru 2021-02-13T17:50:24.790 INFO:teuthology.orchestra.run.gibba036.stdout: python-requests python-rgw python-routes python-rsa python-scgi python-scipy 2021-02-13T17:50:24.790 INFO:teuthology.orchestra.run.gibba036.stdout: python-simplegeneric python-simplejson python-singledispatch python-sklearn 2021-02-13T17:50:24.790 INFO:teuthology.orchestra.run.gibba036.stdout: python-sklearn-lib python-sqlalchemy python-sqlalchemy-ext python-tempita 2021-02-13T17:50:24.790 INFO:teuthology.orchestra.run.gibba036.stdout: python-uritemplate python-urllib3 python-waitress python-webencodings 2021-02-13T17:50:24.790 INFO:teuthology.orchestra.run.gibba036.stdout: python-webob python-websocket python-webtest python-werkzeug python-yaml 2021-02-13T17:50:24.790 INFO:teuthology.orchestra.run.gibba036.stdout: socat xmlstarlet 2021-02-13T17:50:24.791 INFO:teuthology.orchestra.run.gibba036.stdout:Suggested packages: 2021-02-13T17:50:24.791 INFO:teuthology.orchestra.run.gibba036.stdout: python-influxdb python-attr-doc python-egenix-mxdatetime python-funcsigs-doc 2021-02-13T17:50:24.791 INFO:teuthology.orchestra.run.gibba036.stdout: python-genshi python-lxml-dbg python-lxml-doc python-beaker python-mako-doc 2021-02-13T17:50:24.791 INFO:teuthology.orchestra.run.gibba036.stdout: python-openssl-doc python-openssl-dbg httpd-wsgi libapache2-mod-python 2021-02-13T17:50:24.791 INFO:teuthology.orchestra.run.gibba036.stdout: libapache2-mod-scgi libjs-mochikit python-pastewebkit python-cheetah 2021-02-13T17:50:24.791 INFO:teuthology.orchestra.run.gibba036.stdout: python-cherrypy python-flup python-pecan-doc subversion python-pytest-xdist 2021-02-13T17:50:24.791 INFO:teuthology.orchestra.run.gibba036.stdout: python-pyinotify-doc python-mock python-socks python-scipy-doc python-dap 2021-02-13T17:50:24.791 INFO:teuthology.orchestra.run.gibba036.stdout: python-scikits-optimization python-sklearn-doc ipython python-sqlalchemy-doc 2021-02-13T17:50:24.792 INFO:teuthology.orchestra.run.gibba036.stdout: python-psycopg2 python-pymysql python-fdb python-pymssql python-ntlm 2021-02-13T17:50:24.792 INFO:teuthology.orchestra.run.gibba036.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-pyquery 2021-02-13T17:50:24.792 INFO:teuthology.orchestra.run.gibba036.stdout: python-redis python-pylibmc | python-memcache python-termcolor 2021-02-13T17:50:24.792 INFO:teuthology.orchestra.run.gibba036.stdout: python-watchdog python-werkzeug-doc 2021-02-13T17:50:24.839 INFO:teuthology.orchestra.run.gibba036.stdout:The following NEW packages will be installed: 2021-02-13T17:50:24.839 INFO:teuthology.orchestra.run.gibba036.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-dashboard 2021-02-13T17:50:24.839 INFO:teuthology.orchestra.run.gibba036.stdout: ceph-mgr-diskprediction-cloud ceph-mgr-diskprediction-local 2021-02-13T17:50:24.839 INFO:teuthology.orchestra.run.gibba036.stdout: ceph-mgr-k8sevents ceph-mgr-rook ceph-mgr-ssh ceph-mon ceph-osd ceph-test 2021-02-13T17:50:24.839 INFO:teuthology.orchestra.run.gibba036.stdout: formencode-i18n jq libcephfs-dev libcephfs2 libjq1 libjs-sphinxdoc 2021-02-13T17:50:24.839 INFO:teuthology.orchestra.run.gibba036.stdout: libjs-underscore libleveldb1v5 liblttng-ust0 liboath0 libonig4 librabbitmq4 2021-02-13T17:50:24.841 INFO:teuthology.orchestra.run.gibba036.stdout: libradosstriper1 librgw2 libsnappy1v5 libxslt1.1 nvme-cli python-attr 2021-02-13T17:50:24.841 INFO:teuthology.orchestra.run.gibba036.stdout: python-bcrypt python-bs4 python-ceph python-ceph-argparse python-cephfs 2021-02-13T17:50:24.841 INFO:teuthology.orchestra.run.gibba036.stdout: python-certifi python-chardet python-cherrypy3 python-decorator 2021-02-13T17:50:24.841 INFO:teuthology.orchestra.run.gibba036.stdout: python-dnspython python-fasteners python-formencode python-funcsigs 2021-02-13T17:50:24.841 INFO:teuthology.orchestra.run.gibba036.stdout: python-html5lib python-httplib2 python-joblib python-jwt python-kubernetes 2021-02-13T17:50:24.841 INFO:teuthology.orchestra.run.gibba036.stdout: python-logutils python-lxml python-mako python-markupsafe python-monotonic 2021-02-13T17:50:24.841 INFO:teuthology.orchestra.run.gibba036.stdout: python-oauth2client python-openid python-openssl python-paste 2021-02-13T17:50:24.841 INFO:teuthology.orchestra.run.gibba036.stdout: python-pastedeploy python-pastedeploy-tpl python-pastescript python-pecan 2021-02-13T17:50:24.841 INFO:teuthology.orchestra.run.gibba036.stdout: python-pluggy python-prettytable python-py python-pyasn1 2021-02-13T17:50:24.841 INFO:teuthology.orchestra.run.gibba036.stdout: python-pyasn1-modules python-pyinotify python-pytest python-rados python-rbd 2021-02-13T17:50:24.841 INFO:teuthology.orchestra.run.gibba036.stdout: python-repoze.lru python-requests python-rgw python-routes python-rsa 2021-02-13T17:50:24.842 INFO:teuthology.orchestra.run.gibba036.stdout: python-scgi python-scipy python-simplegeneric python-simplejson 2021-02-13T17:50:24.842 INFO:teuthology.orchestra.run.gibba036.stdout: python-singledispatch python-sklearn python-sklearn-lib python-sqlalchemy 2021-02-13T17:50:24.842 INFO:teuthology.orchestra.run.gibba036.stdout: python-sqlalchemy-ext python-tempita python-uritemplate python-urllib3 2021-02-13T17:50:24.842 INFO:teuthology.orchestra.run.gibba036.stdout: python-waitress python-webencodings python-webob python-websocket 2021-02-13T17:50:24.842 INFO:teuthology.orchestra.run.gibba036.stdout: python-webtest python-werkzeug python-yaml radosgw rbd-fuse socat xmlstarlet 2021-02-13T17:50:24.842 INFO:teuthology.orchestra.run.gibba036.stdout:The following packages will be upgraded: 2021-02-13T17:50:24.842 INFO:teuthology.orchestra.run.gibba036.stdout: librados2 librbd1 2021-02-13T17:50:24.873 INFO:teuthology.orchestra.run.gibba025.stdout:2 upgraded, 101 newly installed, 0 to remove and 78 not upgraded. 2021-02-13T17:50:24.873 INFO:teuthology.orchestra.run.gibba025.stdout:Need to get 109 MB of archives. 2021-02-13T17:50:24.873 INFO:teuthology.orchestra.run.gibba025.stdout:After this operation, 484 MB of additional disk space will be used. 2021-02-13T17:50:24.873 INFO:teuthology.orchestra.run.gibba025.stdout:Get:1 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 librbd1 amd64 14.2.16-285-g7194982c-1bionic [1,478 kB] 2021-02-13T17:50:24.905 INFO:teuthology.orchestra.run.gibba025.stdout:Get:2 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-uritemplate all 0.6-1ubuntu1 [5,042 B] 2021-02-13T17:50:24.978 INFO:teuthology.orchestra.run.gibba036.stdout:2 upgraded, 101 newly installed, 0 to remove and 78 not upgraded. 2021-02-13T17:50:24.978 INFO:teuthology.orchestra.run.gibba036.stdout:Need to get 109 MB of archives. 2021-02-13T17:50:24.978 INFO:teuthology.orchestra.run.gibba036.stdout:After this operation, 484 MB of additional disk space will be used. 2021-02-13T17:50:24.978 INFO:teuthology.orchestra.run.gibba036.stdout:Get:1 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 librbd1 amd64 14.2.16-285-g7194982c-1bionic [1,478 kB] 2021-02-13T17:50:24.985 INFO:teuthology.orchestra.run.gibba025.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic/universe amd64 liblttng-ust0 amd64 2.10.1-1 [154 kB] 2021-02-13T17:50:25.011 INFO:teuthology.orchestra.run.gibba036.stdout:Get:2 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-uritemplate all 0.6-1ubuntu1 [5,042 B] 2021-02-13T17:50:25.039 INFO:teuthology.orchestra.run.gibba025.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 librados2 amd64 14.2.16-285-g7194982c-1bionic [3,018 kB] 2021-02-13T17:50:25.091 INFO:teuthology.orchestra.run.gibba036.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic/universe amd64 liblttng-ust0 amd64 2.10.1-1 [154 kB] 2021-02-13T17:50:25.174 INFO:teuthology.orchestra.run.gibba036.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 librados2 amd64 14.2.16-285-g7194982c-1bionic [3,018 kB] 2021-02-13T17:50:25.184 INFO:teuthology.orchestra.run.gibba025.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 libcephfs2 amd64 14.2.16-285-g7194982c-1bionic [442 kB] 2021-02-13T17:50:25.206 INFO:teuthology.orchestra.run.gibba025.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 python-rados amd64 14.2.16-285-g7194982c-1bionic [290 kB] 2021-02-13T17:50:25.232 INFO:teuthology.orchestra.run.gibba025.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 python-ceph-argparse all 14.2.16-285-g7194982c-1bionic [20.2 kB] 2021-02-13T17:50:25.234 INFO:teuthology.orchestra.run.gibba025.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 python-cephfs amd64 14.2.16-285-g7194982c-1bionic [124 kB] 2021-02-13T17:50:25.237 INFO:teuthology.orchestra.run.gibba025.stdout:Get:9 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-prettytable all 0.7.2-3 [19.6 kB] 2021-02-13T17:50:25.239 INFO:teuthology.orchestra.run.gibba025.stdout:Get:10 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 python-rbd amd64 14.2.16-285-g7194982c-1bionic [264 kB] 2021-02-13T17:50:25.248 INFO:teuthology.orchestra.run.gibba025.stdout:Get:11 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 librgw2 amd64 14.2.16-285-g7194982c-1bionic [4,303 kB] 2021-02-13T17:50:25.250 INFO:teuthology.orchestra.run.gibba025.stdout:Get:12 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 librabbitmq4 amd64 0.8.0-1ubuntu0.18.04.2 [33.9 kB] 2021-02-13T17:50:25.267 INFO:teuthology.orchestra.run.gibba025.stdout:Get:13 http://archive.ubuntu.com/ubuntu bionic/main amd64 libsnappy1v5 amd64 1.1.7-1 [16.0 kB] 2021-02-13T17:50:25.275 INFO:teuthology.orchestra.run.gibba025.stdout:Get:14 http://archive.ubuntu.com/ubuntu bionic/main amd64 libleveldb1v5 amd64 1.20-2 [136 kB] 2021-02-13T17:50:25.328 INFO:teuthology.orchestra.run.gibba025.stdout:Get:15 http://archive.ubuntu.com/ubuntu bionic/universe amd64 liboath0 amd64 2.6.1-1 [44.7 kB] 2021-02-13T17:50:25.342 INFO:teuthology.orchestra.run.gibba036.stdout:Get:5 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-prettytable all 0.7.2-3 [19.6 kB] 2021-02-13T17:50:25.342 INFO:teuthology.orchestra.run.gibba025.stdout:Get:16 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-bcrypt amd64 3.1.4-2 [29.8 kB] 2021-02-13T17:50:25.349 INFO:teuthology.orchestra.run.gibba025.stdout:Get:17 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-cherrypy3 all 8.9.1-2 [160 kB] 2021-02-13T17:50:25.350 INFO:teuthology.orchestra.run.gibba036.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 librabbitmq4 amd64 0.8.0-1ubuntu0.18.04.2 [33.9 kB] 2021-02-13T17:50:25.372 INFO:teuthology.orchestra.run.gibba036.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic/main amd64 libsnappy1v5 amd64 1.1.7-1 [16.0 kB] 2021-02-13T17:50:25.376 INFO:teuthology.orchestra.run.gibba036.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic/main amd64 libleveldb1v5 amd64 1.20-2 [136 kB] 2021-02-13T17:50:25.389 INFO:teuthology.orchestra.run.gibba025.stdout:Get:18 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-jwt all 1.5.3+ds1-1 [15.8 kB] 2021-02-13T17:50:25.391 INFO:teuthology.orchestra.run.gibba025.stdout:Get:19 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-openssl all 17.5.0-1ubuntu1 [41.3 kB] 2021-02-13T17:50:25.398 INFO:teuthology.orchestra.run.gibba036.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 libcephfs2 amd64 14.2.16-285-g7194982c-1bionic [442 kB] 2021-02-13T17:50:25.399 INFO:teuthology.orchestra.run.gibba025.stdout:Get:20 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-logutils all 0.3.3-5 [16.7 kB] 2021-02-13T17:50:25.402 INFO:teuthology.orchestra.run.gibba025.stdout:Get:21 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-markupsafe amd64 1.0-1build1 [13.0 kB] 2021-02-13T17:50:25.404 INFO:teuthology.orchestra.run.gibba025.stdout:Get:22 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-mako all 1.0.7+ds1-1 [60.1 kB] 2021-02-13T17:50:25.412 INFO:teuthology.orchestra.run.gibba036.stdout:Get:10 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 python-rados amd64 14.2.16-285-g7194982c-1bionic [290 kB] 2021-02-13T17:50:25.413 INFO:teuthology.orchestra.run.gibba025.stdout:Get:23 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-simplegeneric all 0.8.1-1 [11.5 kB] 2021-02-13T17:50:25.434 INFO:teuthology.orchestra.run.gibba036.stdout:Get:11 http://archive.ubuntu.com/ubuntu bionic/universe amd64 liboath0 amd64 2.6.1-1 [44.7 kB] 2021-02-13T17:50:25.442 INFO:teuthology.orchestra.run.gibba036.stdout:Get:12 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-bcrypt amd64 3.1.4-2 [29.8 kB] 2021-02-13T17:50:25.449 INFO:teuthology.orchestra.run.gibba036.stdout:Get:13 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 python-ceph-argparse all 14.2.16-285-g7194982c-1bionic [20.2 kB] 2021-02-13T17:50:25.450 INFO:teuthology.orchestra.run.gibba036.stdout:Get:14 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 python-cephfs amd64 14.2.16-285-g7194982c-1bionic [124 kB] 2021-02-13T17:50:25.451 INFO:teuthology.orchestra.run.gibba036.stdout:Get:15 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-cherrypy3 all 8.9.1-2 [160 kB] 2021-02-13T17:50:25.454 INFO:teuthology.orchestra.run.gibba036.stdout:Get:16 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 python-rbd amd64 14.2.16-285-g7194982c-1bionic [264 kB] 2021-02-13T17:50:25.464 INFO:teuthology.orchestra.run.gibba036.stdout:Get:17 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 librgw2 amd64 14.2.16-285-g7194982c-1bionic [4,303 kB] 2021-02-13T17:50:25.481 INFO:teuthology.orchestra.run.gibba025.stdout:Get:24 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-singledispatch all 3.4.0.3-2 [9,848 B] 2021-02-13T17:50:25.481 INFO:teuthology.orchestra.run.gibba025.stdout:Get:25 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-simplejson amd64 3.13.2-1 [61.2 kB] 2021-02-13T17:50:25.487 INFO:teuthology.orchestra.run.gibba025.stdout:Get:26 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-webob all 1:1.7.3-2fakesync1 [64.3 kB] 2021-02-13T17:50:25.488 INFO:teuthology.orchestra.run.gibba036.stdout:Get:18 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-jwt all 1.5.3+ds1-1 [15.8 kB] 2021-02-13T17:50:25.490 INFO:teuthology.orchestra.run.gibba036.stdout:Get:19 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-openssl all 17.5.0-1ubuntu1 [41.3 kB] 2021-02-13T17:50:25.492 INFO:teuthology.orchestra.run.gibba025.stdout:Get:27 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-bs4 all 4.6.0-1 [67.9 kB] 2021-02-13T17:50:25.497 INFO:teuthology.orchestra.run.gibba025.stdout:Get:28 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-waitress all 1.0.1-1 [53.3 kB] 2021-02-13T17:50:25.501 INFO:teuthology.orchestra.run.gibba025.stdout:Get:29 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-dnspython all 1.15.0-1 [84.9 kB] 2021-02-13T17:50:25.501 INFO:teuthology.orchestra.run.gibba025.stdout:Get:30 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 python-rgw amd64 14.2.16-285-g7194982c-1bionic [98.9 kB] 2021-02-13T17:50:25.502 INFO:teuthology.orchestra.run.gibba036.stdout:Get:20 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-logutils all 0.3.3-5 [16.7 kB] 2021-02-13T17:50:25.504 INFO:teuthology.orchestra.run.gibba036.stdout:Get:21 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-markupsafe amd64 1.0-1build1 [13.0 kB] 2021-02-13T17:50:25.505 INFO:teuthology.orchestra.run.gibba025.stdout:Get:31 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 libradosstriper1 amd64 14.2.16-285-g7194982c-1bionic [330 kB] 2021-02-13T17:50:25.507 INFO:teuthology.orchestra.run.gibba036.stdout:Get:22 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-mako all 1.0.7+ds1-1 [60.1 kB] 2021-02-13T17:50:25.515 INFO:teuthology.orchestra.run.gibba036.stdout:Get:23 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-simplegeneric all 0.8.1-1 [11.5 kB] 2021-02-13T17:50:25.536 INFO:teuthology.orchestra.run.gibba025.stdout:Get:32 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 ceph-common amd64 14.2.16-285-g7194982c-1bionic [15.5 MB] 2021-02-13T17:50:25.560 INFO:teuthology.orchestra.run.gibba025.stdout:Get:33 http://archive.ubuntu.com/ubuntu bionic/main amd64 formencode-i18n all 1.3.0-0ubuntu5 [3,382 B] 2021-02-13T17:50:25.560 INFO:teuthology.orchestra.run.gibba025.stdout:Get:34 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-formencode all 1.3.0-0ubuntu5 [69.1 kB] 2021-02-13T17:50:25.564 INFO:teuthology.orchestra.run.gibba025.stdout:Get:35 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-tempita all 0.5.2-2 [13.9 kB] 2021-02-13T17:50:25.565 INFO:teuthology.orchestra.run.gibba025.stdout:Get:36 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-paste all 2.0.3+dfsg-4ubuntu1 [456 kB] 2021-02-13T17:50:25.582 INFO:teuthology.orchestra.run.gibba036.stdout:Get:24 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-singledispatch all 3.4.0.3-2 [9,848 B] 2021-02-13T17:50:25.583 INFO:teuthology.orchestra.run.gibba036.stdout:Get:25 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-simplejson amd64 3.13.2-1 [61.2 kB] 2021-02-13T17:50:25.588 INFO:teuthology.orchestra.run.gibba036.stdout:Get:26 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-webob all 1:1.7.3-2fakesync1 [64.3 kB] 2021-02-13T17:50:25.593 INFO:teuthology.orchestra.run.gibba036.stdout:Get:27 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-bs4 all 4.6.0-1 [67.9 kB] 2021-02-13T17:50:25.598 INFO:teuthology.orchestra.run.gibba036.stdout:Get:28 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-waitress all 1.0.1-1 [53.3 kB] 2021-02-13T17:50:25.602 INFO:teuthology.orchestra.run.gibba036.stdout:Get:29 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-dnspython all 1.15.0-1 [84.9 kB] 2021-02-13T17:50:25.639 INFO:teuthology.orchestra.run.gibba025.stdout:Get:37 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pastedeploy-tpl all 1.5.2-4 [4,796 B] 2021-02-13T17:50:25.640 INFO:teuthology.orchestra.run.gibba025.stdout:Get:38 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pastedeploy all 1.5.2-4 [25.6 kB] 2021-02-13T17:50:25.642 INFO:teuthology.orchestra.run.gibba025.stdout:Get:39 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-webtest all 2.0.28-1ubuntu1 [27.8 kB] 2021-02-13T17:50:25.644 INFO:teuthology.orchestra.run.gibba025.stdout:Get:40 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pecan all 1.2.1-2 [86.1 kB] 2021-02-13T17:50:25.650 INFO:teuthology.orchestra.run.gibba025.stdout:Get:41 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-certifi all 2018.1.18-2 [144 kB] 2021-02-13T17:50:25.661 INFO:teuthology.orchestra.run.gibba025.stdout:Get:42 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-chardet all 3.0.4-1 [80.3 kB] 2021-02-13T17:50:25.661 INFO:teuthology.orchestra.run.gibba036.stdout:Get:30 http://archive.ubuntu.com/ubuntu bionic/main amd64 formencode-i18n all 1.3.0-0ubuntu5 [3,382 B] 2021-02-13T17:50:25.662 INFO:teuthology.orchestra.run.gibba036.stdout:Get:31 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-formencode all 1.3.0-0ubuntu5 [69.1 kB] 2021-02-13T17:50:25.666 INFO:teuthology.orchestra.run.gibba036.stdout:Get:32 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-tempita all 0.5.2-2 [13.9 kB] 2021-02-13T17:50:25.667 INFO:teuthology.orchestra.run.gibba036.stdout:Get:33 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-paste all 2.0.3+dfsg-4ubuntu1 [456 kB] 2021-02-13T17:50:25.719 INFO:teuthology.orchestra.run.gibba025.stdout:Get:43 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python-urllib3 all 1.22-1ubuntu0.18.04.2 [86.0 kB] 2021-02-13T17:50:25.723 INFO:teuthology.orchestra.run.gibba025.stdout:Get:44 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python-requests all 2.18.4-2ubuntu0.1 [58.5 kB] 2021-02-13T17:50:25.727 INFO:teuthology.orchestra.run.gibba025.stdout:Get:45 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python-werkzeug all 0.14.1+dfsg1-1ubuntu0.1 [174 kB] 2021-02-13T17:50:25.736 INFO:teuthology.orchestra.run.gibba025.stdout:Get:46 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-repoze.lru all 0.7-1 [11.9 kB] 2021-02-13T17:50:25.741 INFO:teuthology.orchestra.run.gibba036.stdout:Get:34 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pastedeploy-tpl all 1.5.2-4 [4,796 B] 2021-02-13T17:50:25.741 INFO:teuthology.orchestra.run.gibba036.stdout:Get:35 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pastedeploy all 1.5.2-4 [25.6 kB] 2021-02-13T17:50:25.743 INFO:teuthology.orchestra.run.gibba036.stdout:Get:36 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-webtest all 2.0.28-1ubuntu1 [27.8 kB] 2021-02-13T17:50:25.745 INFO:teuthology.orchestra.run.gibba036.stdout:Get:37 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pecan all 1.2.1-2 [86.1 kB] 2021-02-13T17:50:25.751 INFO:teuthology.orchestra.run.gibba036.stdout:Get:38 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-certifi all 2018.1.18-2 [144 kB] 2021-02-13T17:50:25.761 INFO:teuthology.orchestra.run.gibba036.stdout:Get:39 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-chardet all 3.0.4-1 [80.3 kB] 2021-02-13T17:50:25.773 INFO:teuthology.orchestra.run.gibba036.stdout:Get:40 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 python-rgw amd64 14.2.16-285-g7194982c-1bionic [98.9 kB] 2021-02-13T17:50:25.777 INFO:teuthology.orchestra.run.gibba036.stdout:Get:41 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 libradosstriper1 amd64 14.2.16-285-g7194982c-1bionic [330 kB] 2021-02-13T17:50:25.798 INFO:teuthology.orchestra.run.gibba025.stdout:Get:47 http://archive.ubuntu.com/ubuntu bionic/main amd64 libjs-underscore all 1.8.3~dfsg-1 [59.9 kB] 2021-02-13T17:50:25.800 INFO:teuthology.orchestra.run.gibba025.stdout:Get:48 http://archive.ubuntu.com/ubuntu bionic/main amd64 libjs-sphinxdoc all 1.6.7-1ubuntu1 [85.6 kB] 2021-02-13T17:50:25.805 INFO:teuthology.orchestra.run.gibba025.stdout:Get:49 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-routes all 2.4.1-1 [88.3 kB] 2021-02-13T17:50:25.808 INFO:teuthology.orchestra.run.gibba025.stdout:Get:50 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-decorator all 4.1.2-1 [9,300 B] 2021-02-13T17:50:25.809 INFO:teuthology.orchestra.run.gibba025.stdout:Get:51 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-scipy amd64 0.19.1-2ubuntu1 [9,689 kB] 2021-02-13T17:50:25.820 INFO:teuthology.orchestra.run.gibba036.stdout:Get:42 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python-urllib3 all 1.22-1ubuntu0.18.04.2 [86.0 kB] 2021-02-13T17:50:25.824 INFO:teuthology.orchestra.run.gibba036.stdout:Get:43 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 ceph-common amd64 14.2.16-285-g7194982c-1bionic [15.5 MB] 2021-02-13T17:50:25.825 INFO:teuthology.orchestra.run.gibba036.stdout:Get:44 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python-requests all 2.18.4-2ubuntu0.1 [58.5 kB] 2021-02-13T17:50:25.832 INFO:teuthology.orchestra.run.gibba036.stdout:Get:45 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python-werkzeug all 0.14.1+dfsg1-1ubuntu0.1 [174 kB] 2021-02-13T17:50:25.836 INFO:teuthology.orchestra.run.gibba036.stdout:Get:46 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-repoze.lru all 0.7-1 [11.9 kB] 2021-02-13T17:50:25.900 INFO:teuthology.orchestra.run.gibba036.stdout:Get:47 http://archive.ubuntu.com/ubuntu bionic/main amd64 libjs-underscore all 1.8.3~dfsg-1 [59.9 kB] 2021-02-13T17:50:25.902 INFO:teuthology.orchestra.run.gibba036.stdout:Get:48 http://archive.ubuntu.com/ubuntu bionic/main amd64 libjs-sphinxdoc all 1.6.7-1ubuntu1 [85.6 kB] 2021-02-13T17:50:25.906 INFO:teuthology.orchestra.run.gibba036.stdout:Get:49 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-routes all 2.4.1-1 [88.3 kB] 2021-02-13T17:50:25.909 INFO:teuthology.orchestra.run.gibba036.stdout:Get:50 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-decorator all 4.1.2-1 [9,300 B] 2021-02-13T17:50:25.910 INFO:teuthology.orchestra.run.gibba036.stdout:Get:51 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-scipy amd64 0.19.1-2ubuntu1 [9,689 kB] 2021-02-13T17:50:26.125 INFO:teuthology.orchestra.run.gibba025.stdout:Get:52 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-sklearn-lib amd64 0.19.1-3 [1,521 kB] 2021-02-13T17:50:26.164 INFO:teuthology.orchestra.run.gibba025.stdout:Get:53 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-joblib all 0.11-1 [112 kB] 2021-02-13T17:50:26.165 INFO:teuthology.orchestra.run.gibba025.stdout:Get:54 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-sklearn all 0.19.1-3 [1,373 kB] 2021-02-13T17:50:26.207 INFO:teuthology.orchestra.run.gibba025.stdout:Get:55 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-monotonic all 1.1-2 [5,262 B] 2021-02-13T17:50:26.207 INFO:teuthology.orchestra.run.gibba025.stdout:Get:56 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-fasteners all 0.12.0-3 [13.4 kB] 2021-02-13T17:50:26.207 INFO:teuthology.orchestra.run.gibba025.stdout:Get:57 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python-httplib2 all 0.9.2+dfsg-1ubuntu0.2 [34.8 kB] 2021-02-13T17:50:26.207 INFO:teuthology.orchestra.run.gibba025.stdout:Get:58 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pyasn1 all 0.4.2-3 [46.7 kB] 2021-02-13T17:50:26.207 INFO:teuthology.orchestra.run.gibba025.stdout:Get:59 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pyasn1-modules all 0.2.1-0.2 [32.8 kB] 2021-02-13T17:50:26.208 INFO:teuthology.orchestra.run.gibba025.stdout:Get:60 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-rsa all 3.4.2-1 [28.9 kB] 2021-02-13T17:50:26.208 INFO:teuthology.orchestra.run.gibba025.stdout:Get:61 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-sqlalchemy all 1.1.11+ds1-1ubuntu1 [682 kB] 2021-02-13T17:50:26.235 INFO:teuthology.orchestra.run.gibba036.stdout:Get:52 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-sklearn-lib amd64 0.19.1-3 [1,521 kB] 2021-02-13T17:50:26.282 INFO:teuthology.orchestra.run.gibba036.stdout:Get:53 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-joblib all 0.11-1 [112 kB] 2021-02-13T17:50:26.286 INFO:teuthology.orchestra.run.gibba025.stdout:Get:62 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-oauth2client all 4.1.2-3 [61.4 kB] 2021-02-13T17:50:26.286 INFO:teuthology.orchestra.run.gibba025.stdout:Get:63 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-websocket all 0.44.0-0ubuntu2 [30.7 kB] 2021-02-13T17:50:26.287 INFO:teuthology.orchestra.run.gibba025.stdout:Get:64 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-yaml amd64 3.12-1build2 [115 kB] 2021-02-13T17:50:26.288 INFO:teuthology.orchestra.run.gibba025.stdout:Get:65 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-kubernetes all 2.0.0-2ubuntu1 [181 kB] 2021-02-13T17:50:26.295 INFO:teuthology.orchestra.run.gibba036.stdout:Get:54 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-sklearn all 0.19.1-3 [1,373 kB] 2021-02-13T17:50:26.313 INFO:teuthology.orchestra.run.gibba036.stdout:Get:55 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-monotonic all 1.1-2 [5,262 B] 2021-02-13T17:50:26.313 INFO:teuthology.orchestra.run.gibba036.stdout:Get:56 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-fasteners all 0.12.0-3 [13.4 kB] 2021-02-13T17:50:26.313 INFO:teuthology.orchestra.run.gibba036.stdout:Get:57 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python-httplib2 all 0.9.2+dfsg-1ubuntu0.2 [34.8 kB] 2021-02-13T17:50:26.314 INFO:teuthology.orchestra.run.gibba036.stdout:Get:58 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pyasn1 all 0.4.2-3 [46.7 kB] 2021-02-13T17:50:26.315 INFO:teuthology.orchestra.run.gibba036.stdout:Get:59 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pyasn1-modules all 0.2.1-0.2 [32.8 kB] 2021-02-13T17:50:26.315 INFO:teuthology.orchestra.run.gibba036.stdout:Get:60 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-rsa all 3.4.2-1 [28.9 kB] 2021-02-13T17:50:26.323 INFO:teuthology.orchestra.run.gibba036.stdout:Get:61 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-sqlalchemy all 1.1.11+ds1-1ubuntu1 [682 kB] 2021-02-13T17:50:26.365 INFO:teuthology.orchestra.run.gibba025.stdout:Get:66 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libonig4 amd64 6.7.0-1 [119 kB] 2021-02-13T17:50:26.374 INFO:teuthology.orchestra.run.gibba025.stdout:Get:67 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libjq1 amd64 1.5+dfsg-2 [111 kB] 2021-02-13T17:50:26.382 INFO:teuthology.orchestra.run.gibba025.stdout:Get:68 http://archive.ubuntu.com/ubuntu bionic/universe amd64 jq amd64 1.5+dfsg-2 [45.6 kB] 2021-02-13T17:50:26.385 INFO:teuthology.orchestra.run.gibba025.stdout:Get:69 http://archive.ubuntu.com/ubuntu bionic/main amd64 socat amd64 1.7.3.2-2ubuntu2 [342 kB] 2021-02-13T17:50:26.394 INFO:teuthology.orchestra.run.gibba036.stdout:Get:62 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-oauth2client all 4.1.2-3 [61.4 kB] 2021-02-13T17:50:26.396 INFO:teuthology.orchestra.run.gibba036.stdout:Get:63 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-websocket all 0.44.0-0ubuntu2 [30.7 kB] 2021-02-13T17:50:26.398 INFO:teuthology.orchestra.run.gibba036.stdout:Get:64 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-yaml amd64 3.12-1build2 [115 kB] 2021-02-13T17:50:26.402 INFO:teuthology.orchestra.run.gibba036.stdout:Get:65 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-kubernetes all 2.0.0-2ubuntu1 [181 kB] 2021-02-13T17:50:26.403 INFO:teuthology.orchestra.run.gibba025.stdout:Get:70 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libxslt1.1 amd64 1.1.29-5ubuntu0.2 [150 kB] 2021-02-13T17:50:26.407 INFO:teuthology.orchestra.run.gibba025.stdout:Get:71 http://archive.ubuntu.com/ubuntu bionic/universe amd64 xmlstarlet amd64 1.6.1-2 [382 kB] 2021-02-13T17:50:26.444 INFO:teuthology.orchestra.run.gibba025.stdout:Get:72 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 nvme-cli amd64 1.5-1ubuntu1.1 [184 kB] 2021-02-13T17:50:26.446 INFO:teuthology.orchestra.run.gibba025.stdout:Get:73 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-attr all 17.4.0-2 [23.7 kB] 2021-02-13T17:50:26.447 INFO:teuthology.orchestra.run.gibba025.stdout:Get:74 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-funcsigs all 1.0.2-4 [13.5 kB] 2021-02-13T17:50:26.447 INFO:teuthology.orchestra.run.gibba025.stdout:Get:75 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-webencodings all 0.5-2 [10.3 kB] 2021-02-13T17:50:26.465 INFO:teuthology.orchestra.run.gibba025.stdout:Get:76 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 ceph-base amd64 14.2.16-285-g7194982c-1bionic [4,080 kB] 2021-02-13T17:50:26.473 INFO:teuthology.orchestra.run.gibba036.stdout:Get:66 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libonig4 amd64 6.7.0-1 [119 kB] 2021-02-13T17:50:26.474 INFO:teuthology.orchestra.run.gibba036.stdout:Get:67 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libjq1 amd64 1.5+dfsg-2 [111 kB] 2021-02-13T17:50:26.475 INFO:teuthology.orchestra.run.gibba036.stdout:Get:68 http://archive.ubuntu.com/ubuntu bionic/universe amd64 jq amd64 1.5+dfsg-2 [45.6 kB] 2021-02-13T17:50:26.475 INFO:teuthology.orchestra.run.gibba036.stdout:Get:69 http://archive.ubuntu.com/ubuntu bionic/main amd64 socat amd64 1.7.3.2-2ubuntu2 [342 kB] 2021-02-13T17:50:26.478 INFO:teuthology.orchestra.run.gibba036.stdout:Get:70 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libxslt1.1 amd64 1.1.29-5ubuntu0.2 [150 kB] 2021-02-13T17:50:26.480 INFO:teuthology.orchestra.run.gibba036.stdout:Get:71 http://archive.ubuntu.com/ubuntu bionic/universe amd64 xmlstarlet amd64 1.6.1-2 [382 kB] 2021-02-13T17:50:26.524 INFO:teuthology.orchestra.run.gibba025.stdout:Get:77 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-html5lib all 0.999999999-1 [83.6 kB] 2021-02-13T17:50:26.528 INFO:teuthology.orchestra.run.gibba025.stdout:Get:78 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python-lxml amd64 4.2.1-1ubuntu0.3 [899 kB] 2021-02-13T17:50:26.536 INFO:teuthology.orchestra.run.gibba025.stdout:Get:79 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-openid all 2.2.5-6 [97.8 kB] 2021-02-13T17:50:26.537 INFO:teuthology.orchestra.run.gibba025.stdout:Get:80 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pastescript all 2.0.2-2 [54.9 kB] 2021-02-13T17:50:26.537 INFO:teuthology.orchestra.run.gibba025.stdout:Get:81 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-pluggy all 0.6.0-1 [12.2 kB] 2021-02-13T17:50:26.538 INFO:teuthology.orchestra.run.gibba025.stdout:Get:82 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-py all 1.5.2-1 [65.1 kB] 2021-02-13T17:50:26.552 INFO:teuthology.orchestra.run.gibba036.stdout:Get:72 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 nvme-cli amd64 1.5-1ubuntu1.1 [184 kB] 2021-02-13T17:50:26.558 INFO:teuthology.orchestra.run.gibba036.stdout:Get:73 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-attr all 17.4.0-2 [23.7 kB] 2021-02-13T17:50:26.558 INFO:teuthology.orchestra.run.gibba036.stdout:Get:74 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-funcsigs all 1.0.2-4 [13.5 kB] 2021-02-13T17:50:26.559 INFO:teuthology.orchestra.run.gibba036.stdout:Get:75 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-webencodings all 0.5-2 [10.3 kB] 2021-02-13T17:50:26.603 INFO:teuthology.orchestra.run.gibba025.stdout:Get:83 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pyinotify all 0.9.6-1 [24.6 kB] 2021-02-13T17:50:26.603 INFO:teuthology.orchestra.run.gibba025.stdout:Get:84 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-pytest all 3.3.2-2 [142 kB] 2021-02-13T17:50:26.604 INFO:teuthology.orchestra.run.gibba025.stdout:Get:85 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-scgi amd64 1.13-1.1build1 [18.4 kB] 2021-02-13T17:50:26.604 INFO:teuthology.orchestra.run.gibba025.stdout:Get:86 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-sqlalchemy-ext amd64 1.1.11+ds1-1ubuntu1 [13.4 kB] 2021-02-13T17:50:26.632 INFO:teuthology.orchestra.run.gibba036.stdout:Get:76 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-html5lib all 0.999999999-1 [83.6 kB] 2021-02-13T17:50:26.634 INFO:teuthology.orchestra.run.gibba036.stdout:Get:77 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python-lxml amd64 4.2.1-1ubuntu0.3 [899 kB] 2021-02-13T17:50:26.672 INFO:teuthology.orchestra.run.gibba036.stdout:Get:78 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-openid all 2.2.5-6 [97.8 kB] 2021-02-13T17:50:26.674 INFO:teuthology.orchestra.run.gibba036.stdout:Get:79 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pastescript all 2.0.2-2 [54.9 kB] 2021-02-13T17:50:26.675 INFO:teuthology.orchestra.run.gibba036.stdout:Get:80 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-pluggy all 0.6.0-1 [12.2 kB] 2021-02-13T17:50:26.675 INFO:teuthology.orchestra.run.gibba036.stdout:Get:81 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-py all 1.5.2-1 [65.1 kB] 2021-02-13T17:50:26.698 INFO:teuthology.orchestra.run.gibba025.stdout:Get:87 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr amd64 14.2.16-285-g7194982c-1bionic [1,390 kB] 2021-02-13T17:50:26.712 INFO:teuthology.orchestra.run.gibba036.stdout:Get:82 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pyinotify all 0.9.6-1 [24.6 kB] 2021-02-13T17:50:26.713 INFO:teuthology.orchestra.run.gibba036.stdout:Get:83 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-pytest all 3.3.2-2 [142 kB] 2021-02-13T17:50:26.717 INFO:teuthology.orchestra.run.gibba036.stdout:Get:84 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-scgi amd64 1.13-1.1build1 [18.4 kB] 2021-02-13T17:50:26.717 INFO:teuthology.orchestra.run.gibba036.stdout:Get:85 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-sqlalchemy-ext amd64 1.1.11+ds1-1ubuntu1 [13.4 kB] 2021-02-13T17:50:26.799 INFO:teuthology.orchestra.run.gibba025.stdout:Get:88 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mon amd64 14.2.16-285-g7194982c-1bionic [3,230 kB] 2021-02-13T17:50:26.919 INFO:teuthology.orchestra.run.gibba036.stdout:Get:86 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 ceph-base amd64 14.2.16-285-g7194982c-1bionic [4,080 kB] 2021-02-13T17:50:26.994 INFO:teuthology.orchestra.run.gibba025.stdout:Get:89 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 ceph-osd amd64 14.2.16-285-g7194982c-1bionic [17.3 MB] 2021-02-13T17:50:27.230 INFO:teuthology.orchestra.run.gibba036.stdout:Get:87 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr amd64 14.2.16-285-g7194982c-1bionic [1,390 kB] 2021-02-13T17:50:27.311 INFO:teuthology.orchestra.run.gibba036.stdout:Get:88 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mon amd64 14.2.16-285-g7194982c-1bionic [3,230 kB] 2021-02-13T17:50:27.560 INFO:teuthology.orchestra.run.gibba036.stdout:Get:89 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 ceph-osd amd64 14.2.16-285-g7194982c-1bionic [17.3 MB] 2021-02-13T17:50:28.044 INFO:teuthology.orchestra.run.gibba025.stdout:Get:90 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 ceph amd64 14.2.16-285-g7194982c-1bionic [3,980 B] 2021-02-13T17:50:28.044 INFO:teuthology.orchestra.run.gibba025.stdout:Get:91 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 ceph-fuse amd64 14.2.16-285-g7194982c-1bionic [528 kB] 2021-02-13T17:50:28.062 INFO:teuthology.orchestra.run.gibba025.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mds amd64 14.2.16-285-g7194982c-1bionic [1,804 kB] 2021-02-13T17:50:28.179 INFO:teuthology.orchestra.run.gibba025.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-dashboard all 14.2.16-285-g7194982c-1bionic [3,455 kB] 2021-02-13T17:50:28.391 INFO:teuthology.orchestra.run.gibba025.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-diskprediction-cloud all 14.2.16-285-g7194982c-1bionic [34.5 kB] 2021-02-13T17:50:28.395 INFO:teuthology.orchestra.run.gibba025.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-diskprediction-local all 14.2.16-285-g7194982c-1bionic [1,093 kB] 2021-02-13T17:50:28.439 INFO:teuthology.orchestra.run.gibba025.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-k8sevents all 14.2.16-285-g7194982c-1bionic [4,100 B] 2021-02-13T17:50:28.439 INFO:teuthology.orchestra.run.gibba025.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-rook all 14.2.16-285-g7194982c-1bionic [12.6 kB] 2021-02-13T17:50:28.446 INFO:teuthology.orchestra.run.gibba025.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-ssh all 14.2.16-285-g7194982c-1bionic [13.0 kB] 2021-02-13T17:50:28.450 INFO:teuthology.orchestra.run.gibba025.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 ceph-test amd64 14.2.16-285-g7194982c-1bionic [26.1 MB] 2021-02-13T17:50:28.811 INFO:teuthology.orchestra.run.gibba036.stdout:Get:90 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 ceph amd64 14.2.16-285-g7194982c-1bionic [3,980 B] 2021-02-13T17:50:28.811 INFO:teuthology.orchestra.run.gibba036.stdout:Get:91 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 ceph-fuse amd64 14.2.16-285-g7194982c-1bionic [528 kB] 2021-02-13T17:50:28.834 INFO:teuthology.orchestra.run.gibba036.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mds amd64 14.2.16-285-g7194982c-1bionic [1,804 kB] 2021-02-13T17:50:28.975 INFO:teuthology.orchestra.run.gibba036.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-dashboard all 14.2.16-285-g7194982c-1bionic [3,455 kB] 2021-02-13T17:50:29.218 INFO:teuthology.orchestra.run.gibba036.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-diskprediction-cloud all 14.2.16-285-g7194982c-1bionic [34.5 kB] 2021-02-13T17:50:29.219 INFO:teuthology.orchestra.run.gibba036.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-diskprediction-local all 14.2.16-285-g7194982c-1bionic [1,093 kB] 2021-02-13T17:50:29.296 INFO:teuthology.orchestra.run.gibba036.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-k8sevents all 14.2.16-285-g7194982c-1bionic [4,100 B] 2021-02-13T17:50:29.297 INFO:teuthology.orchestra.run.gibba036.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-rook all 14.2.16-285-g7194982c-1bionic [12.6 kB] 2021-02-13T17:50:29.297 INFO:teuthology.orchestra.run.gibba036.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-ssh all 14.2.16-285-g7194982c-1bionic [13.0 kB] 2021-02-13T17:50:29.298 INFO:teuthology.orchestra.run.gibba036.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 ceph-test amd64 14.2.16-285-g7194982c-1bionic [26.1 MB] 2021-02-13T17:50:30.042 INFO:teuthology.orchestra.run.gibba025.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 libcephfs-dev amd64 14.2.16-285-g7194982c-1bionic [17.9 kB] 2021-02-13T17:50:30.042 INFO:teuthology.orchestra.run.gibba025.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 python-ceph amd64 14.2.16-285-g7194982c-1bionic [4,040 B] 2021-02-13T17:50:30.042 INFO:teuthology.orchestra.run.gibba025.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 radosgw amd64 14.2.16-285-g7194982c-1bionic [4,905 kB] 2021-02-13T17:50:30.358 INFO:teuthology.orchestra.run.gibba025.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 rbd-fuse amd64 14.2.16-285-g7194982c-1bionic [63.7 kB] 2021-02-13T17:50:30.716 INFO:teuthology.orchestra.run.gibba036.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 libcephfs-dev amd64 14.2.16-285-g7194982c-1bionic [17.9 kB] 2021-02-13T17:50:30.717 INFO:teuthology.orchestra.run.gibba036.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 python-ceph amd64 14.2.16-285-g7194982c-1bionic [4,040 B] 2021-02-13T17:50:30.717 INFO:teuthology.orchestra.run.gibba036.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 radosgw amd64 14.2.16-285-g7194982c-1bionic [4,905 kB] 2021-02-13T17:50:30.774 INFO:teuthology.orchestra.run.gibba025.stdout:Fetched 109 MB in 6s (19.5 MB/s) 2021-02-13T17:50:30.876 INFO:teuthology.orchestra.run.gibba036.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2021-02-12-0757-nautilus/7194982cc16a1fd51df59ee58e1c54797c4465d1/ubuntu/bionic/flavors/default bionic/main amd64 rbd-fuse amd64 14.2.16-285-g7194982c-1bionic [63.7 kB] 2021-02-13T17:50:30.878 INFO:teuthology.orchestra.run.gibba025.stdout:Selecting previously unselected package python-uritemplate. 2021-02-13T17:50:30.900 INFO:teuthology.orchestra.run.gibba025.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 137603 files and directories currently installed.) 2021-02-13T17:50:30.902 INFO:teuthology.orchestra.run.gibba025.stdout:Preparing to unpack .../000-python-uritemplate_0.6-1ubuntu1_all.deb ... 2021-02-13T17:50:30.937 INFO:teuthology.orchestra.run.gibba025.stdout:Unpacking python-uritemplate (0.6-1ubuntu1) ... 2021-02-13T17:50:31.181 INFO:teuthology.orchestra.run.gibba025.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2021-02-13T17:50:31.185 INFO:teuthology.orchestra.run.gibba025.stdout:Preparing to unpack .../001-liblttng-ust0_2.10.1-1_amd64.deb ... 2021-02-13T17:50:31.256 INFO:teuthology.orchestra.run.gibba025.stdout:Unpacking liblttng-ust0:amd64 (2.10.1-1) ... 2021-02-13T17:50:31.274 INFO:teuthology.orchestra.run.gibba036.stdout:Fetched 109 MB in 6s (18.1 MB/s) 2021-02-13T17:50:31.409 INFO:teuthology.orchestra.run.gibba036.stdout:Selecting previously unselected package python-uritemplate. 2021-02-13T17:50:31.470 INFO:teuthology.orchestra.run.gibba036.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 137603 files and directories currently installed.) 2021-02-13T17:50:31.473 INFO:teuthology.orchestra.run.gibba036.stdout:Preparing to unpack .../000-python-uritemplate_0.6-1ubuntu1_all.deb ... 2021-02-13T17:50:31.515 INFO:teuthology.orchestra.run.gibba036.stdout:Unpacking python-uritemplate (0.6-1ubuntu1) ... 2021-02-13T17:50:31.521 INFO:teuthology.orchestra.run.gibba025.stdout:Preparing to unpack .../002-librbd1_14.2.16-285-g7194982c-1bionic_amd64.deb ... 2021-02-13T17:50:31.626 INFO:teuthology.orchestra.run.gibba025.stdout:Unpacking librbd1 (14.2.16-285-g7194982c-1bionic) over (12.2.13-0ubuntu0.18.04.6) ... 2021-02-13T17:50:31.860 INFO:teuthology.orchestra.run.gibba036.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2021-02-13T17:50:31.867 INFO:teuthology.orchestra.run.gibba036.stdout:Preparing to unpack .../001-liblttng-ust0_2.10.1-1_amd64.deb ... 2021-02-13T17:50:31.952 INFO:teuthology.orchestra.run.gibba036.stdout:Unpacking liblttng-ust0:amd64 (2.10.1-1) ... 2021-02-13T17:50:32.059 INFO:teuthology.orchestra.run.gibba025.stdout:Preparing to unpack .../003-librados2_14.2.16-285-g7194982c-1bionic_amd64.deb ... 2021-02-13T17:50:32.180 INFO:teuthology.orchestra.run.gibba025.stdout:Unpacking librados2 (14.2.16-285-g7194982c-1bionic) over (12.2.13-0ubuntu0.18.04.6) ... 2021-02-13T17:50:32.299 INFO:teuthology.orchestra.run.gibba036.stdout:Preparing to unpack .../002-librbd1_14.2.16-285-g7194982c-1bionic_amd64.deb ... 2021-02-13T17:50:32.422 INFO:teuthology.orchestra.run.gibba036.stdout:Unpacking librbd1 (14.2.16-285-g7194982c-1bionic) over (12.2.13-0ubuntu0.18.04.6) ... 2021-02-13T17:50:32.692 INFO:teuthology.orchestra.run.gibba025.stdout:Selecting previously unselected package libcephfs2. 2021-02-13T17:50:32.696 INFO:teuthology.orchestra.run.gibba025.stdout:Preparing to unpack .../004-libcephfs2_14.2.16-285-g7194982c-1bionic_amd64.deb ... 2021-02-13T17:50:32.733 INFO:teuthology.orchestra.run.gibba025.stdout:Unpacking libcephfs2 (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:50:32.893 INFO:teuthology.orchestra.run.gibba036.stdout:Preparing to unpack .../003-librados2_14.2.16-285-g7194982c-1bionic_amd64.deb ... 2021-02-13T17:50:32.977 INFO:teuthology.orchestra.run.gibba025.stdout:Selecting previously unselected package python-rados. 2021-02-13T17:50:32.981 INFO:teuthology.orchestra.run.gibba025.stdout:Preparing to unpack .../005-python-rados_14.2.16-285-g7194982c-1bionic_amd64.deb ... 2021-02-13T17:50:33.017 INFO:teuthology.orchestra.run.gibba036.stdout:Unpacking librados2 (14.2.16-285-g7194982c-1bionic) over (12.2.13-0ubuntu0.18.04.6) ... 2021-02-13T17:50:33.020 INFO:teuthology.orchestra.run.gibba025.stdout:Unpacking python-rados (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:50:33.263 INFO:teuthology.orchestra.run.gibba025.stdout:Selecting previously unselected package python-ceph-argparse. 2021-02-13T17:50:33.267 INFO:teuthology.orchestra.run.gibba025.stdout:Preparing to unpack .../006-python-ceph-argparse_14.2.16-285-g7194982c-1bionic_all.deb ... 2021-02-13T17:50:33.305 INFO:teuthology.orchestra.run.gibba025.stdout:Unpacking python-ceph-argparse (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:50:33.546 INFO:teuthology.orchestra.run.gibba036.stdout:Selecting previously unselected package libcephfs2. 2021-02-13T17:50:33.553 INFO:teuthology.orchestra.run.gibba036.stdout:Preparing to unpack .../004-libcephfs2_14.2.16-285-g7194982c-1bionic_amd64.deb ... 2021-02-13T17:50:33.587 INFO:teuthology.orchestra.run.gibba036.stdout:Unpacking libcephfs2 (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:50:33.599 INFO:teuthology.orchestra.run.gibba025.stdout:Selecting previously unselected package python-cephfs. 2021-02-13T17:50:33.608 INFO:teuthology.orchestra.run.gibba025.stdout:Preparing to unpack .../007-python-cephfs_14.2.16-285-g7194982c-1bionic_amd64.deb ... 2021-02-13T17:50:33.641 INFO:teuthology.orchestra.run.gibba025.stdout:Unpacking python-cephfs (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:50:33.840 INFO:teuthology.orchestra.run.gibba036.stdout:Selecting previously unselected package python-rados. 2021-02-13T17:50:33.909 INFO:teuthology.orchestra.run.gibba025.stdout:Selecting previously unselected package python-prettytable. 2021-02-13T17:50:33.909 INFO:teuthology.orchestra.run.gibba025.stdout:Preparing to unpack .../008-python-prettytable_0.7.2-3_all.deb ... 2021-02-13T17:50:33.909 INFO:teuthology.orchestra.run.gibba036.stdout:Preparing to unpack .../005-python-rados_14.2.16-285-g7194982c-1bionic_amd64.deb ... 2021-02-13T17:50:33.909 INFO:teuthology.orchestra.run.gibba036.stdout:Unpacking python-rados (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:50:33.943 INFO:teuthology.orchestra.run.gibba025.stdout:Unpacking python-prettytable (0.7.2-3) ... 2021-02-13T17:50:34.146 INFO:teuthology.orchestra.run.gibba025.stdout:Selecting previously unselected package python-rbd. 2021-02-13T17:50:34.150 INFO:teuthology.orchestra.run.gibba025.stdout:Preparing to unpack .../009-python-rbd_14.2.16-285-g7194982c-1bionic_amd64.deb ... 2021-02-13T17:50:34.167 INFO:teuthology.orchestra.run.gibba036.stdout:Selecting previously unselected package python-ceph-argparse. 2021-02-13T17:50:34.187 INFO:teuthology.orchestra.run.gibba036.stdout:Preparing to unpack .../006-python-ceph-argparse_14.2.16-285-g7194982c-1bionic_all.deb ... 2021-02-13T17:50:34.189 INFO:teuthology.orchestra.run.gibba025.stdout:Unpacking python-rbd (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:50:34.225 INFO:teuthology.orchestra.run.gibba036.stdout:Unpacking python-ceph-argparse (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:50:34.502 INFO:teuthology.orchestra.run.gibba036.stdout:Selecting previously unselected package python-cephfs. 2021-02-13T17:50:34.507 INFO:teuthology.orchestra.run.gibba025.stdout:Selecting previously unselected package librabbitmq4:amd64. 2021-02-13T17:50:34.520 INFO:teuthology.orchestra.run.gibba036.stdout:Preparing to unpack .../007-python-cephfs_14.2.16-285-g7194982c-1bionic_amd64.deb ... 2021-02-13T17:50:34.525 INFO:teuthology.orchestra.run.gibba025.stdout:Preparing to unpack .../010-librabbitmq4_0.8.0-1ubuntu0.18.04.2_amd64.deb ... 2021-02-13T17:50:34.552 INFO:teuthology.orchestra.run.gibba036.stdout:Unpacking python-cephfs (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:50:34.566 INFO:teuthology.orchestra.run.gibba025.stdout:Unpacking librabbitmq4:amd64 (0.8.0-1ubuntu0.18.04.2) ... 2021-02-13T17:50:34.838 INFO:teuthology.orchestra.run.gibba036.stdout:Selecting previously unselected package python-prettytable. 2021-02-13T17:50:34.856 INFO:teuthology.orchestra.run.gibba036.stdout:Preparing to unpack .../008-python-prettytable_0.7.2-3_all.deb ... 2021-02-13T17:50:34.877 INFO:teuthology.orchestra.run.gibba025.stdout:Selecting previously unselected package librgw2. 2021-02-13T17:50:34.887 INFO:teuthology.orchestra.run.gibba036.stdout:Unpacking python-prettytable (0.7.2-3) ... 2021-02-13T17:50:34.894 INFO:teuthology.orchestra.run.gibba025.stdout:Preparing to unpack .../011-librgw2_14.2.16-285-g7194982c-1bionic_amd64.deb ... 2021-02-13T17:50:34.935 INFO:teuthology.orchestra.run.gibba025.stdout:Unpacking librgw2 (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:50:35.098 INFO:teuthology.orchestra.run.gibba036.stdout:Selecting previously unselected package python-rbd. 2021-02-13T17:50:35.106 INFO:teuthology.orchestra.run.gibba036.stdout:Preparing to unpack .../009-python-rbd_14.2.16-285-g7194982c-1bionic_amd64.deb ... 2021-02-13T17:50:35.149 INFO:teuthology.orchestra.run.gibba036.stdout:Unpacking python-rbd (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:50:35.421 INFO:teuthology.orchestra.run.gibba025.stdout:Selecting previously unselected package python-rgw. 2021-02-13T17:50:35.438 INFO:teuthology.orchestra.run.gibba025.stdout:Preparing to unpack .../012-python-rgw_14.2.16-285-g7194982c-1bionic_amd64.deb ... 2021-02-13T17:50:35.470 INFO:teuthology.orchestra.run.gibba025.stdout:Unpacking python-rgw (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:50:35.527 INFO:teuthology.orchestra.run.gibba036.stdout:Selecting previously unselected package librabbitmq4:amd64. 2021-02-13T17:50:35.546 INFO:teuthology.orchestra.run.gibba036.stdout:Preparing to unpack .../010-librabbitmq4_0.8.0-1ubuntu0.18.04.2_amd64.deb ... 2021-02-13T17:50:35.585 INFO:teuthology.orchestra.run.gibba036.stdout:Unpacking librabbitmq4:amd64 (0.8.0-1ubuntu0.18.04.2) ... 2021-02-13T17:50:35.741 INFO:teuthology.orchestra.run.gibba025.stdout:Selecting previously unselected package libsnappy1v5:amd64. 2021-02-13T17:50:35.758 INFO:teuthology.orchestra.run.gibba025.stdout:Preparing to unpack .../013-libsnappy1v5_1.1.7-1_amd64.deb ... 2021-02-13T17:50:35.798 INFO:teuthology.orchestra.run.gibba025.stdout:Unpacking libsnappy1v5:amd64 (1.1.7-1) ... 2021-02-13T17:50:35.879 INFO:teuthology.orchestra.run.gibba036.stdout:Selecting previously unselected package librgw2. 2021-02-13T17:50:35.887 INFO:teuthology.orchestra.run.gibba036.stdout:Preparing to unpack .../011-librgw2_14.2.16-285-g7194982c-1bionic_amd64.deb ... 2021-02-13T17:50:35.920 INFO:teuthology.orchestra.run.gibba036.stdout:Unpacking librgw2 (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:50:36.101 INFO:teuthology.orchestra.run.gibba025.stdout:Selecting previously unselected package libleveldb1v5:amd64. 2021-02-13T17:50:36.108 INFO:teuthology.orchestra.run.gibba025.stdout:Preparing to unpack .../014-libleveldb1v5_1.20-2_amd64.deb ... 2021-02-13T17:50:36.151 INFO:teuthology.orchestra.run.gibba025.stdout:Unpacking libleveldb1v5:amd64 (1.20-2) ... 2021-02-13T17:50:36.431 INFO:teuthology.orchestra.run.gibba036.stdout:Selecting previously unselected package python-rgw. 2021-02-13T17:50:36.451 INFO:teuthology.orchestra.run.gibba036.stdout:Preparing to unpack .../012-python-rgw_14.2.16-285-g7194982c-1bionic_amd64.deb ... 2021-02-13T17:50:36.479 INFO:teuthology.orchestra.run.gibba025.stdout:Selecting previously unselected package liboath0. 2021-02-13T17:50:36.489 INFO:teuthology.orchestra.run.gibba036.stdout:Unpacking python-rgw (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:50:36.499 INFO:teuthology.orchestra.run.gibba025.stdout:Preparing to unpack .../015-liboath0_2.6.1-1_amd64.deb ... 2021-02-13T17:50:36.537 INFO:teuthology.orchestra.run.gibba025.stdout:Unpacking liboath0 (2.6.1-1) ... 2021-02-13T17:50:36.767 INFO:teuthology.orchestra.run.gibba036.stdout:Selecting previously unselected package libsnappy1v5:amd64. 2021-02-13T17:50:36.787 INFO:teuthology.orchestra.run.gibba036.stdout:Preparing to unpack .../013-libsnappy1v5_1.1.7-1_amd64.deb ... 2021-02-13T17:50:36.825 INFO:teuthology.orchestra.run.gibba036.stdout:Unpacking libsnappy1v5:amd64 (1.1.7-1) ... 2021-02-13T17:50:36.943 INFO:teuthology.orchestra.run.gibba025.stdout:Selecting previously unselected package libradosstriper1. 2021-02-13T17:50:36.949 INFO:teuthology.orchestra.run.gibba025.stdout:Preparing to unpack .../016-libradosstriper1_14.2.16-285-g7194982c-1bionic_amd64.deb ... 2021-02-13T17:50:36.992 INFO:teuthology.orchestra.run.gibba025.stdout:Unpacking libradosstriper1 (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:50:37.119 INFO:teuthology.orchestra.run.gibba036.stdout:Selecting previously unselected package libleveldb1v5:amd64. 2021-02-13T17:50:37.127 INFO:teuthology.orchestra.run.gibba036.stdout:Preparing to unpack .../014-libleveldb1v5_1.20-2_amd64.deb ... 2021-02-13T17:50:37.169 INFO:teuthology.orchestra.run.gibba036.stdout:Unpacking libleveldb1v5:amd64 (1.20-2) ... 2021-02-13T17:50:37.361 INFO:teuthology.orchestra.run.gibba025.stdout:Selecting previously unselected package ceph-common. 2021-02-13T17:50:37.365 INFO:teuthology.orchestra.run.gibba025.stdout:Preparing to unpack .../017-ceph-common_14.2.16-285-g7194982c-1bionic_amd64.deb ... 2021-02-13T17:50:37.394 INFO:teuthology.orchestra.run.gibba025.stdout:Unpacking ceph-common (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:50:37.482 INFO:teuthology.orchestra.run.gibba036.stdout:Selecting previously unselected package liboath0. 2021-02-13T17:50:37.501 INFO:teuthology.orchestra.run.gibba036.stdout:Preparing to unpack .../015-liboath0_2.6.1-1_amd64.deb ... 2021-02-13T17:50:37.549 INFO:teuthology.orchestra.run.gibba036.stdout:Unpacking liboath0 (2.6.1-1) ... 2021-02-13T17:50:37.877 INFO:teuthology.orchestra.run.gibba036.stdout:Selecting previously unselected package libradosstriper1. 2021-02-13T17:50:37.883 INFO:teuthology.orchestra.run.gibba036.stdout:Preparing to unpack .../016-libradosstriper1_14.2.16-285-g7194982c-1bionic_amd64.deb ... 2021-02-13T17:50:37.918 INFO:teuthology.orchestra.run.gibba036.stdout:Unpacking libradosstriper1 (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:50:38.347 INFO:teuthology.orchestra.run.gibba036.stdout:Selecting previously unselected package ceph-common. 2021-02-13T17:50:38.353 INFO:teuthology.orchestra.run.gibba036.stdout:Preparing to unpack .../017-ceph-common_14.2.16-285-g7194982c-1bionic_amd64.deb ... 2021-02-13T17:50:38.388 INFO:teuthology.orchestra.run.gibba036.stdout:Unpacking ceph-common (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:50:38.600 INFO:teuthology.orchestra.run.gibba025.stdout:Selecting previously unselected package ceph-base. 2021-02-13T17:50:38.604 INFO:teuthology.orchestra.run.gibba025.stdout:Preparing to unpack .../018-ceph-base_14.2.16-285-g7194982c-1bionic_amd64.deb ... 2021-02-13T17:50:38.644 INFO:teuthology.orchestra.run.gibba025.stdout:Unpacking ceph-base (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:50:39.304 INFO:teuthology.orchestra.run.gibba025.stdout:Selecting previously unselected package python-bcrypt. 2021-02-13T17:50:39.308 INFO:teuthology.orchestra.run.gibba025.stdout:Preparing to unpack .../019-python-bcrypt_3.1.4-2_amd64.deb ... 2021-02-13T17:50:39.337 INFO:teuthology.orchestra.run.gibba025.stdout:Unpacking python-bcrypt (3.1.4-2) ... 2021-02-13T17:50:39.582 INFO:teuthology.orchestra.run.gibba025.stdout:Selecting previously unselected package python-cherrypy3. 2021-02-13T17:50:39.585 INFO:teuthology.orchestra.run.gibba036.stdout:Selecting previously unselected package ceph-base. 2021-02-13T17:50:39.586 INFO:teuthology.orchestra.run.gibba025.stdout:Preparing to unpack .../020-python-cherrypy3_8.9.1-2_all.deb ... 2021-02-13T17:50:39.602 INFO:teuthology.orchestra.run.gibba036.stdout:Preparing to unpack .../018-ceph-base_14.2.16-285-g7194982c-1bionic_amd64.deb ... 2021-02-13T17:50:39.624 INFO:teuthology.orchestra.run.gibba025.stdout:Unpacking python-cherrypy3 (8.9.1-2) ... 2021-02-13T17:50:39.655 INFO:teuthology.orchestra.run.gibba036.stdout:Unpacking ceph-base (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:50:39.944 INFO:teuthology.orchestra.run.gibba025.stdout:Selecting previously unselected package python-jwt. 2021-02-13T17:50:39.947 INFO:teuthology.orchestra.run.gibba025.stdout:Preparing to unpack .../021-python-jwt_1.5.3+ds1-1_all.deb ... 2021-02-13T17:50:39.994 INFO:teuthology.orchestra.run.gibba025.stdout:Unpacking python-jwt (1.5.3+ds1-1) ... 2021-02-13T17:50:40.255 INFO:teuthology.orchestra.run.gibba025.stdout:Selecting previously unselected package python-openssl. 2021-02-13T17:50:40.259 INFO:teuthology.orchestra.run.gibba025.stdout:Preparing to unpack .../022-python-openssl_17.5.0-1ubuntu1_all.deb ... 2021-02-13T17:50:40.296 INFO:teuthology.orchestra.run.gibba025.stdout:Unpacking python-openssl (17.5.0-1ubuntu1) ... 2021-02-13T17:50:40.305 INFO:teuthology.orchestra.run.gibba036.stdout:Selecting previously unselected package python-bcrypt. 2021-02-13T17:50:40.313 INFO:teuthology.orchestra.run.gibba036.stdout:Preparing to unpack .../019-python-bcrypt_3.1.4-2_amd64.deb ... 2021-02-13T17:50:40.355 INFO:teuthology.orchestra.run.gibba036.stdout:Unpacking python-bcrypt (3.1.4-2) ... 2021-02-13T17:50:40.600 INFO:teuthology.orchestra.run.gibba025.stdout:Selecting previously unselected package python-logutils. 2021-02-13T17:50:40.603 INFO:teuthology.orchestra.run.gibba025.stdout:Preparing to unpack .../023-python-logutils_0.3.3-5_all.deb ... 2021-02-13T17:50:40.641 INFO:teuthology.orchestra.run.gibba025.stdout:Unpacking python-logutils (0.3.3-5) ... 2021-02-13T17:50:40.666 INFO:teuthology.orchestra.run.gibba036.stdout:Selecting previously unselected package python-cherrypy3. 2021-02-13T17:50:40.686 INFO:teuthology.orchestra.run.gibba036.stdout:Preparing to unpack .../020-python-cherrypy3_8.9.1-2_all.deb ... 2021-02-13T17:50:40.724 INFO:teuthology.orchestra.run.gibba036.stdout:Unpacking python-cherrypy3 (8.9.1-2) ... 2021-02-13T17:50:40.944 INFO:teuthology.orchestra.run.gibba025.stdout:Selecting previously unselected package python-markupsafe. 2021-02-13T17:50:40.951 INFO:teuthology.orchestra.run.gibba025.stdout:Preparing to unpack .../024-python-markupsafe_1.0-1build1_amd64.deb ... 2021-02-13T17:50:40.994 INFO:teuthology.orchestra.run.gibba025.stdout:Unpacking python-markupsafe (1.0-1build1) ... 2021-02-13T17:50:41.053 INFO:teuthology.orchestra.run.gibba036.stdout:Selecting previously unselected package python-jwt. 2021-02-13T17:50:41.059 INFO:teuthology.orchestra.run.gibba036.stdout:Preparing to unpack .../021-python-jwt_1.5.3+ds1-1_all.deb ... 2021-02-13T17:50:41.102 INFO:teuthology.orchestra.run.gibba036.stdout:Unpacking python-jwt (1.5.3+ds1-1) ... 2021-02-13T17:50:41.297 INFO:teuthology.orchestra.run.gibba025.stdout:Selecting previously unselected package python-mako. 2021-02-13T17:50:41.314 INFO:teuthology.orchestra.run.gibba025.stdout:Preparing to unpack .../025-python-mako_1.0.7+ds1-1_all.deb ... 2021-02-13T17:50:41.363 INFO:teuthology.orchestra.run.gibba025.stdout:Unpacking python-mako (1.0.7+ds1-1) ... 2021-02-13T17:50:41.406 INFO:teuthology.orchestra.run.gibba036.stdout:Selecting previously unselected package python-openssl. 2021-02-13T17:50:41.426 INFO:teuthology.orchestra.run.gibba036.stdout:Preparing to unpack .../022-python-openssl_17.5.0-1ubuntu1_all.deb ... 2021-02-13T17:50:41.464 INFO:teuthology.orchestra.run.gibba036.stdout:Unpacking python-openssl (17.5.0-1ubuntu1) ... 2021-02-13T17:50:41.708 INFO:teuthology.orchestra.run.gibba025.stdout:Selecting previously unselected package python-simplegeneric. 2021-02-13T17:50:41.726 INFO:teuthology.orchestra.run.gibba025.stdout:Preparing to unpack .../026-python-simplegeneric_0.8.1-1_all.deb ... 2021-02-13T17:50:41.775 INFO:teuthology.orchestra.run.gibba025.stdout:Unpacking python-simplegeneric (0.8.1-1) ... 2021-02-13T17:50:41.783 INFO:teuthology.orchestra.run.gibba036.stdout:Selecting previously unselected package python-logutils. 2021-02-13T17:50:41.791 INFO:teuthology.orchestra.run.gibba036.stdout:Preparing to unpack .../023-python-logutils_0.3.3-5_all.deb ... 2021-02-13T17:50:41.833 INFO:teuthology.orchestra.run.gibba036.stdout:Unpacking python-logutils (0.3.3-5) ... 2021-02-13T17:50:42.070 INFO:teuthology.orchestra.run.gibba025.stdout:Selecting previously unselected package python-singledispatch. 2021-02-13T17:50:42.077 INFO:teuthology.orchestra.run.gibba025.stdout:Preparing to unpack .../027-python-singledispatch_3.4.0.3-2_all.deb ... 2021-02-13T17:50:42.119 INFO:teuthology.orchestra.run.gibba025.stdout:Unpacking python-singledispatch (3.4.0.3-2) ... 2021-02-13T17:50:42.136 INFO:teuthology.orchestra.run.gibba036.stdout:Selecting previously unselected package python-markupsafe. 2021-02-13T17:50:42.156 INFO:teuthology.orchestra.run.gibba036.stdout:Preparing to unpack .../024-python-markupsafe_1.0-1build1_amd64.deb ... 2021-02-13T17:50:42.211 INFO:teuthology.orchestra.run.gibba036.stdout:Unpacking python-markupsafe (1.0-1build1) ... 2021-02-13T17:50:42.430 INFO:teuthology.orchestra.run.gibba025.stdout:Selecting previously unselected package python-simplejson. 2021-02-13T17:50:42.449 INFO:teuthology.orchestra.run.gibba025.stdout:Preparing to unpack .../028-python-simplejson_3.13.2-1_amd64.deb ... 2021-02-13T17:50:42.488 INFO:teuthology.orchestra.run.gibba025.stdout:Unpacking python-simplejson (3.13.2-1) ... 2021-02-13T17:50:42.538 INFO:teuthology.orchestra.run.gibba036.stdout:Selecting previously unselected package python-mako. 2021-02-13T17:50:42.545 INFO:teuthology.orchestra.run.gibba036.stdout:Preparing to unpack .../025-python-mako_1.0.7+ds1-1_all.deb ... 2021-02-13T17:50:42.580 INFO:teuthology.orchestra.run.gibba036.stdout:Unpacking python-mako (1.0.7+ds1-1) ... 2021-02-13T17:50:42.791 INFO:teuthology.orchestra.run.gibba025.stdout:Selecting previously unselected package python-webob. 2021-02-13T17:50:42.809 INFO:teuthology.orchestra.run.gibba025.stdout:Preparing to unpack .../029-python-webob_1%3a1.7.3-2fakesync1_all.deb ... 2021-02-13T17:50:42.849 INFO:teuthology.orchestra.run.gibba025.stdout:Unpacking python-webob (1:1.7.3-2fakesync1) ... 2021-02-13T17:50:42.899 INFO:teuthology.orchestra.run.gibba036.stdout:Selecting previously unselected package python-simplegeneric. 2021-02-13T17:50:42.919 INFO:teuthology.orchestra.run.gibba036.stdout:Preparing to unpack .../026-python-simplegeneric_0.8.1-1_all.deb ... 2021-02-13T17:50:42.966 INFO:teuthology.orchestra.run.gibba036.stdout:Unpacking python-simplegeneric (0.8.1-1) ... 2021-02-13T17:50:43.178 INFO:teuthology.orchestra.run.gibba025.stdout:Selecting previously unselected package python-bs4. 2021-02-13T17:50:43.184 INFO:teuthology.orchestra.run.gibba025.stdout:Preparing to unpack .../030-python-bs4_4.6.0-1_all.deb ... 2021-02-13T17:50:43.227 INFO:teuthology.orchestra.run.gibba025.stdout:Unpacking python-bs4 (4.6.0-1) ... 2021-02-13T17:50:43.285 INFO:teuthology.orchestra.run.gibba036.stdout:Selecting previously unselected package python-singledispatch. 2021-02-13T17:50:43.291 INFO:teuthology.orchestra.run.gibba036.stdout:Preparing to unpack .../027-python-singledispatch_3.4.0.3-2_all.deb ... 2021-02-13T17:50:43.334 INFO:teuthology.orchestra.run.gibba036.stdout:Unpacking python-singledispatch (3.4.0.3-2) ... 2021-02-13T17:50:43.522 INFO:teuthology.orchestra.run.gibba025.stdout:Selecting previously unselected package python-waitress. 2021-02-13T17:50:43.541 INFO:teuthology.orchestra.run.gibba025.stdout:Preparing to unpack .../031-python-waitress_1.0.1-1_all.deb ... 2021-02-13T17:50:43.580 INFO:teuthology.orchestra.run.gibba025.stdout:Unpacking python-waitress (1.0.1-1) ... 2021-02-13T17:50:43.654 INFO:teuthology.orchestra.run.gibba036.stdout:Selecting previously unselected package python-simplejson. 2021-02-13T17:50:43.674 INFO:teuthology.orchestra.run.gibba036.stdout:Preparing to unpack .../028-python-simplejson_3.13.2-1_amd64.deb ... 2021-02-13T17:50:43.713 INFO:teuthology.orchestra.run.gibba036.stdout:Unpacking python-simplejson (3.13.2-1) ... 2021-02-13T17:50:43.849 INFO:teuthology.orchestra.run.gibba025.stdout:Selecting previously unselected package python-dnspython. 2021-02-13T17:50:43.869 INFO:teuthology.orchestra.run.gibba025.stdout:Preparing to unpack .../032-python-dnspython_1.15.0-1_all.deb ... 2021-02-13T17:50:43.908 INFO:teuthology.orchestra.run.gibba025.stdout:Unpacking python-dnspython (1.15.0-1) ... 2021-02-13T17:50:44.032 INFO:teuthology.orchestra.run.gibba036.stdout:Selecting previously unselected package python-webob. 2021-02-13T17:50:44.039 INFO:teuthology.orchestra.run.gibba036.stdout:Preparing to unpack .../029-python-webob_1%3a1.7.3-2fakesync1_all.deb ... 2021-02-13T17:50:44.082 INFO:teuthology.orchestra.run.gibba036.stdout:Unpacking python-webob (1:1.7.3-2fakesync1) ... 2021-02-13T17:50:44.211 INFO:teuthology.orchestra.run.gibba025.stdout:Selecting previously unselected package formencode-i18n. 2021-02-13T17:50:44.231 INFO:teuthology.orchestra.run.gibba025.stdout:Preparing to unpack .../033-formencode-i18n_1.3.0-0ubuntu5_all.deb ... 2021-02-13T17:50:44.277 INFO:teuthology.orchestra.run.gibba025.stdout:Unpacking formencode-i18n (1.3.0-0ubuntu5) ... 2021-02-13T17:50:44.384 INFO:teuthology.orchestra.run.gibba036.stdout:Selecting previously unselected package python-bs4. 2021-02-13T17:50:44.404 INFO:teuthology.orchestra.run.gibba036.stdout:Preparing to unpack .../030-python-bs4_4.6.0-1_all.deb ... 2021-02-13T17:50:44.442 INFO:teuthology.orchestra.run.gibba036.stdout:Unpacking python-bs4 (4.6.0-1) ... 2021-02-13T17:50:44.597 INFO:teuthology.orchestra.run.gibba025.stdout:Selecting previously unselected package python-formencode. 2021-02-13T17:50:44.604 INFO:teuthology.orchestra.run.gibba025.stdout:Preparing to unpack .../034-python-formencode_1.3.0-0ubuntu5_all.deb ... 2021-02-13T17:50:44.646 INFO:teuthology.orchestra.run.gibba025.stdout:Unpacking python-formencode (1.3.0-0ubuntu5) ... 2021-02-13T17:50:44.770 INFO:teuthology.orchestra.run.gibba036.stdout:Selecting previously unselected package python-waitress. 2021-02-13T17:50:44.777 INFO:teuthology.orchestra.run.gibba036.stdout:Preparing to unpack .../031-python-waitress_1.0.1-1_all.deb ... 2021-02-13T17:50:44.820 INFO:teuthology.orchestra.run.gibba036.stdout:Unpacking python-waitress (1.0.1-1) ... 2021-02-13T17:50:44.941 INFO:teuthology.orchestra.run.gibba025.stdout:Selecting previously unselected package python-tempita. 2021-02-13T17:50:44.960 INFO:teuthology.orchestra.run.gibba025.stdout:Preparing to unpack .../035-python-tempita_0.5.2-2_all.deb ... 2021-02-13T17:50:44.999 INFO:teuthology.orchestra.run.gibba025.stdout:Unpacking python-tempita (0.5.2-2) ... 2021-02-13T17:50:45.130 INFO:teuthology.orchestra.run.gibba036.stdout:Selecting previously unselected package python-dnspython. 2021-02-13T17:50:45.134 INFO:teuthology.orchestra.run.gibba036.stdout:Preparing to unpack .../032-python-dnspython_1.15.0-1_all.deb ... 2021-02-13T17:50:45.180 INFO:teuthology.orchestra.run.gibba036.stdout:Unpacking python-dnspython (1.15.0-1) ... 2021-02-13T17:50:45.318 INFO:teuthology.orchestra.run.gibba025.stdout:Selecting previously unselected package python-paste. 2021-02-13T17:50:45.325 INFO:teuthology.orchestra.run.gibba025.stdout:Preparing to unpack .../036-python-paste_2.0.3+dfsg-4ubuntu1_all.deb ... 2021-02-13T17:50:45.368 INFO:teuthology.orchestra.run.gibba025.stdout:Unpacking python-paste (2.0.3+dfsg-4ubuntu1) ... 2021-02-13T17:50:45.425 INFO:teuthology.orchestra.run.gibba036.stdout:Selecting previously unselected package formencode-i18n. 2021-02-13T17:50:45.429 INFO:teuthology.orchestra.run.gibba036.stdout:Preparing to unpack .../033-formencode-i18n_1.3.0-0ubuntu5_all.deb ... 2021-02-13T17:50:45.489 INFO:teuthology.orchestra.run.gibba036.stdout:Unpacking formencode-i18n (1.3.0-0ubuntu5) ... 2021-02-13T17:50:45.680 INFO:teuthology.orchestra.run.gibba025.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2021-02-13T17:50:45.699 INFO:teuthology.orchestra.run.gibba025.stdout:Preparing to unpack .../037-python-pastedeploy-tpl_1.5.2-4_all.deb ... 2021-02-13T17:50:45.738 INFO:teuthology.orchestra.run.gibba025.stdout:Unpacking python-pastedeploy-tpl (1.5.2-4) ... 2021-02-13T17:50:45.778 INFO:teuthology.orchestra.run.gibba036.stdout:Selecting previously unselected package python-formencode. 2021-02-13T17:50:45.785 INFO:teuthology.orchestra.run.gibba036.stdout:Preparing to unpack .../034-python-formencode_1.3.0-0ubuntu5_all.deb ... 2021-02-13T17:50:45.827 INFO:teuthology.orchestra.run.gibba036.stdout:Unpacking python-formencode (1.3.0-0ubuntu5) ... 2021-02-13T17:50:46.066 INFO:teuthology.orchestra.run.gibba025.stdout:Selecting previously unselected package python-pastedeploy. 2021-02-13T17:50:46.073 INFO:teuthology.orchestra.run.gibba025.stdout:Preparing to unpack .../038-python-pastedeploy_1.5.2-4_all.deb ... 2021-02-13T17:50:46.115 INFO:teuthology.orchestra.run.gibba025.stdout:Unpacking python-pastedeploy (1.5.2-4) ... 2021-02-13T17:50:46.131 INFO:teuthology.orchestra.run.gibba036.stdout:Selecting previously unselected package python-tempita. 2021-02-13T17:50:46.150 INFO:teuthology.orchestra.run.gibba036.stdout:Preparing to unpack .../035-python-tempita_0.5.2-2_all.deb ... 2021-02-13T17:50:46.189 INFO:teuthology.orchestra.run.gibba036.stdout:Unpacking python-tempita (0.5.2-2) ... 2021-02-13T17:50:46.443 INFO:teuthology.orchestra.run.gibba025.stdout:Selecting previously unselected package python-webtest. 2021-02-13T17:50:46.463 INFO:teuthology.orchestra.run.gibba025.stdout:Preparing to unpack .../039-python-webtest_2.0.28-1ubuntu1_all.deb ... 2021-02-13T17:50:46.500 INFO:teuthology.orchestra.run.gibba036.stdout:Selecting previously unselected package python-paste. 2021-02-13T17:50:46.506 INFO:teuthology.orchestra.run.gibba036.stdout:Preparing to unpack .../036-python-paste_2.0.3+dfsg-4ubuntu1_all.deb ... 2021-02-13T17:50:46.510 INFO:teuthology.orchestra.run.gibba025.stdout:Unpacking python-webtest (2.0.28-1ubuntu1) ... 2021-02-13T17:50:46.549 INFO:teuthology.orchestra.run.gibba036.stdout:Unpacking python-paste (2.0.3+dfsg-4ubuntu1) ... 2021-02-13T17:50:46.844 INFO:teuthology.orchestra.run.gibba036.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2021-02-13T17:50:46.864 INFO:teuthology.orchestra.run.gibba036.stdout:Preparing to unpack .../037-python-pastedeploy-tpl_1.5.2-4_all.deb ... 2021-02-13T17:50:46.872 INFO:teuthology.orchestra.run.gibba025.stdout:Selecting previously unselected package python-pecan. 2021-02-13T17:50:46.878 INFO:teuthology.orchestra.run.gibba025.stdout:Preparing to unpack .../040-python-pecan_1.2.1-2_all.deb ... 2021-02-13T17:50:46.902 INFO:teuthology.orchestra.run.gibba036.stdout:Unpacking python-pastedeploy-tpl (1.5.2-4) ... 2021-02-13T17:50:46.914 INFO:teuthology.orchestra.run.gibba025.stdout:Unpacking python-pecan (1.2.1-2) ... 2021-02-13T17:50:47.221 INFO:teuthology.orchestra.run.gibba036.stdout:Selecting previously unselected package python-pastedeploy. 2021-02-13T17:50:47.227 INFO:teuthology.orchestra.run.gibba036.stdout:Preparing to unpack .../038-python-pastedeploy_1.5.2-4_all.deb ... 2021-02-13T17:50:47.243 INFO:teuthology.orchestra.run.gibba025.stdout:Selecting previously unselected package python-certifi. 2021-02-13T17:50:47.262 INFO:teuthology.orchestra.run.gibba025.stdout:Preparing to unpack .../041-python-certifi_2018.1.18-2_all.deb ... 2021-02-13T17:50:47.271 INFO:teuthology.orchestra.run.gibba036.stdout:Unpacking python-pastedeploy (1.5.2-4) ... 2021-02-13T17:50:47.301 INFO:teuthology.orchestra.run.gibba025.stdout:Unpacking python-certifi (2018.1.18-2) ... 2021-02-13T17:50:47.600 INFO:teuthology.orchestra.run.gibba036.stdout:Selecting previously unselected package python-webtest. 2021-02-13T17:50:47.613 INFO:teuthology.orchestra.run.gibba025.stdout:Selecting previously unselected package python-chardet. 2021-02-13T17:50:47.619 INFO:teuthology.orchestra.run.gibba036.stdout:Preparing to unpack .../039-python-webtest_2.0.28-1ubuntu1_all.deb ... 2021-02-13T17:50:47.620 INFO:teuthology.orchestra.run.gibba025.stdout:Preparing to unpack .../042-python-chardet_3.0.4-1_all.deb ... 2021-02-13T17:50:47.662 INFO:teuthology.orchestra.run.gibba025.stdout:Unpacking python-chardet (3.0.4-1) ... 2021-02-13T17:50:47.666 INFO:teuthology.orchestra.run.gibba036.stdout:Unpacking python-webtest (2.0.28-1ubuntu1) ... 2021-02-13T17:50:47.957 INFO:teuthology.orchestra.run.gibba025.stdout:Selecting previously unselected package python-urllib3. 2021-02-13T17:50:47.976 INFO:teuthology.orchestra.run.gibba025.stdout:Preparing to unpack .../043-python-urllib3_1.22-1ubuntu0.18.04.2_all.deb ... 2021-02-13T17:50:48.010 INFO:teuthology.orchestra.run.gibba036.stdout:Selecting previously unselected package python-pecan. 2021-02-13T17:50:48.018 INFO:teuthology.orchestra.run.gibba036.stdout:Preparing to unpack .../040-python-pecan_1.2.1-2_all.deb ... 2021-02-13T17:50:48.023 INFO:teuthology.orchestra.run.gibba025.stdout:Unpacking python-urllib3 (1.22-1ubuntu0.18.04.2) ... 2021-02-13T17:50:48.061 INFO:teuthology.orchestra.run.gibba036.stdout:Unpacking python-pecan (1.2.1-2) ... 2021-02-13T17:50:48.360 INFO:teuthology.orchestra.run.gibba025.stdout:Selecting previously unselected package python-requests. 2021-02-13T17:50:48.380 INFO:teuthology.orchestra.run.gibba025.stdout:Preparing to unpack .../044-python-requests_2.18.4-2ubuntu0.1_all.deb ... 2021-02-13T17:50:48.407 INFO:teuthology.orchestra.run.gibba036.stdout:Selecting previously unselected package python-certifi. 2021-02-13T17:50:48.426 INFO:teuthology.orchestra.run.gibba025.stdout:Unpacking python-requests (2.18.4-2ubuntu0.1) ... 2021-02-13T17:50:48.427 INFO:teuthology.orchestra.run.gibba036.stdout:Preparing to unpack .../041-python-certifi_2018.1.18-2_all.deb ... 2021-02-13T17:50:48.473 INFO:teuthology.orchestra.run.gibba036.stdout:Unpacking python-certifi (2018.1.18-2) ... 2021-02-13T17:50:48.729 INFO:teuthology.orchestra.run.gibba025.stdout:Selecting previously unselected package python-werkzeug. 2021-02-13T17:50:48.748 INFO:teuthology.orchestra.run.gibba025.stdout:Preparing to unpack .../045-python-werkzeug_0.14.1+dfsg1-1ubuntu0.1_all.deb ... 2021-02-13T17:50:48.787 INFO:teuthology.orchestra.run.gibba025.stdout:Unpacking python-werkzeug (0.14.1+dfsg1-1ubuntu0.1) ... 2021-02-13T17:50:48.842 INFO:teuthology.orchestra.run.gibba036.stdout:Selecting previously unselected package python-chardet. 2021-02-13T17:50:48.850 INFO:teuthology.orchestra.run.gibba036.stdout:Preparing to unpack .../042-python-chardet_3.0.4-1_all.deb ... 2021-02-13T17:50:48.892 INFO:teuthology.orchestra.run.gibba036.stdout:Unpacking python-chardet (3.0.4-1) ... 2021-02-13T17:50:49.124 INFO:teuthology.orchestra.run.gibba025.stdout:Selecting previously unselected package ceph-mgr. 2021-02-13T17:50:49.144 INFO:teuthology.orchestra.run.gibba025.stdout:Preparing to unpack .../046-ceph-mgr_14.2.16-285-g7194982c-1bionic_amd64.deb ... 2021-02-13T17:50:49.182 INFO:teuthology.orchestra.run.gibba025.stdout:Unpacking ceph-mgr (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:50:49.212 INFO:teuthology.orchestra.run.gibba036.stdout:Selecting previously unselected package python-urllib3. 2021-02-13T17:50:49.232 INFO:teuthology.orchestra.run.gibba036.stdout:Preparing to unpack .../043-python-urllib3_1.22-1ubuntu0.18.04.2_all.deb ... 2021-02-13T17:50:49.270 INFO:teuthology.orchestra.run.gibba036.stdout:Unpacking python-urllib3 (1.22-1ubuntu0.18.04.2) ... 2021-02-13T17:50:49.589 INFO:teuthology.orchestra.run.gibba036.stdout:Selecting previously unselected package python-requests. 2021-02-13T17:50:49.609 INFO:teuthology.orchestra.run.gibba036.stdout:Preparing to unpack .../044-python-requests_2.18.4-2ubuntu0.1_all.deb ... 2021-02-13T17:50:49.636 INFO:teuthology.orchestra.run.gibba025.stdout:Selecting previously unselected package ceph-mon. 2021-02-13T17:50:49.640 INFO:teuthology.orchestra.run.gibba025.stdout:Preparing to unpack .../047-ceph-mon_14.2.16-285-g7194982c-1bionic_amd64.deb ... 2021-02-13T17:50:49.648 INFO:teuthology.orchestra.run.gibba036.stdout:Unpacking python-requests (2.18.4-2ubuntu0.1) ... 2021-02-13T17:50:49.677 INFO:teuthology.orchestra.run.gibba025.stdout:Unpacking ceph-mon (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:50:49.976 INFO:teuthology.orchestra.run.gibba036.stdout:Selecting previously unselected package python-werkzeug. 2021-02-13T17:50:49.996 INFO:teuthology.orchestra.run.gibba036.stdout:Preparing to unpack .../045-python-werkzeug_0.14.1+dfsg1-1ubuntu0.1_all.deb ... 2021-02-13T17:50:50.042 INFO:teuthology.orchestra.run.gibba036.stdout:Unpacking python-werkzeug (0.14.1+dfsg1-1ubuntu0.1) ... 2021-02-13T17:50:50.281 INFO:teuthology.orchestra.run.gibba025.stdout:Selecting previously unselected package ceph-osd. 2021-02-13T17:50:50.285 INFO:teuthology.orchestra.run.gibba025.stdout:Preparing to unpack .../048-ceph-osd_14.2.16-285-g7194982c-1bionic_amd64.deb ... 2021-02-13T17:50:50.331 INFO:teuthology.orchestra.run.gibba025.stdout:Unpacking ceph-osd (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:50:50.387 INFO:teuthology.orchestra.run.gibba036.stdout:Selecting previously unselected package ceph-mgr. 2021-02-13T17:50:50.394 INFO:teuthology.orchestra.run.gibba036.stdout:Preparing to unpack .../046-ceph-mgr_14.2.16-285-g7194982c-1bionic_amd64.deb ... 2021-02-13T17:50:50.436 INFO:teuthology.orchestra.run.gibba036.stdout:Unpacking ceph-mgr (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:50:50.908 INFO:teuthology.orchestra.run.gibba036.stdout:Selecting previously unselected package ceph-mon. 2021-02-13T17:50:50.915 INFO:teuthology.orchestra.run.gibba036.stdout:Preparing to unpack .../047-ceph-mon_14.2.16-285-g7194982c-1bionic_amd64.deb ... 2021-02-13T17:50:50.957 INFO:teuthology.orchestra.run.gibba036.stdout:Unpacking ceph-mon (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:50:51.535 INFO:teuthology.orchestra.run.gibba025.stdout:Selecting previously unselected package ceph. 2021-02-13T17:50:51.539 INFO:teuthology.orchestra.run.gibba025.stdout:Preparing to unpack .../049-ceph_14.2.16-285-g7194982c-1bionic_amd64.deb ... 2021-02-13T17:50:51.585 INFO:teuthology.orchestra.run.gibba025.stdout:Unpacking ceph (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:50:51.594 INFO:teuthology.orchestra.run.gibba036.stdout:Selecting previously unselected package ceph-osd. 2021-02-13T17:50:51.601 INFO:teuthology.orchestra.run.gibba036.stdout:Preparing to unpack .../048-ceph-osd_14.2.16-285-g7194982c-1bionic_amd64.deb ... 2021-02-13T17:50:51.644 INFO:teuthology.orchestra.run.gibba036.stdout:Unpacking ceph-osd (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:50:51.846 INFO:teuthology.orchestra.run.gibba025.stdout:Selecting previously unselected package ceph-fuse. 2021-02-13T17:50:51.850 INFO:teuthology.orchestra.run.gibba025.stdout:Preparing to unpack .../050-ceph-fuse_14.2.16-285-g7194982c-1bionic_amd64.deb ... 2021-02-13T17:50:51.888 INFO:teuthology.orchestra.run.gibba025.stdout:Unpacking ceph-fuse (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:50:52.249 INFO:teuthology.orchestra.run.gibba025.stdout:Selecting previously unselected package ceph-mds. 2021-02-13T17:50:52.253 INFO:teuthology.orchestra.run.gibba025.stdout:Preparing to unpack .../051-ceph-mds_14.2.16-285-g7194982c-1bionic_amd64.deb ... 2021-02-13T17:50:52.291 INFO:teuthology.orchestra.run.gibba025.stdout:Unpacking ceph-mds (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:50:52.702 INFO:teuthology.orchestra.run.gibba025.stdout:Selecting previously unselected package python-repoze.lru. 2021-02-13T17:50:52.706 INFO:teuthology.orchestra.run.gibba025.stdout:Preparing to unpack .../052-python-repoze.lru_0.7-1_all.deb ... 2021-02-13T17:50:52.752 INFO:teuthology.orchestra.run.gibba025.stdout:Unpacking python-repoze.lru (0.7-1) ... 2021-02-13T17:50:52.823 INFO:teuthology.orchestra.run.gibba036.stdout:Selecting previously unselected package ceph. 2021-02-13T17:50:52.831 INFO:teuthology.orchestra.run.gibba036.stdout:Preparing to unpack .../049-ceph_14.2.16-285-g7194982c-1bionic_amd64.deb ... 2021-02-13T17:50:52.886 INFO:teuthology.orchestra.run.gibba036.stdout:Unpacking ceph (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:50:52.989 INFO:teuthology.orchestra.run.gibba025.stdout:Selecting previously unselected package libjs-underscore. 2021-02-13T17:50:52.996 INFO:teuthology.orchestra.run.gibba025.stdout:Preparing to unpack .../053-libjs-underscore_1.8.3~dfsg-1_all.deb ... 2021-02-13T17:50:53.030 INFO:teuthology.orchestra.run.gibba025.stdout:Unpacking libjs-underscore (1.8.3~dfsg-1) ... 2021-02-13T17:50:53.234 INFO:teuthology.orchestra.run.gibba036.stdout:Selecting previously unselected package ceph-fuse. 2021-02-13T17:50:53.254 INFO:teuthology.orchestra.run.gibba036.stdout:Preparing to unpack .../050-ceph-fuse_14.2.16-285-g7194982c-1bionic_amd64.deb ... 2021-02-13T17:50:53.292 INFO:teuthology.orchestra.run.gibba036.stdout:Unpacking ceph-fuse (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:50:53.300 INFO:teuthology.orchestra.run.gibba025.stdout:Selecting previously unselected package libjs-sphinxdoc. 2021-02-13T17:50:53.318 INFO:teuthology.orchestra.run.gibba025.stdout:Preparing to unpack .../054-libjs-sphinxdoc_1.6.7-1ubuntu1_all.deb ... 2021-02-13T17:50:53.358 INFO:teuthology.orchestra.run.gibba025.stdout:Unpacking libjs-sphinxdoc (1.6.7-1ubuntu1) ... 2021-02-13T17:50:53.652 INFO:teuthology.orchestra.run.gibba025.stdout:Selecting previously unselected package python-routes. 2021-02-13T17:50:53.660 INFO:teuthology.orchestra.run.gibba025.stdout:Preparing to unpack .../055-python-routes_2.4.1-1_all.deb ... 2021-02-13T17:50:53.670 INFO:teuthology.orchestra.run.gibba036.stdout:Selecting previously unselected package ceph-mds. 2021-02-13T17:50:53.678 INFO:teuthology.orchestra.run.gibba036.stdout:Preparing to unpack .../051-ceph-mds_14.2.16-285-g7194982c-1bionic_amd64.deb ... 2021-02-13T17:50:53.702 INFO:teuthology.orchestra.run.gibba025.stdout:Unpacking python-routes (2.4.1-1) ... 2021-02-13T17:50:53.711 INFO:teuthology.orchestra.run.gibba036.stdout:Unpacking ceph-mds (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:50:54.022 INFO:teuthology.orchestra.run.gibba025.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2021-02-13T17:50:54.039 INFO:teuthology.orchestra.run.gibba025.stdout:Preparing to unpack .../056-ceph-mgr-dashboard_14.2.16-285-g7194982c-1bionic_all.deb ... 2021-02-13T17:50:54.080 INFO:teuthology.orchestra.run.gibba025.stdout:Unpacking ceph-mgr-dashboard (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:50:54.148 INFO:teuthology.orchestra.run.gibba036.stdout:Selecting previously unselected package python-repoze.lru. 2021-02-13T17:50:54.155 INFO:teuthology.orchestra.run.gibba036.stdout:Preparing to unpack .../052-python-repoze.lru_0.7-1_all.deb ... 2021-02-13T17:50:54.197 INFO:teuthology.orchestra.run.gibba036.stdout:Unpacking python-repoze.lru (0.7-1) ... 2021-02-13T17:50:54.459 INFO:teuthology.orchestra.run.gibba036.stdout:Selecting previously unselected package libjs-underscore. 2021-02-13T17:50:54.479 INFO:teuthology.orchestra.run.gibba036.stdout:Preparing to unpack .../053-libjs-underscore_1.8.3~dfsg-1_all.deb ... 2021-02-13T17:50:54.518 INFO:teuthology.orchestra.run.gibba036.stdout:Unpacking libjs-underscore (1.8.3~dfsg-1) ... 2021-02-13T17:50:54.676 INFO:teuthology.orchestra.run.gibba025.stdout:Selecting previously unselected package ceph-mgr-diskprediction-cloud. 2021-02-13T17:50:54.696 INFO:teuthology.orchestra.run.gibba025.stdout:Preparing to unpack .../057-ceph-mgr-diskprediction-cloud_14.2.16-285-g7194982c-1bionic_all.deb ... 2021-02-13T17:50:54.734 INFO:teuthology.orchestra.run.gibba025.stdout:Unpacking ceph-mgr-diskprediction-cloud (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:50:54.803 INFO:teuthology.orchestra.run.gibba036.stdout:Selecting previously unselected package libjs-sphinxdoc. 2021-02-13T17:50:54.823 INFO:teuthology.orchestra.run.gibba036.stdout:Preparing to unpack .../054-libjs-sphinxdoc_1.6.7-1ubuntu1_all.deb ... 2021-02-13T17:50:54.862 INFO:teuthology.orchestra.run.gibba036.stdout:Unpacking libjs-sphinxdoc (1.6.7-1ubuntu1) ... 2021-02-13T17:50:55.054 INFO:teuthology.orchestra.run.gibba025.stdout:Selecting previously unselected package python-decorator. 2021-02-13T17:50:55.060 INFO:teuthology.orchestra.run.gibba025.stdout:Preparing to unpack .../058-python-decorator_4.1.2-1_all.deb ... 2021-02-13T17:50:55.103 INFO:teuthology.orchestra.run.gibba025.stdout:Unpacking python-decorator (4.1.2-1) ... 2021-02-13T17:50:55.172 INFO:teuthology.orchestra.run.gibba036.stdout:Selecting previously unselected package python-routes. 2021-02-13T17:50:55.179 INFO:teuthology.orchestra.run.gibba036.stdout:Preparing to unpack .../055-python-routes_2.4.1-1_all.deb ... 2021-02-13T17:50:55.221 INFO:teuthology.orchestra.run.gibba036.stdout:Unpacking python-routes (2.4.1-1) ... 2021-02-13T17:50:55.423 INFO:teuthology.orchestra.run.gibba025.stdout:Selecting previously unselected package python-scipy. 2021-02-13T17:50:55.443 INFO:teuthology.orchestra.run.gibba025.stdout:Preparing to unpack .../059-python-scipy_0.19.1-2ubuntu1_amd64.deb ... 2021-02-13T17:50:55.489 INFO:teuthology.orchestra.run.gibba025.stdout:Unpacking python-scipy (0.19.1-2ubuntu1) ... 2021-02-13T17:50:55.591 INFO:teuthology.orchestra.run.gibba036.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2021-02-13T17:50:55.611 INFO:teuthology.orchestra.run.gibba036.stdout:Preparing to unpack .../056-ceph-mgr-dashboard_14.2.16-285-g7194982c-1bionic_all.deb ... 2021-02-13T17:50:55.649 INFO:teuthology.orchestra.run.gibba036.stdout:Unpacking ceph-mgr-dashboard (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:50:56.270 INFO:teuthology.orchestra.run.gibba036.stdout:Selecting previously unselected package ceph-mgr-diskprediction-cloud. 2021-02-13T17:50:56.278 INFO:teuthology.orchestra.run.gibba036.stdout:Preparing to unpack .../057-ceph-mgr-diskprediction-cloud_14.2.16-285-g7194982c-1bionic_all.deb ... 2021-02-13T17:50:56.297 INFO:teuthology.orchestra.run.gibba025.stdout:Selecting previously unselected package python-sklearn-lib. 2021-02-13T17:50:56.317 INFO:teuthology.orchestra.run.gibba025.stdout:Preparing to unpack .../060-python-sklearn-lib_0.19.1-3_amd64.deb ... 2021-02-13T17:50:56.320 INFO:teuthology.orchestra.run.gibba036.stdout:Unpacking ceph-mgr-diskprediction-cloud (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:50:56.356 INFO:teuthology.orchestra.run.gibba025.stdout:Unpacking python-sklearn-lib (0.19.1-3) ... 2021-02-13T17:50:56.648 INFO:teuthology.orchestra.run.gibba036.stdout:Selecting previously unselected package python-decorator. 2021-02-13T17:50:56.668 INFO:teuthology.orchestra.run.gibba036.stdout:Preparing to unpack .../058-python-decorator_4.1.2-1_all.deb ... 2021-02-13T17:50:56.714 INFO:teuthology.orchestra.run.gibba036.stdout:Unpacking python-decorator (4.1.2-1) ... 2021-02-13T17:50:56.768 INFO:teuthology.orchestra.run.gibba025.stdout:Selecting previously unselected package python-joblib. 2021-02-13T17:50:56.776 INFO:teuthology.orchestra.run.gibba025.stdout:Preparing to unpack .../061-python-joblib_0.11-1_all.deb ... 2021-02-13T17:50:56.818 INFO:teuthology.orchestra.run.gibba025.stdout:Unpacking python-joblib (0.11-1) ... 2021-02-13T17:50:57.146 INFO:teuthology.orchestra.run.gibba025.stdout:Selecting previously unselected package python-sklearn. 2021-02-13T17:50:57.167 INFO:teuthology.orchestra.run.gibba025.stdout:Preparing to unpack .../062-python-sklearn_0.19.1-3_all.deb ... 2021-02-13T17:50:57.204 INFO:teuthology.orchestra.run.gibba025.stdout:Unpacking python-sklearn (0.19.1-3) ... 2021-02-13T17:50:57.759 INFO:teuthology.orchestra.run.gibba036.stdout:Selecting previously unselected package python-scipy. 2021-02-13T17:50:57.779 INFO:teuthology.orchestra.run.gibba036.stdout:Preparing to unpack .../059-python-scipy_0.19.1-2ubuntu1_amd64.deb ... 2021-02-13T17:50:57.825 INFO:teuthology.orchestra.run.gibba036.stdout:Unpacking python-scipy (0.19.1-2ubuntu1) ... 2021-02-13T17:50:58.286 INFO:teuthology.orchestra.run.gibba025.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2021-02-13T17:50:58.307 INFO:teuthology.orchestra.run.gibba025.stdout:Preparing to unpack .../063-ceph-mgr-diskprediction-local_14.2.16-285-g7194982c-1bionic_all.deb ... 2021-02-13T17:50:58.344 INFO:teuthology.orchestra.run.gibba025.stdout:Unpacking ceph-mgr-diskprediction-local (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:50:58.758 INFO:teuthology.orchestra.run.gibba036.stdout:Selecting previously unselected package python-sklearn-lib. 2021-02-13T17:50:58.780 INFO:teuthology.orchestra.run.gibba036.stdout:Preparing to unpack .../060-python-sklearn-lib_0.19.1-3_amd64.deb ... 2021-02-13T17:50:58.850 INFO:teuthology.orchestra.run.gibba036.stdout:Unpacking python-sklearn-lib (0.19.1-3) ... 2021-02-13T17:50:58.913 INFO:teuthology.orchestra.run.gibba025.stdout:Selecting previously unselected package python-monotonic. 2021-02-13T17:50:58.921 INFO:teuthology.orchestra.run.gibba025.stdout:Preparing to unpack .../064-python-monotonic_1.1-2_all.deb ... 2021-02-13T17:50:58.963 INFO:teuthology.orchestra.run.gibba025.stdout:Unpacking python-monotonic (1.1-2) ... 2021-02-13T17:50:59.291 INFO:teuthology.orchestra.run.gibba025.stdout:Selecting previously unselected package python-fasteners. 2021-02-13T17:50:59.295 INFO:teuthology.orchestra.run.gibba036.stdout:Selecting previously unselected package python-joblib. 2021-02-13T17:50:59.303 INFO:teuthology.orchestra.run.gibba036.stdout:Preparing to unpack .../061-python-joblib_0.11-1_all.deb ... 2021-02-13T17:50:59.311 INFO:teuthology.orchestra.run.gibba025.stdout:Preparing to unpack .../065-python-fasteners_0.12.0-3_all.deb ... 2021-02-13T17:50:59.345 INFO:teuthology.orchestra.run.gibba036.stdout:Unpacking python-joblib (0.11-1) ... 2021-02-13T17:50:59.357 INFO:teuthology.orchestra.run.gibba025.stdout:Unpacking python-fasteners (0.12.0-3) ... 2021-02-13T17:50:59.664 INFO:teuthology.orchestra.run.gibba036.stdout:Selecting previously unselected package python-sklearn. 2021-02-13T17:50:59.668 INFO:teuthology.orchestra.run.gibba025.stdout:Selecting previously unselected package python-httplib2. 2021-02-13T17:50:59.676 INFO:teuthology.orchestra.run.gibba025.stdout:Preparing to unpack .../066-python-httplib2_0.9.2+dfsg-1ubuntu0.2_all.deb ... 2021-02-13T17:50:59.685 INFO:teuthology.orchestra.run.gibba036.stdout:Preparing to unpack .../062-python-sklearn_0.19.1-3_all.deb ... 2021-02-13T17:50:59.718 INFO:teuthology.orchestra.run.gibba025.stdout:Unpacking python-httplib2 (0.9.2+dfsg-1ubuntu0.2) ... 2021-02-13T17:50:59.722 INFO:teuthology.orchestra.run.gibba036.stdout:Unpacking python-sklearn (0.19.1-3) ... 2021-02-13T17:51:00.037 INFO:teuthology.orchestra.run.gibba025.stdout:Selecting previously unselected package python-pyasn1. 2021-02-13T17:51:00.041 INFO:teuthology.orchestra.run.gibba025.stdout:Preparing to unpack .../067-python-pyasn1_0.4.2-3_all.deb ... 2021-02-13T17:51:00.079 INFO:teuthology.orchestra.run.gibba025.stdout:Unpacking python-pyasn1 (0.4.2-3) ... 2021-02-13T17:51:00.120 INFO:teuthology.orchestra.run.gibba036.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2021-02-13T17:51:00.127 INFO:teuthology.orchestra.run.gibba036.stdout:Preparing to unpack .../063-ceph-mgr-diskprediction-local_14.2.16-285-g7194982c-1bionic_all.deb ... 2021-02-13T17:51:00.170 INFO:teuthology.orchestra.run.gibba036.stdout:Unpacking ceph-mgr-diskprediction-local (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:51:00.399 INFO:teuthology.orchestra.run.gibba025.stdout:Selecting previously unselected package python-pyasn1-modules. 2021-02-13T17:51:00.407 INFO:teuthology.orchestra.run.gibba025.stdout:Preparing to unpack .../068-python-pyasn1-modules_0.2.1-0.2_all.deb ... 2021-02-13T17:51:00.449 INFO:teuthology.orchestra.run.gibba025.stdout:Unpacking python-pyasn1-modules (0.2.1-0.2) ... 2021-02-13T17:51:00.723 INFO:teuthology.orchestra.run.gibba036.stdout:Selecting previously unselected package python-monotonic. 2021-02-13T17:51:00.729 INFO:teuthology.orchestra.run.gibba036.stdout:Preparing to unpack .../064-python-monotonic_1.1-2_all.deb ... 2021-02-13T17:51:00.772 INFO:teuthology.orchestra.run.gibba036.stdout:Unpacking python-monotonic (1.1-2) ... 2021-02-13T17:51:00.776 INFO:teuthology.orchestra.run.gibba025.stdout:Selecting previously unselected package python-rsa. 2021-02-13T17:51:00.797 INFO:teuthology.orchestra.run.gibba025.stdout:Preparing to unpack .../069-python-rsa_3.4.2-1_all.deb ... 2021-02-13T17:51:00.843 INFO:teuthology.orchestra.run.gibba025.stdout:Unpacking python-rsa (3.4.2-1) ... 2021-02-13T17:51:01.075 INFO:teuthology.orchestra.run.gibba036.stdout:Selecting previously unselected package python-fasteners. 2021-02-13T17:51:01.095 INFO:teuthology.orchestra.run.gibba036.stdout:Preparing to unpack .../065-python-fasteners_0.12.0-3_all.deb ... 2021-02-13T17:51:01.142 INFO:teuthology.orchestra.run.gibba036.stdout:Unpacking python-fasteners (0.12.0-3) ... 2021-02-13T17:51:01.155 INFO:teuthology.orchestra.run.gibba025.stdout:Selecting previously unselected package python-sqlalchemy. 2021-02-13T17:51:01.163 INFO:teuthology.orchestra.run.gibba025.stdout:Preparing to unpack .../070-python-sqlalchemy_1.1.11+ds1-1ubuntu1_all.deb ... 2021-02-13T17:51:01.204 INFO:teuthology.orchestra.run.gibba025.stdout:Unpacking python-sqlalchemy (1.1.11+ds1-1ubuntu1) ... 2021-02-13T17:51:01.469 INFO:teuthology.orchestra.run.gibba036.stdout:Selecting previously unselected package python-httplib2. 2021-02-13T17:51:01.476 INFO:teuthology.orchestra.run.gibba036.stdout:Preparing to unpack .../066-python-httplib2_0.9.2+dfsg-1ubuntu0.2_all.deb ... 2021-02-13T17:51:01.519 INFO:teuthology.orchestra.run.gibba036.stdout:Unpacking python-httplib2 (0.9.2+dfsg-1ubuntu0.2) ... 2021-02-13T17:51:01.609 INFO:teuthology.orchestra.run.gibba025.stdout:Selecting previously unselected package python-oauth2client. 2021-02-13T17:51:01.629 INFO:teuthology.orchestra.run.gibba025.stdout:Preparing to unpack .../071-python-oauth2client_4.1.2-3_all.deb ... 2021-02-13T17:51:01.675 INFO:teuthology.orchestra.run.gibba025.stdout:Unpacking python-oauth2client (4.1.2-3) ... 2021-02-13T17:51:01.839 INFO:teuthology.orchestra.run.gibba036.stdout:Selecting previously unselected package python-pyasn1. 2021-02-13T17:51:01.859 INFO:teuthology.orchestra.run.gibba036.stdout:Preparing to unpack .../067-python-pyasn1_0.4.2-3_all.deb ... 2021-02-13T17:51:01.939 INFO:teuthology.orchestra.run.gibba036.stdout:Unpacking python-pyasn1 (0.4.2-3) ... 2021-02-13T17:51:02.020 INFO:teuthology.orchestra.run.gibba025.stdout:Selecting previously unselected package python-websocket. 2021-02-13T17:51:02.028 INFO:teuthology.orchestra.run.gibba025.stdout:Preparing to unpack .../072-python-websocket_0.44.0-0ubuntu2_all.deb ... 2021-02-13T17:51:02.069 INFO:teuthology.orchestra.run.gibba025.stdout:Unpacking python-websocket (0.44.0-0ubuntu2) ... 2021-02-13T17:51:02.292 INFO:teuthology.orchestra.run.gibba036.stdout:Selecting previously unselected package python-pyasn1-modules. 2021-02-13T17:51:02.299 INFO:teuthology.orchestra.run.gibba036.stdout:Preparing to unpack .../068-python-pyasn1-modules_0.2.1-0.2_all.deb ... 2021-02-13T17:51:02.341 INFO:teuthology.orchestra.run.gibba036.stdout:Unpacking python-pyasn1-modules (0.2.1-0.2) ... 2021-02-13T17:51:02.415 INFO:teuthology.orchestra.run.gibba025.stdout:Selecting previously unselected package python-yaml. 2021-02-13T17:51:02.435 INFO:teuthology.orchestra.run.gibba025.stdout:Preparing to unpack .../073-python-yaml_3.12-1build2_amd64.deb ... 2021-02-13T17:51:02.506 INFO:teuthology.orchestra.run.gibba025.stdout:Unpacking python-yaml (3.12-1build2) ... 2021-02-13T17:51:02.644 INFO:teuthology.orchestra.run.gibba036.stdout:Selecting previously unselected package python-rsa. 2021-02-13T17:51:02.664 INFO:teuthology.orchestra.run.gibba036.stdout:Preparing to unpack .../069-python-rsa_3.4.2-1_all.deb ... 2021-02-13T17:51:02.702 INFO:teuthology.orchestra.run.gibba036.stdout:Unpacking python-rsa (3.4.2-1) ... 2021-02-13T17:51:02.834 INFO:teuthology.orchestra.run.gibba025.stdout:Selecting previously unselected package python-kubernetes. 2021-02-13T17:51:02.841 INFO:teuthology.orchestra.run.gibba025.stdout:Preparing to unpack .../074-python-kubernetes_2.0.0-2ubuntu1_all.deb ... 2021-02-13T17:51:02.883 INFO:teuthology.orchestra.run.gibba025.stdout:Unpacking python-kubernetes (2.0.0-2ubuntu1) ... 2021-02-13T17:51:03.031 INFO:teuthology.orchestra.run.gibba036.stdout:Selecting previously unselected package python-sqlalchemy. 2021-02-13T17:51:03.051 INFO:teuthology.orchestra.run.gibba036.stdout:Preparing to unpack .../070-python-sqlalchemy_1.1.11+ds1-1ubuntu1_all.deb ... 2021-02-13T17:51:03.089 INFO:teuthology.orchestra.run.gibba036.stdout:Unpacking python-sqlalchemy (1.1.11+ds1-1ubuntu1) ... 2021-02-13T17:51:03.229 INFO:teuthology.orchestra.run.gibba025.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2021-02-13T17:51:03.250 INFO:teuthology.orchestra.run.gibba025.stdout:Preparing to unpack .../075-ceph-mgr-k8sevents_14.2.16-285-g7194982c-1bionic_all.deb ... 2021-02-13T17:51:03.296 INFO:teuthology.orchestra.run.gibba025.stdout:Unpacking ceph-mgr-k8sevents (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:51:03.468 INFO:teuthology.orchestra.run.gibba036.stdout:Selecting previously unselected package python-oauth2client. 2021-02-13T17:51:03.475 INFO:teuthology.orchestra.run.gibba036.stdout:Preparing to unpack .../071-python-oauth2client_4.1.2-3_all.deb ... 2021-02-13T17:51:03.517 INFO:teuthology.orchestra.run.gibba036.stdout:Unpacking python-oauth2client (4.1.2-3) ... 2021-02-13T17:51:03.598 INFO:teuthology.orchestra.run.gibba025.stdout:Selecting previously unselected package ceph-mgr-rook. 2021-02-13T17:51:03.606 INFO:teuthology.orchestra.run.gibba025.stdout:Preparing to unpack .../076-ceph-mgr-rook_14.2.16-285-g7194982c-1bionic_all.deb ... 2021-02-13T17:51:03.648 INFO:teuthology.orchestra.run.gibba025.stdout:Unpacking ceph-mgr-rook (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:51:03.887 INFO:teuthology.orchestra.run.gibba036.stdout:Selecting previously unselected package python-websocket. 2021-02-13T17:51:03.907 INFO:teuthology.orchestra.run.gibba036.stdout:Preparing to unpack .../072-python-websocket_0.44.0-0ubuntu2_all.deb ... 2021-02-13T17:51:03.953 INFO:teuthology.orchestra.run.gibba036.stdout:Unpacking python-websocket (0.44.0-0ubuntu2) ... 2021-02-13T17:51:03.959 INFO:teuthology.orchestra.run.gibba025.stdout:Selecting previously unselected package ceph-mgr-ssh. 2021-02-13T17:51:03.980 INFO:teuthology.orchestra.run.gibba025.stdout:Preparing to unpack .../077-ceph-mgr-ssh_14.2.16-285-g7194982c-1bionic_all.deb ... 2021-02-13T17:51:04.017 INFO:teuthology.orchestra.run.gibba025.stdout:Unpacking ceph-mgr-ssh (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:51:04.282 INFO:teuthology.orchestra.run.gibba036.stdout:Selecting previously unselected package python-yaml. 2021-02-13T17:51:04.289 INFO:teuthology.orchestra.run.gibba036.stdout:Preparing to unpack .../073-python-yaml_3.12-1build2_amd64.deb ... 2021-02-13T17:51:04.331 INFO:teuthology.orchestra.run.gibba036.stdout:Unpacking python-yaml (3.12-1build2) ... 2021-02-13T17:51:04.361 INFO:teuthology.orchestra.run.gibba025.stdout:Selecting previously unselected package libonig4:amd64. 2021-02-13T17:51:04.369 INFO:teuthology.orchestra.run.gibba025.stdout:Preparing to unpack .../078-libonig4_6.7.0-1_amd64.deb ... 2021-02-13T17:51:04.411 INFO:teuthology.orchestra.run.gibba025.stdout:Unpacking libonig4:amd64 (6.7.0-1) ... 2021-02-13T17:51:04.651 INFO:teuthology.orchestra.run.gibba036.stdout:Selecting previously unselected package python-kubernetes. 2021-02-13T17:51:04.754 INFO:teuthology.orchestra.run.gibba025.stdout:Selecting previously unselected package libjq1:amd64. 2021-02-13T17:51:04.754 INFO:teuthology.orchestra.run.gibba036.stdout:Preparing to unpack .../074-python-kubernetes_2.0.0-2ubuntu1_all.deb ... 2021-02-13T17:51:04.754 INFO:teuthology.orchestra.run.gibba036.stdout:Unpacking python-kubernetes (2.0.0-2ubuntu1) ... 2021-02-13T17:51:04.760 INFO:teuthology.orchestra.run.gibba025.stdout:Preparing to unpack .../079-libjq1_1.5+dfsg-2_amd64.deb ... 2021-02-13T17:51:04.806 INFO:teuthology.orchestra.run.gibba025.stdout:Unpacking libjq1:amd64 (1.5+dfsg-2) ... 2021-02-13T17:51:05.087 INFO:teuthology.orchestra.run.gibba036.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2021-02-13T17:51:05.100 INFO:teuthology.orchestra.run.gibba025.stdout:Selecting previously unselected package jq. 2021-02-13T17:51:05.107 INFO:teuthology.orchestra.run.gibba025.stdout:Preparing to unpack .../080-jq_1.5+dfsg-2_amd64.deb ... 2021-02-13T17:51:05.108 INFO:teuthology.orchestra.run.gibba036.stdout:Preparing to unpack .../075-ceph-mgr-k8sevents_14.2.16-285-g7194982c-1bionic_all.deb ... 2021-02-13T17:51:05.154 INFO:teuthology.orchestra.run.gibba036.stdout:Unpacking ceph-mgr-k8sevents (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:51:05.235 INFO:teuthology.orchestra.run.gibba025.stdout:Unpacking jq (1.5+dfsg-2) ... 2021-02-13T17:51:05.489 INFO:teuthology.orchestra.run.gibba036.stdout:Selecting previously unselected package ceph-mgr-rook. 2021-02-13T17:51:05.497 INFO:teuthology.orchestra.run.gibba036.stdout:Preparing to unpack .../076-ceph-mgr-rook_14.2.16-285-g7194982c-1bionic_all.deb ... 2021-02-13T17:51:05.504 INFO:teuthology.orchestra.run.gibba025.stdout:Selecting previously unselected package socat. 2021-02-13T17:51:05.524 INFO:teuthology.orchestra.run.gibba025.stdout:Preparing to unpack .../081-socat_1.7.3.2-2ubuntu2_amd64.deb ... 2021-02-13T17:51:05.539 INFO:teuthology.orchestra.run.gibba036.stdout:Unpacking ceph-mgr-rook (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:51:05.562 INFO:teuthology.orchestra.run.gibba025.stdout:Unpacking socat (1.7.3.2-2ubuntu2) ... 2021-02-13T17:51:05.842 INFO:teuthology.orchestra.run.gibba036.stdout:Selecting previously unselected package ceph-mgr-ssh. 2021-02-13T17:51:05.863 INFO:teuthology.orchestra.run.gibba036.stdout:Preparing to unpack .../077-ceph-mgr-ssh_14.2.16-285-g7194982c-1bionic_all.deb ... 2021-02-13T17:51:05.900 INFO:teuthology.orchestra.run.gibba036.stdout:Unpacking ceph-mgr-ssh (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:51:05.958 INFO:teuthology.orchestra.run.gibba025.stdout:Selecting previously unselected package libxslt1.1:amd64. 2021-02-13T17:51:05.965 INFO:teuthology.orchestra.run.gibba025.stdout:Preparing to unpack .../082-libxslt1.1_1.1.29-5ubuntu0.2_amd64.deb ... 2021-02-13T17:51:06.007 INFO:teuthology.orchestra.run.gibba025.stdout:Unpacking libxslt1.1:amd64 (1.1.29-5ubuntu0.2) ... 2021-02-13T17:51:06.236 INFO:teuthology.orchestra.run.gibba036.stdout:Selecting previously unselected package libonig4:amd64. 2021-02-13T17:51:06.244 INFO:teuthology.orchestra.run.gibba036.stdout:Preparing to unpack .../078-libonig4_6.7.0-1_amd64.deb ... 2021-02-13T17:51:06.285 INFO:teuthology.orchestra.run.gibba025.stdout:Selecting previously unselected package xmlstarlet. 2021-02-13T17:51:06.286 INFO:teuthology.orchestra.run.gibba036.stdout:Unpacking libonig4:amd64 (6.7.0-1) ... 2021-02-13T17:51:06.306 INFO:teuthology.orchestra.run.gibba025.stdout:Preparing to unpack .../083-xmlstarlet_1.6.1-2_amd64.deb ... 2021-02-13T17:51:06.351 INFO:teuthology.orchestra.run.gibba025.stdout:Unpacking xmlstarlet (1.6.1-2) ... 2021-02-13T17:51:06.639 INFO:teuthology.orchestra.run.gibba036.stdout:Selecting previously unselected package libjq1:amd64. 2021-02-13T17:51:06.659 INFO:teuthology.orchestra.run.gibba036.stdout:Preparing to unpack .../079-libjq1_1.5+dfsg-2_amd64.deb ... 2021-02-13T17:51:06.680 INFO:teuthology.orchestra.run.gibba025.stdout:Selecting previously unselected package ceph-test. 2021-02-13T17:51:06.701 INFO:teuthology.orchestra.run.gibba025.stdout:Preparing to unpack .../084-ceph-test_14.2.16-285-g7194982c-1bionic_amd64.deb ... 2021-02-13T17:51:06.705 INFO:teuthology.orchestra.run.gibba036.stdout:Unpacking libjq1:amd64 (1.5+dfsg-2) ... 2021-02-13T17:51:06.747 INFO:teuthology.orchestra.run.gibba025.stdout:Unpacking ceph-test (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:51:07.030 INFO:teuthology.orchestra.run.gibba036.stdout:Selecting previously unselected package jq. 2021-02-13T17:51:07.101 INFO:teuthology.orchestra.run.gibba036.stdout:Preparing to unpack .../080-jq_1.5+dfsg-2_amd64.deb ... 2021-02-13T17:51:07.468 INFO:teuthology.orchestra.run.gibba036.stdout:Unpacking jq (1.5+dfsg-2) ... 2021-02-13T17:51:07.720 INFO:teuthology.orchestra.run.gibba036.stdout:Selecting previously unselected package socat. 2021-02-13T17:51:07.741 INFO:teuthology.orchestra.run.gibba036.stdout:Preparing to unpack .../081-socat_1.7.3.2-2ubuntu2_amd64.deb ... 2021-02-13T17:51:07.778 INFO:teuthology.orchestra.run.gibba036.stdout:Unpacking socat (1.7.3.2-2ubuntu2) ... 2021-02-13T17:51:08.148 INFO:teuthology.orchestra.run.gibba036.stdout:Selecting previously unselected package libxslt1.1:amd64. 2021-02-13T17:51:08.156 INFO:teuthology.orchestra.run.gibba036.stdout:Preparing to unpack .../082-libxslt1.1_1.1.29-5ubuntu0.2_amd64.deb ... 2021-02-13T17:51:08.198 INFO:teuthology.orchestra.run.gibba036.stdout:Unpacking libxslt1.1:amd64 (1.1.29-5ubuntu0.2) ... 2021-02-13T17:51:08.476 INFO:teuthology.orchestra.run.gibba036.stdout:Selecting previously unselected package xmlstarlet. 2021-02-13T17:51:08.497 INFO:teuthology.orchestra.run.gibba036.stdout:Preparing to unpack .../083-xmlstarlet_1.6.1-2_amd64.deb ... 2021-02-13T17:51:08.542 INFO:teuthology.orchestra.run.gibba036.stdout:Unpacking xmlstarlet (1.6.1-2) ... 2021-02-13T17:51:08.601 INFO:teuthology.orchestra.run.gibba025.stdout:Selecting previously unselected package libcephfs-dev. 2021-02-13T17:51:08.619 INFO:teuthology.orchestra.run.gibba025.stdout:Preparing to unpack .../085-libcephfs-dev_14.2.16-285-g7194982c-1bionic_amd64.deb ... 2021-02-13T17:51:08.659 INFO:teuthology.orchestra.run.gibba025.stdout:Unpacking libcephfs-dev (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:51:08.846 INFO:teuthology.orchestra.run.gibba036.stdout:Selecting previously unselected package ceph-test. 2021-02-13T17:51:08.867 INFO:teuthology.orchestra.run.gibba036.stdout:Preparing to unpack .../084-ceph-test_14.2.16-285-g7194982c-1bionic_amd64.deb ... 2021-02-13T17:51:08.886 INFO:teuthology.orchestra.run.gibba025.stdout:Selecting previously unselected package nvme-cli. 2021-02-13T17:51:08.905 INFO:teuthology.orchestra.run.gibba025.stdout:Preparing to unpack .../086-nvme-cli_1.5-1ubuntu1.1_amd64.deb ... 2021-02-13T17:51:08.913 INFO:teuthology.orchestra.run.gibba036.stdout:Unpacking ceph-test (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:51:08.936 INFO:teuthology.orchestra.run.gibba025.stdout:Unpacking nvme-cli (1.5-1ubuntu1.1) ... 2021-02-13T17:51:09.216 INFO:teuthology.orchestra.run.gibba025.stdout:Selecting previously unselected package python-attr. 2021-02-13T17:51:09.235 INFO:teuthology.orchestra.run.gibba025.stdout:Preparing to unpack .../087-python-attr_17.4.0-2_all.deb ... 2021-02-13T17:51:09.274 INFO:teuthology.orchestra.run.gibba025.stdout:Unpacking python-attr (17.4.0-2) ... 2021-02-13T17:51:09.535 INFO:teuthology.orchestra.run.gibba025.stdout:Selecting previously unselected package python-ceph. 2021-02-13T17:51:09.543 INFO:teuthology.orchestra.run.gibba025.stdout:Preparing to unpack .../088-python-ceph_14.2.16-285-g7194982c-1bionic_amd64.deb ... 2021-02-13T17:51:09.584 INFO:teuthology.orchestra.run.gibba025.stdout:Unpacking python-ceph (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:51:09.879 INFO:teuthology.orchestra.run.gibba025.stdout:Selecting previously unselected package python-funcsigs. 2021-02-13T17:51:09.899 INFO:teuthology.orchestra.run.gibba025.stdout:Preparing to unpack .../089-python-funcsigs_1.0.2-4_all.deb ... 2021-02-13T17:51:09.937 INFO:teuthology.orchestra.run.gibba025.stdout:Unpacking python-funcsigs (1.0.2-4) ... 2021-02-13T17:51:10.189 INFO:teuthology.orchestra.run.gibba025.stdout:Selecting previously unselected package python-webencodings. 2021-02-13T17:51:10.210 INFO:teuthology.orchestra.run.gibba025.stdout:Preparing to unpack .../090-python-webencodings_0.5-2_all.deb ... 2021-02-13T17:51:10.247 INFO:teuthology.orchestra.run.gibba025.stdout:Unpacking python-webencodings (0.5-2) ... 2021-02-13T17:51:10.509 INFO:teuthology.orchestra.run.gibba025.stdout:Selecting previously unselected package python-html5lib. 2021-02-13T17:51:10.530 INFO:teuthology.orchestra.run.gibba025.stdout:Preparing to unpack .../091-python-html5lib_0.999999999-1_all.deb ... 2021-02-13T17:51:10.566 INFO:teuthology.orchestra.run.gibba036.stdout:Selecting previously unselected package libcephfs-dev. 2021-02-13T17:51:10.567 INFO:teuthology.orchestra.run.gibba025.stdout:Unpacking python-html5lib (0.999999999-1) ... 2021-02-13T17:51:10.585 INFO:teuthology.orchestra.run.gibba036.stdout:Preparing to unpack .../085-libcephfs-dev_14.2.16-285-g7194982c-1bionic_amd64.deb ... 2021-02-13T17:51:10.632 INFO:teuthology.orchestra.run.gibba036.stdout:Unpacking libcephfs-dev (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:51:10.853 INFO:teuthology.orchestra.run.gibba025.stdout:Selecting previously unselected package python-lxml:amd64. 2021-02-13T17:51:10.874 INFO:teuthology.orchestra.run.gibba025.stdout:Preparing to unpack .../092-python-lxml_4.2.1-1ubuntu0.3_amd64.deb ... 2021-02-13T17:51:10.910 INFO:teuthology.orchestra.run.gibba036.stdout:Selecting previously unselected package nvme-cli. 2021-02-13T17:51:10.911 INFO:teuthology.orchestra.run.gibba025.stdout:Unpacking python-lxml:amd64 (4.2.1-1ubuntu0.3) ... 2021-02-13T17:51:10.929 INFO:teuthology.orchestra.run.gibba036.stdout:Preparing to unpack .../086-nvme-cli_1.5-1ubuntu1.1_amd64.deb ... 2021-02-13T17:51:10.968 INFO:teuthology.orchestra.run.gibba036.stdout:Unpacking nvme-cli (1.5-1ubuntu1.1) ... 2021-02-13T17:51:11.273 INFO:teuthology.orchestra.run.gibba025.stdout:Selecting previously unselected package python-openid. 2021-02-13T17:51:11.289 INFO:teuthology.orchestra.run.gibba036.stdout:Selecting previously unselected package python-attr. 2021-02-13T17:51:11.293 INFO:teuthology.orchestra.run.gibba025.stdout:Preparing to unpack .../093-python-openid_2.2.5-6_all.deb ... 2021-02-13T17:51:11.296 INFO:teuthology.orchestra.run.gibba036.stdout:Preparing to unpack .../087-python-attr_17.4.0-2_all.deb ... 2021-02-13T17:51:11.331 INFO:teuthology.orchestra.run.gibba025.stdout:Unpacking python-openid (2.2.5-6) ... 2021-02-13T17:51:11.338 INFO:teuthology.orchestra.run.gibba036.stdout:Unpacking python-attr (17.4.0-2) ... 2021-02-13T17:51:11.591 INFO:teuthology.orchestra.run.gibba036.stdout:Selecting previously unselected package python-ceph. 2021-02-13T17:51:11.610 INFO:teuthology.orchestra.run.gibba036.stdout:Preparing to unpack .../088-python-ceph_14.2.16-285-g7194982c-1bionic_amd64.deb ... 2021-02-13T17:51:11.649 INFO:teuthology.orchestra.run.gibba036.stdout:Unpacking python-ceph (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:51:11.651 INFO:teuthology.orchestra.run.gibba025.stdout:Selecting previously unselected package python-pastescript. 2021-02-13T17:51:11.659 INFO:teuthology.orchestra.run.gibba025.stdout:Preparing to unpack .../094-python-pastescript_2.0.2-2_all.deb ... 2021-02-13T17:51:11.701 INFO:teuthology.orchestra.run.gibba025.stdout:Unpacking python-pastescript (2.0.2-2) ... 2021-02-13T17:51:11.952 INFO:teuthology.orchestra.run.gibba036.stdout:Selecting previously unselected package python-funcsigs. 2021-02-13T17:51:11.960 INFO:teuthology.orchestra.run.gibba036.stdout:Preparing to unpack .../089-python-funcsigs_1.0.2-4_all.deb ... 2021-02-13T17:51:12.001 INFO:teuthology.orchestra.run.gibba036.stdout:Unpacking python-funcsigs (1.0.2-4) ... 2021-02-13T17:51:12.046 INFO:teuthology.orchestra.run.gibba025.stdout:Selecting previously unselected package python-pluggy. 2021-02-13T17:51:12.053 INFO:teuthology.orchestra.run.gibba025.stdout:Preparing to unpack .../095-python-pluggy_0.6.0-1_all.deb ... 2021-02-13T17:51:12.087 INFO:teuthology.orchestra.run.gibba025.stdout:Unpacking python-pluggy (0.6.0-1) ... 2021-02-13T17:51:12.330 INFO:teuthology.orchestra.run.gibba036.stdout:Selecting previously unselected package python-webencodings. 2021-02-13T17:51:12.349 INFO:teuthology.orchestra.run.gibba036.stdout:Preparing to unpack .../090-python-webencodings_0.5-2_all.deb ... 2021-02-13T17:51:12.388 INFO:teuthology.orchestra.run.gibba036.stdout:Unpacking python-webencodings (0.5-2) ... 2021-02-13T17:51:12.413 INFO:teuthology.orchestra.run.gibba025.stdout:Selecting previously unselected package python-py. 2021-02-13T17:51:12.434 INFO:teuthology.orchestra.run.gibba025.stdout:Preparing to unpack .../096-python-py_1.5.2-1_all.deb ... 2021-02-13T17:51:12.473 INFO:teuthology.orchestra.run.gibba025.stdout:Unpacking python-py (1.5.2-1) ... 2021-02-13T17:51:12.707 INFO:teuthology.orchestra.run.gibba036.stdout:Selecting previously unselected package python-html5lib. 2021-02-13T17:51:12.714 INFO:teuthology.orchestra.run.gibba036.stdout:Preparing to unpack .../091-python-html5lib_0.999999999-1_all.deb ... 2021-02-13T17:51:12.756 INFO:teuthology.orchestra.run.gibba036.stdout:Unpacking python-html5lib (0.999999999-1) ... 2021-02-13T17:51:12.819 INFO:teuthology.orchestra.run.gibba025.stdout:Selecting previously unselected package python-pyinotify. 2021-02-13T17:51:12.827 INFO:teuthology.orchestra.run.gibba025.stdout:Preparing to unpack .../097-python-pyinotify_0.9.6-1_all.deb ... 2021-02-13T17:51:12.868 INFO:teuthology.orchestra.run.gibba025.stdout:Unpacking python-pyinotify (0.9.6-1) ... 2021-02-13T17:51:13.076 INFO:teuthology.orchestra.run.gibba036.stdout:Selecting previously unselected package python-lxml:amd64. 2021-02-13T17:51:13.097 INFO:teuthology.orchestra.run.gibba036.stdout:Preparing to unpack .../092-python-lxml_4.2.1-1ubuntu0.3_amd64.deb ... 2021-02-13T17:51:13.143 INFO:teuthology.orchestra.run.gibba036.stdout:Unpacking python-lxml:amd64 (4.2.1-1ubuntu0.3) ... 2021-02-13T17:51:13.171 INFO:teuthology.orchestra.run.gibba025.stdout:Selecting previously unselected package python-pytest. 2021-02-13T17:51:13.191 INFO:teuthology.orchestra.run.gibba025.stdout:Preparing to unpack .../098-python-pytest_3.3.2-2_all.deb ... 2021-02-13T17:51:13.237 INFO:teuthology.orchestra.run.gibba025.stdout:Unpacking python-pytest (3.3.2-2) ... 2021-02-13T17:51:13.554 INFO:teuthology.orchestra.run.gibba036.stdout:Selecting previously unselected package python-openid. 2021-02-13T17:51:13.557 INFO:teuthology.orchestra.run.gibba025.stdout:Selecting previously unselected package python-scgi. 2021-02-13T17:51:13.562 INFO:teuthology.orchestra.run.gibba036.stdout:Preparing to unpack .../093-python-openid_2.2.5-6_all.deb ... 2021-02-13T17:51:13.565 INFO:teuthology.orchestra.run.gibba025.stdout:Preparing to unpack .../099-python-scgi_1.13-1.1build1_amd64.deb ... 2021-02-13T17:51:13.604 INFO:teuthology.orchestra.run.gibba036.stdout:Unpacking python-openid (2.2.5-6) ... 2021-02-13T17:51:13.606 INFO:teuthology.orchestra.run.gibba025.stdout:Unpacking python-scgi (1.13-1.1build1) ... 2021-02-13T17:51:13.876 INFO:teuthology.orchestra.run.gibba025.stdout:Selecting previously unselected package python-sqlalchemy-ext. 2021-02-13T17:51:13.897 INFO:teuthology.orchestra.run.gibba025.stdout:Preparing to unpack .../100-python-sqlalchemy-ext_1.1.11+ds1-1ubuntu1_amd64.deb ... 2021-02-13T17:51:13.907 INFO:teuthology.orchestra.run.gibba036.stdout:Selecting previously unselected package python-pastescript. 2021-02-13T17:51:13.928 INFO:teuthology.orchestra.run.gibba036.stdout:Preparing to unpack .../094-python-pastescript_2.0.2-2_all.deb ... 2021-02-13T17:51:13.943 INFO:teuthology.orchestra.run.gibba025.stdout:Unpacking python-sqlalchemy-ext (1.1.11+ds1-1ubuntu1) ... 2021-02-13T17:51:13.973 INFO:teuthology.orchestra.run.gibba036.stdout:Unpacking python-pastescript (2.0.2-2) ... 2021-02-13T17:51:14.261 INFO:teuthology.orchestra.run.gibba036.stdout:Selecting previously unselected package python-pluggy. 2021-02-13T17:51:14.281 INFO:teuthology.orchestra.run.gibba036.stdout:Preparing to unpack .../095-python-pluggy_0.6.0-1_all.deb ... 2021-02-13T17:51:14.304 INFO:teuthology.orchestra.run.gibba025.stdout:Selecting previously unselected package radosgw. 2021-02-13T17:51:14.311 INFO:teuthology.orchestra.run.gibba025.stdout:Preparing to unpack .../101-radosgw_14.2.16-285-g7194982c-1bionic_amd64.deb ... 2021-02-13T17:51:14.318 INFO:teuthology.orchestra.run.gibba036.stdout:Unpacking python-pluggy (0.6.0-1) ... 2021-02-13T17:51:14.353 INFO:teuthology.orchestra.run.gibba025.stdout:Unpacking radosgw (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:51:14.605 INFO:teuthology.orchestra.run.gibba036.stdout:Selecting previously unselected package python-py. 2021-02-13T17:51:14.611 INFO:teuthology.orchestra.run.gibba036.stdout:Preparing to unpack .../096-python-py_1.5.2-1_all.deb ... 2021-02-13T17:51:14.646 INFO:teuthology.orchestra.run.gibba036.stdout:Unpacking python-py (1.5.2-1) ... 2021-02-13T17:51:14.915 INFO:teuthology.orchestra.run.gibba025.stdout:Selecting previously unselected package rbd-fuse. 2021-02-13T17:51:14.937 INFO:teuthology.orchestra.run.gibba025.stdout:Preparing to unpack .../102-rbd-fuse_14.2.16-285-g7194982c-1bionic_amd64.deb ... 2021-02-13T17:51:14.966 INFO:teuthology.orchestra.run.gibba036.stdout:Selecting previously unselected package python-pyinotify. 2021-02-13T17:51:14.982 INFO:teuthology.orchestra.run.gibba025.stdout:Unpacking rbd-fuse (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:51:14.988 INFO:teuthology.orchestra.run.gibba036.stdout:Preparing to unpack .../097-python-pyinotify_0.9.6-1_all.deb ... 2021-02-13T17:51:15.024 INFO:teuthology.orchestra.run.gibba036.stdout:Unpacking python-pyinotify (0.9.6-1) ... 2021-02-13T17:51:15.317 INFO:teuthology.orchestra.run.gibba025.stdout:Setting up python-dnspython (1.15.0-1) ... 2021-02-13T17:51:15.343 INFO:teuthology.orchestra.run.gibba036.stdout:Selecting previously unselected package python-pytest. 2021-02-13T17:51:15.351 INFO:teuthology.orchestra.run.gibba036.stdout:Preparing to unpack .../098-python-pytest_3.3.2-2_all.deb ... 2021-02-13T17:51:15.392 INFO:teuthology.orchestra.run.gibba036.stdout:Unpacking python-pytest (3.3.2-2) ... 2021-02-13T17:51:15.503 INFO:teuthology.orchestra.run.gibba025.stdout:Setting up python-simplejson (3.13.2-1) ... 2021-02-13T17:51:15.712 INFO:teuthology.orchestra.run.gibba025.stdout:Setting up python-repoze.lru (0.7-1) ... 2021-02-13T17:51:15.747 INFO:teuthology.orchestra.run.gibba036.stdout:Selecting previously unselected package python-scgi. 2021-02-13T17:51:15.768 INFO:teuthology.orchestra.run.gibba036.stdout:Preparing to unpack .../099-python-scgi_1.13-1.1build1_amd64.deb ... 2021-02-13T17:51:15.804 INFO:teuthology.orchestra.run.gibba036.stdout:Unpacking python-scgi (1.13-1.1build1) ... 2021-02-13T17:51:15.922 INFO:teuthology.orchestra.run.gibba025.stdout:Setting up python-sqlalchemy (1.1.11+ds1-1ubuntu1) ... 2021-02-13T17:51:16.074 INFO:teuthology.orchestra.run.gibba036.stdout:Selecting previously unselected package python-sqlalchemy-ext. 2021-02-13T17:51:16.094 INFO:teuthology.orchestra.run.gibba036.stdout:Preparing to unpack .../100-python-sqlalchemy-ext_1.1.11+ds1-1ubuntu1_amd64.deb ... 2021-02-13T17:51:16.140 INFO:teuthology.orchestra.run.gibba036.stdout:Unpacking python-sqlalchemy-ext (1.1.11+ds1-1ubuntu1) ... 2021-02-13T17:51:16.274 INFO:teuthology.orchestra.run.gibba025.stdout:Setting up python-openid (2.2.5-6) ... 2021-02-13T17:51:16.458 INFO:teuthology.orchestra.run.gibba025.stdout:Setting up python-prettytable (0.7.2-3) ... 2021-02-13T17:51:16.518 INFO:teuthology.orchestra.run.gibba036.stdout:Selecting previously unselected package radosgw. 2021-02-13T17:51:16.523 INFO:teuthology.orchestra.run.gibba036.stdout:Preparing to unpack .../101-radosgw_14.2.16-285-g7194982c-1bionic_amd64.deb ... 2021-02-13T17:51:16.567 INFO:teuthology.orchestra.run.gibba036.stdout:Unpacking radosgw (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:51:16.668 INFO:teuthology.orchestra.run.gibba025.stdout:Setting up python-urllib3 (1.22-1ubuntu0.18.04.2) ... 2021-02-13T17:51:16.894 INFO:teuthology.orchestra.run.gibba025.stdout:Setting up python-yaml (3.12-1build2) ... 2021-02-13T17:51:17.104 INFO:teuthology.orchestra.run.gibba025.stdout:Setting up python-simplegeneric (0.8.1-1) ... 2021-02-13T17:51:17.121 INFO:teuthology.orchestra.run.gibba036.stdout:Selecting previously unselected package rbd-fuse. 2021-02-13T17:51:17.128 INFO:teuthology.orchestra.run.gibba036.stdout:Preparing to unpack .../102-rbd-fuse_14.2.16-285-g7194982c-1bionic_amd64.deb ... 2021-02-13T17:51:17.170 INFO:teuthology.orchestra.run.gibba036.stdout:Unpacking rbd-fuse (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:51:17.263 INFO:teuthology.orchestra.run.gibba025.stdout:Setting up python-chardet (3.0.4-1) ... 2021-02-13T17:51:17.460 INFO:teuthology.orchestra.run.gibba036.stdout:Setting up python-dnspython (1.15.0-1) ... 2021-02-13T17:51:17.514 INFO:teuthology.orchestra.run.gibba025.stdout:Setting up python-attr (17.4.0-2) ... 2021-02-13T17:51:17.650 INFO:teuthology.orchestra.run.gibba036.stdout:Setting up python-simplejson (3.13.2-1) ... 2021-02-13T17:51:17.740 INFO:teuthology.orchestra.run.gibba025.stdout:Setting up libjs-underscore (1.8.3~dfsg-1) ... 2021-02-13T17:51:17.867 INFO:teuthology.orchestra.run.gibba025.stdout:Setting up python-openssl (17.5.0-1ubuntu1) ... 2021-02-13T17:51:17.876 INFO:teuthology.orchestra.run.gibba036.stdout:Setting up python-repoze.lru (0.7-1) ... 2021-02-13T17:51:18.076 INFO:teuthology.orchestra.run.gibba025.stdout:Setting up socat (1.7.3.2-2ubuntu2) ... 2021-02-13T17:51:18.076 INFO:teuthology.orchestra.run.gibba036.stdout:Setting up python-sqlalchemy (1.1.11+ds1-1ubuntu1) ... 2021-02-13T17:51:18.202 INFO:teuthology.orchestra.run.gibba025.stdout:Setting up python-pyasn1 (0.4.2-3) ... 2021-02-13T17:51:18.379 INFO:teuthology.orchestra.run.gibba025.stdout:Setting up python-py (1.5.2-1) ... 2021-02-13T17:51:18.421 INFO:teuthology.orchestra.run.gibba036.stdout:Setting up python-openid (2.2.5-6) ... 2021-02-13T17:51:18.563 INFO:teuthology.orchestra.run.gibba025.stdout:Setting up python-monotonic (1.1-2) ... 2021-02-13T17:51:18.597 INFO:teuthology.orchestra.run.gibba036.stdout:Setting up python-prettytable (0.7.2-3) ... 2021-02-13T17:51:18.764 INFO:teuthology.orchestra.run.gibba025.stdout:Setting up python-joblib (0.11-1) ... 2021-02-13T17:51:18.806 INFO:teuthology.orchestra.run.gibba036.stdout:Setting up python-urllib3 (1.22-1ubuntu0.18.04.2) ... 2021-02-13T17:51:18.983 INFO:teuthology.orchestra.run.gibba036.stdout:Setting up python-yaml (3.12-1build2) ... 2021-02-13T17:51:19.024 INFO:teuthology.orchestra.run.gibba025.stdout:Setting up libonig4:amd64 (6.7.0-1) ... 2021-02-13T17:51:19.150 INFO:teuthology.orchestra.run.gibba025.stdout:Setting up python-pluggy (0.6.0-1) ... 2021-02-13T17:51:19.191 INFO:teuthology.orchestra.run.gibba036.stdout:Setting up python-simplegeneric (0.8.1-1) ... 2021-02-13T17:51:19.317 INFO:teuthology.orchestra.run.gibba025.stdout:Setting up python-certifi (2018.1.18-2) ... 2021-02-13T17:51:19.351 INFO:teuthology.orchestra.run.gibba036.stdout:Setting up python-chardet (3.0.4-1) ... 2021-02-13T17:51:19.485 INFO:teuthology.orchestra.run.gibba025.stdout:Setting up formencode-i18n (1.3.0-0ubuntu5) ... 2021-02-13T17:51:19.560 INFO:teuthology.orchestra.run.gibba036.stdout:Setting up python-attr (17.4.0-2) ... 2021-02-13T17:51:19.611 INFO:teuthology.orchestra.run.gibba025.stdout:Setting up libjs-sphinxdoc (1.6.7-1ubuntu1) ... 2021-02-13T17:51:19.721 INFO:teuthology.orchestra.run.gibba025.stdout:Setting up python-webob (1:1.7.3-2fakesync1) ... 2021-02-13T17:51:19.753 INFO:teuthology.orchestra.run.gibba036.stdout:Setting up libjs-underscore (1.8.3~dfsg-1) ... 2021-02-13T17:51:19.872 INFO:teuthology.orchestra.run.gibba036.stdout:Setting up python-openssl (17.5.0-1ubuntu1) ... 2021-02-13T17:51:19.897 INFO:teuthology.orchestra.run.gibba025.stdout:Setting up python-ceph-argparse (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:51:20.023 INFO:teuthology.orchestra.run.gibba025.stdout:Setting up python-waitress (1.0.1-1) ... 2021-02-13T17:51:20.039 INFO:teuthology.orchestra.run.gibba036.stdout:Setting up socat (1.7.3.2-2ubuntu2) ... 2021-02-13T17:51:20.165 INFO:teuthology.orchestra.run.gibba036.stdout:Setting up python-pyasn1 (0.4.2-3) ... 2021-02-13T17:51:20.341 INFO:teuthology.orchestra.run.gibba036.stdout:Setting up python-py (1.5.2-1) ... 2021-02-13T17:51:20.475 INFO:teuthology.orchestra.run.gibba025.stdout:update-alternatives: using /usr/bin/waitress-serve-python2 to provide /usr/bin/waitress-serve (waitress-serve) in auto mode 2021-02-13T17:51:20.559 INFO:teuthology.orchestra.run.gibba036.stdout:Setting up python-monotonic (1.1-2) ... 2021-02-13T17:51:20.609 INFO:teuthology.orchestra.run.gibba025.stdout:Setting up python-pyasn1-modules (0.2.1-0.2) ... 2021-02-13T17:51:20.718 INFO:teuthology.orchestra.run.gibba036.stdout:Setting up python-joblib (0.11-1) ... 2021-02-13T17:51:20.793 INFO:teuthology.orchestra.run.gibba025.stdout:Setting up python-fasteners (0.12.0-3) ... 2021-02-13T17:51:20.961 INFO:teuthology.orchestra.run.gibba036.stdout:Setting up libonig4:amd64 (6.7.0-1) ... 2021-02-13T17:51:20.994 INFO:teuthology.orchestra.run.gibba025.stdout:Setting up python-jwt (1.5.3+ds1-1) ... 2021-02-13T17:51:21.070 INFO:teuthology.orchestra.run.gibba036.stdout:Setting up python-pluggy (0.6.0-1) ... 2021-02-13T17:51:21.195 INFO:teuthology.orchestra.run.gibba025.stdout:Setting up python-markupsafe (1.0-1build1) ... 2021-02-13T17:51:21.229 INFO:teuthology.orchestra.run.gibba036.stdout:Setting up python-certifi (2018.1.18-2) ... 2021-02-13T17:51:21.347 INFO:teuthology.orchestra.run.gibba025.stdout:Setting up python-werkzeug (0.14.1+dfsg1-1ubuntu0.1) ... 2021-02-13T17:51:21.389 INFO:teuthology.orchestra.run.gibba036.stdout:Setting up formencode-i18n (1.3.0-0ubuntu5) ... 2021-02-13T17:51:21.516 INFO:teuthology.orchestra.run.gibba036.stdout:Setting up libjs-sphinxdoc (1.6.7-1ubuntu1) ... 2021-02-13T17:51:21.548 INFO:teuthology.orchestra.run.gibba025.stdout:Setting up python-pyinotify (0.9.6-1) ... 2021-02-13T17:51:21.641 INFO:teuthology.orchestra.run.gibba036.stdout:Setting up python-webob (1:1.7.3-2fakesync1) ... 2021-02-13T17:51:21.749 INFO:teuthology.orchestra.run.gibba025.stdout:Setting up python-scgi (1.13-1.1build1) ... 2021-02-13T17:51:21.825 INFO:teuthology.orchestra.run.gibba036.stdout:Setting up python-ceph-argparse (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:51:21.949 INFO:teuthology.orchestra.run.gibba025.stdout:Setting up python-websocket (0.44.0-0ubuntu2) ... 2021-02-13T17:51:21.951 INFO:teuthology.orchestra.run.gibba036.stdout:Setting up python-waitress (1.0.1-1) ... 2021-02-13T17:51:22.040 INFO:teuthology.orchestra.run.gibba025.stdout:update-alternatives: using /usr/bin/python2-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2021-02-13T17:51:22.201 INFO:teuthology.orchestra.run.gibba025.stdout:Setting up libxslt1.1:amd64 (1.1.29-5ubuntu0.2) ... 2021-02-13T17:51:22.328 INFO:teuthology.orchestra.run.gibba025.stdout:Setting up nvme-cli (1.5-1ubuntu1.1) ... 2021-02-13T17:51:22.369 INFO:teuthology.orchestra.run.gibba036.stdout:update-alternatives: using /usr/bin/waitress-serve-python2 to provide /usr/bin/waitress-serve (waitress-serve) in auto mode 2021-02-13T17:51:22.470 INFO:teuthology.orchestra.run.gibba025.stdout:Setting up python-httplib2 (0.9.2+dfsg-1ubuntu0.2) ... 2021-02-13T17:51:22.512 INFO:teuthology.orchestra.run.gibba036.stdout:Setting up python-pyasn1-modules (0.2.1-0.2) ... 2021-02-13T17:51:22.629 INFO:teuthology.orchestra.run.gibba025.stdout:Setting up libjq1:amd64 (1.5+dfsg-2) ... 2021-02-13T17:51:22.696 INFO:teuthology.orchestra.run.gibba036.stdout:Setting up python-fasteners (0.12.0-3) ... 2021-02-13T17:51:22.773 INFO:teuthology.orchestra.run.gibba025.stdout:Setting up python-bs4 (4.6.0-1) ... 2021-02-13T17:51:22.898 INFO:teuthology.orchestra.run.gibba036.stdout:Setting up python-jwt (1.5.3+ds1-1) ... 2021-02-13T17:51:22.949 INFO:teuthology.orchestra.run.gibba025.stdout:Setting up python-mako (1.0.7+ds1-1) ... 2021-02-13T17:51:23.099 INFO:teuthology.orchestra.run.gibba036.stdout:Setting up python-markupsafe (1.0-1build1) ... 2021-02-13T17:51:23.166 INFO:teuthology.orchestra.run.gibba025.stdout:Setting up python-sklearn-lib (0.19.1-3) ... 2021-02-13T17:51:23.292 INFO:teuthology.orchestra.run.gibba025.stdout:Setting up libsnappy1v5:amd64 (1.1.7-1) ... 2021-02-13T17:51:23.300 INFO:teuthology.orchestra.run.gibba036.stdout:Setting up python-werkzeug (0.14.1+dfsg1-1ubuntu0.1) ... 2021-02-13T17:51:23.418 INFO:teuthology.orchestra.run.gibba025.stdout:Setting up python-lxml:amd64 (4.2.1-1ubuntu0.3) ... 2021-02-13T17:51:23.559 INFO:teuthology.orchestra.run.gibba036.stdout:Setting up python-pyinotify (0.9.6-1) ... 2021-02-13T17:51:23.586 INFO:teuthology.orchestra.run.gibba025.stdout:Setting up python-sqlalchemy-ext (1.1.11+ds1-1ubuntu1) ... 2021-02-13T17:51:23.712 INFO:teuthology.orchestra.run.gibba025.stdout:Setting up python-funcsigs (1.0.2-4) ... 2021-02-13T17:51:23.727 INFO:teuthology.orchestra.run.gibba036.stdout:Setting up python-scgi (1.13-1.1build1) ... 2021-02-13T17:51:23.871 INFO:teuthology.orchestra.run.gibba025.stdout:Setting up python-requests (2.18.4-2ubuntu0.1) ... 2021-02-13T17:51:23.928 INFO:teuthology.orchestra.run.gibba036.stdout:Setting up python-websocket (0.44.0-0ubuntu2) ... 2021-02-13T17:51:24.019 INFO:teuthology.orchestra.run.gibba036.stdout:update-alternatives: using /usr/bin/python2-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2021-02-13T17:51:24.081 INFO:teuthology.orchestra.run.gibba025.stdout:Setting up python-uritemplate (0.6-1ubuntu1) ... 2021-02-13T17:51:24.129 INFO:teuthology.orchestra.run.gibba036.stdout:Setting up libxslt1.1:amd64 (1.1.29-5ubuntu0.2) ... 2021-02-13T17:51:24.240 INFO:teuthology.orchestra.run.gibba025.stdout:Setting up python-decorator (4.1.2-1) ... 2021-02-13T17:51:24.247 INFO:teuthology.orchestra.run.gibba036.stdout:Setting up nvme-cli (1.5-1ubuntu1.1) ... 2021-02-13T17:51:24.391 INFO:teuthology.orchestra.run.gibba036.stdout:Setting up python-httplib2 (0.9.2+dfsg-1ubuntu0.2) ... 2021-02-13T17:51:24.450 INFO:teuthology.orchestra.run.gibba025.stdout:Setting up liboath0 (2.6.1-1) ... 2021-02-13T17:51:24.549 INFO:teuthology.orchestra.run.gibba036.stdout:Setting up libjq1:amd64 (1.5+dfsg-2) ... 2021-02-13T17:51:24.626 INFO:teuthology.orchestra.run.gibba025.stdout:Setting up python-singledispatch (3.4.0.3-2) ... 2021-02-13T17:51:24.675 INFO:teuthology.orchestra.run.gibba036.stdout:Setting up python-bs4 (4.6.0-1) ... 2021-02-13T17:51:24.794 INFO:teuthology.orchestra.run.gibba025.stdout:Setting up librabbitmq4:amd64 (0.8.0-1ubuntu0.18.04.2) ... 2021-02-13T17:51:24.860 INFO:teuthology.orchestra.run.gibba036.stdout:Setting up python-mako (1.0.7+ds1-1) ... 2021-02-13T17:51:24.920 INFO:teuthology.orchestra.run.gibba025.stdout:Setting up python-pastedeploy-tpl (1.5.2-4) ... 2021-02-13T17:51:25.044 INFO:teuthology.orchestra.run.gibba036.stdout:Setting up python-sklearn-lib (0.19.1-3) ... 2021-02-13T17:51:25.046 INFO:teuthology.orchestra.run.gibba025.stdout:Setting up python-tempita (0.5.2-2) ... 2021-02-13T17:51:25.170 INFO:teuthology.orchestra.run.gibba036.stdout:Setting up libsnappy1v5:amd64 (1.1.7-1) ... 2021-02-13T17:51:25.205 INFO:teuthology.orchestra.run.gibba025.stdout:Setting up liblttng-ust0:amd64 (2.10.1-1) ... 2021-02-13T17:51:25.296 INFO:teuthology.orchestra.run.gibba036.stdout:Setting up python-lxml:amd64 (4.2.1-1ubuntu0.3) ... 2021-02-13T17:51:25.332 INFO:teuthology.orchestra.run.gibba025.stdout:Setting up python-webencodings (0.5-2) ... 2021-02-13T17:51:25.472 INFO:teuthology.orchestra.run.gibba036.stdout:Setting up python-sqlalchemy-ext (1.1.11+ds1-1ubuntu1) ... 2021-02-13T17:51:25.541 INFO:teuthology.orchestra.run.gibba025.stdout:Setting up python-cherrypy3 (8.9.1-2) ... 2021-02-13T17:51:25.598 INFO:teuthology.orchestra.run.gibba036.stdout:Setting up python-funcsigs (1.0.2-4) ... 2021-02-13T17:51:25.742 INFO:teuthology.orchestra.run.gibba025.stdout:Setting up python-bcrypt (3.1.4-2) ... 2021-02-13T17:51:25.758 INFO:teuthology.orchestra.run.gibba036.stdout:Setting up python-requests (2.18.4-2ubuntu0.1) ... 2021-02-13T17:51:25.901 INFO:teuthology.orchestra.run.gibba025.stdout:Setting up python-logutils (0.3.3-5) ... 2021-02-13T17:51:25.925 INFO:teuthology.orchestra.run.gibba036.stdout:Setting up python-uritemplate (0.6-1ubuntu1) ... 2021-02-13T17:51:26.085 INFO:teuthology.orchestra.run.gibba036.stdout:Setting up python-decorator (4.1.2-1) ... 2021-02-13T17:51:26.111 INFO:teuthology.orchestra.run.gibba025.stdout:Setting up python-routes (2.4.1-1) ... 2021-02-13T17:51:26.244 INFO:teuthology.orchestra.run.gibba036.stdout:Setting up liboath0 (2.6.1-1) ... 2021-02-13T17:51:26.320 INFO:teuthology.orchestra.run.gibba025.stdout:Setting up python-formencode (1.3.0-0ubuntu5) ... 2021-02-13T17:51:26.420 INFO:teuthology.orchestra.run.gibba036.stdout:Setting up python-singledispatch (3.4.0.3-2) ... 2021-02-13T17:51:26.513 INFO:teuthology.orchestra.run.gibba025.stdout:Setting up jq (1.5+dfsg-2) ... 2021-02-13T17:51:26.588 INFO:teuthology.orchestra.run.gibba036.stdout:Setting up librabbitmq4:amd64 (0.8.0-1ubuntu0.18.04.2) ... 2021-02-13T17:51:26.631 INFO:teuthology.orchestra.run.gibba025.stdout:Setting up python-scipy (0.19.1-2ubuntu1) ... 2021-02-13T17:51:26.689 INFO:teuthology.orchestra.run.gibba036.stdout:Setting up python-pastedeploy-tpl (1.5.2-4) ... 2021-02-13T17:51:26.815 INFO:teuthology.orchestra.run.gibba036.stdout:Setting up python-tempita (0.5.2-2) ... 2021-02-13T17:51:26.974 INFO:teuthology.orchestra.run.gibba036.stdout:Setting up liblttng-ust0:amd64 (2.10.1-1) ... 2021-02-13T17:51:27.101 INFO:teuthology.orchestra.run.gibba036.stdout:Setting up python-webencodings (0.5-2) ... 2021-02-13T17:51:27.260 INFO:teuthology.orchestra.run.gibba036.stdout:Setting up python-cherrypy3 (8.9.1-2) ... 2021-02-13T17:51:27.368 INFO:teuthology.orchestra.run.gibba025.stdout:Setting up python-rsa (3.4.2-1) ... 2021-02-13T17:51:27.502 INFO:teuthology.orchestra.run.gibba036.stdout:Setting up python-bcrypt (3.1.4-2) ... 2021-02-13T17:51:27.536 INFO:teuthology.orchestra.run.gibba025.stdout:Setting up python-paste (2.0.3+dfsg-4ubuntu1) ... 2021-02-13T17:51:27.670 INFO:teuthology.orchestra.run.gibba036.stdout:Setting up python-logutils (0.3.3-5) ... 2021-02-13T17:51:27.777 INFO:teuthology.orchestra.run.gibba025.stdout:Setting up python-pytest (3.3.2-2) ... 2021-02-13T17:51:27.871 INFO:teuthology.orchestra.run.gibba036.stdout:Setting up python-routes (2.4.1-1) ... 2021-02-13T17:51:27.989 INFO:teuthology.orchestra.run.gibba025.stdout:Setting up python-oauth2client (4.1.2-3) ... 2021-02-13T17:51:28.072 INFO:teuthology.orchestra.run.gibba036.stdout:Setting up python-formencode (1.3.0-0ubuntu5) ... 2021-02-13T17:51:28.157 INFO:teuthology.orchestra.run.gibba025.stdout:Setting up libleveldb1v5:amd64 (1.20-2) ... 2021-02-13T17:51:28.283 INFO:teuthology.orchestra.run.gibba025.stdout:Setting up xmlstarlet (1.6.1-2) ... 2021-02-13T17:51:28.289 INFO:teuthology.orchestra.run.gibba036.stdout:Setting up jq (1.5+dfsg-2) ... 2021-02-13T17:51:28.409 INFO:teuthology.orchestra.run.gibba025.stdout:Setting up librados2 (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:51:28.416 INFO:teuthology.orchestra.run.gibba036.stdout:Setting up python-scipy (0.19.1-2ubuntu1) ... 2021-02-13T17:51:28.535 INFO:teuthology.orchestra.run.gibba025.stdout:Setting up libcephfs2 (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:51:28.661 INFO:teuthology.orchestra.run.gibba025.stdout:Setting up python-sklearn (0.19.1-3) ... 2021-02-13T17:51:29.153 INFO:teuthology.orchestra.run.gibba036.stdout:Setting up python-rsa (3.4.2-1) ... 2021-02-13T17:51:29.181 INFO:teuthology.orchestra.run.gibba025.stdout:Setting up libcephfs-dev (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:51:29.290 INFO:teuthology.orchestra.run.gibba025.stdout:Setting up python-kubernetes (2.0.0-2ubuntu1) ... 2021-02-13T17:51:29.321 INFO:teuthology.orchestra.run.gibba036.stdout:Setting up python-paste (2.0.3+dfsg-4ubuntu1) ... 2021-02-13T17:51:29.547 INFO:teuthology.orchestra.run.gibba036.stdout:Setting up python-pytest (3.3.2-2) ... 2021-02-13T17:51:29.684 INFO:teuthology.orchestra.run.gibba025.stdout:Setting up python-html5lib (0.999999999-1) ... 2021-02-13T17:51:29.765 INFO:teuthology.orchestra.run.gibba036.stdout:Setting up python-oauth2client (4.1.2-3) ... 2021-02-13T17:51:29.916 INFO:teuthology.orchestra.run.gibba036.stdout:Setting up libleveldb1v5:amd64 (1.20-2) ... 2021-02-13T17:51:29.918 INFO:teuthology.orchestra.run.gibba025.stdout:Setting up python-rados (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:51:30.042 INFO:teuthology.orchestra.run.gibba036.stdout:Setting up xmlstarlet (1.6.1-2) ... 2021-02-13T17:51:30.044 INFO:teuthology.orchestra.run.gibba025.stdout:Setting up python-cephfs (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:51:30.169 INFO:teuthology.orchestra.run.gibba036.stdout:Setting up librados2 (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:51:30.212 INFO:teuthology.orchestra.run.gibba025.stdout:Setting up libradosstriper1 (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:51:30.294 INFO:teuthology.orchestra.run.gibba036.stdout:Setting up libcephfs2 (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:51:30.338 INFO:teuthology.orchestra.run.gibba025.stdout:Setting up librgw2 (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:51:30.403 INFO:teuthology.orchestra.run.gibba036.stdout:Setting up python-sklearn (0.19.1-3) ... 2021-02-13T17:51:30.464 INFO:teuthology.orchestra.run.gibba025.stdout:Setting up python-rgw (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:51:30.582 INFO:teuthology.orchestra.run.gibba025.stdout:Setting up python-pastedeploy (1.5.2-4) ... 2021-02-13T17:51:30.741 INFO:teuthology.orchestra.run.gibba025.stdout:Setting up ceph-fuse (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:51:30.898 INFO:teuthology.orchestra.run.gibba036.stdout:Setting up libcephfs-dev (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:51:30.939 INFO:teuthology.orchestra.run.gibba025.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-02-13T17:51:30.939 INFO:teuthology.orchestra.run.gibba025.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-02-13T17:51:30.999 INFO:teuthology.orchestra.run.gibba036.stdout:Setting up python-kubernetes (2.0.0-2ubuntu1) ... 2021-02-13T17:51:31.143 INFO:teuthology.orchestra.run.gibba025.stdout:Setting up librbd1 (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:51:31.269 INFO:teuthology.orchestra.run.gibba025.stdout:Setting up python-pastescript (2.0.2-2) ... 2021-02-13T17:51:31.375 INFO:teuthology.orchestra.run.gibba036.stdout:Setting up python-html5lib (0.999999999-1) ... 2021-02-13T17:51:31.445 INFO:teuthology.orchestra.run.gibba025.stdout:Setting up python-rbd (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:51:31.602 INFO:teuthology.orchestra.run.gibba036.stdout:Setting up python-rados (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:51:31.639 INFO:teuthology.orchestra.run.gibba025.stdout:Setting up ceph-common (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:51:31.728 INFO:teuthology.orchestra.run.gibba036.stdout:Setting up python-cephfs (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:51:31.879 INFO:teuthology.orchestra.run.gibba036.stdout:Setting up libradosstriper1 (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:51:31.980 INFO:teuthology.orchestra.run.gibba036.stdout:Setting up librgw2 (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:51:32.098 INFO:teuthology.orchestra.run.gibba036.stdout:Setting up python-rgw (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:51:32.142 INFO:teuthology.orchestra.run.gibba025.stdout:Adding group ceph....done 2021-02-13T17:51:32.198 INFO:teuthology.orchestra.run.gibba036.stdout:Setting up python-pastedeploy (1.5.2-4) ... 2021-02-13T17:51:32.341 INFO:teuthology.orchestra.run.gibba036.stdout:Setting up ceph-fuse (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:51:32.519 INFO:teuthology.orchestra.run.gibba025.stdout:Adding system user ceph....done 2021-02-13T17:51:32.525 INFO:teuthology.orchestra.run.gibba036.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-02-13T17:51:32.525 INFO:teuthology.orchestra.run.gibba036.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-02-13T17:51:32.694 INFO:teuthology.orchestra.run.gibba025.stdout:Setting system user ceph properties....done 2021-02-13T17:51:32.709 INFO:teuthology.orchestra.run.gibba036.stdout:Setting up librbd1 (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:51:32.779 INFO:teuthology.orchestra.run.gibba025.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2021-02-13T17:51:32.834 INFO:teuthology.orchestra.run.gibba036.stdout:Setting up python-pastescript (2.0.2-2) ... 2021-02-13T17:51:32.909 INFO:teuthology.orchestra.run.gibba025.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2021-02-13T17:51:33.019 INFO:teuthology.orchestra.run.gibba036.stdout:Setting up python-rbd (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:51:33.132 INFO:teuthology.orchestra.run.gibba025.stdout:Setting up radosgw (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:51:33.213 INFO:teuthology.orchestra.run.gibba036.stdout:Setting up ceph-common (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:51:33.375 INFO:teuthology.orchestra.run.gibba025.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-02-13T17:51:33.375 INFO:teuthology.orchestra.run.gibba025.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-02-13T17:51:33.631 INFO:teuthology.orchestra.run.gibba036.stdout:Adding group ceph....done 2021-02-13T17:51:33.668 INFO:teuthology.orchestra.run.gibba025.stdout:Setting up rbd-fuse (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:51:33.794 INFO:teuthology.orchestra.run.gibba025.stdout:Setting up python-ceph (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:51:33.920 INFO:teuthology.orchestra.run.gibba025.stdout:Setting up python-webtest (2.0.28-1ubuntu1) ... 2021-02-13T17:51:34.025 INFO:teuthology.orchestra.run.gibba036.stdout:Adding system user ceph....done 2021-02-13T17:51:34.088 INFO:teuthology.orchestra.run.gibba025.stdout:Setting up ceph-test (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:51:34.168 INFO:teuthology.orchestra.run.gibba036.stdout:Setting system user ceph properties....done 2021-02-13T17:51:34.214 INFO:teuthology.orchestra.run.gibba025.stdout:Setting up ceph-base (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:51:34.252 INFO:teuthology.orchestra.run.gibba036.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2021-02-13T17:51:34.393 INFO:teuthology.orchestra.run.gibba036.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2021-02-13T17:51:34.466 INFO:teuthology.orchestra.run.gibba025.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2021-02-13T17:51:34.589 INFO:teuthology.orchestra.run.gibba036.stdout:Setting up radosgw (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:51:34.657 INFO:teuthology.orchestra.run.gibba025.stdout:Setting up python-pecan (1.2.1-2) ... 2021-02-13T17:51:34.740 INFO:teuthology.orchestra.run.gibba025.stdout:update-alternatives: using /usr/bin/python2-pecan to provide /usr/bin/pecan (pecan) in auto mode 2021-02-13T17:51:34.764 INFO:teuthology.orchestra.run.gibba025.stdout:update-alternatives: using /usr/bin/python2-gunicorn_pecan to provide /usr/bin/gunicorn_pecan (gunicorn_pecan) in auto mode 2021-02-13T17:51:34.768 INFO:teuthology.orchestra.run.gibba036.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-02-13T17:51:34.768 INFO:teuthology.orchestra.run.gibba036.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-02-13T17:51:34.893 INFO:teuthology.orchestra.run.gibba025.stdout:Setting up ceph-osd (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:51:35.032 INFO:teuthology.orchestra.run.gibba036.stdout:Setting up rbd-fuse (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:51:35.134 INFO:teuthology.orchestra.run.gibba036.stdout:Setting up python-ceph (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:51:35.243 INFO:teuthology.orchestra.run.gibba036.stdout:Setting up python-webtest (2.0.28-1ubuntu1) ... 2021-02-13T17:51:35.279 INFO:teuthology.orchestra.run.gibba025.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-02-13T17:51:35.279 INFO:teuthology.orchestra.run.gibba025.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-02-13T17:51:35.436 INFO:teuthology.orchestra.run.gibba036.stdout:Setting up ceph-test (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:51:35.454 INFO:teuthology.orchestra.run.gibba025.stdout:Setting up ceph-mds (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:51:35.562 INFO:teuthology.orchestra.run.gibba036.stdout:Setting up ceph-base (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:51:35.610 INFO:teuthology.orchestra.run.gibba025.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-02-13T17:51:35.610 INFO:teuthology.orchestra.run.gibba025.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-02-13T17:51:35.804 INFO:teuthology.orchestra.run.gibba036.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2021-02-13T17:51:35.806 INFO:teuthology.orchestra.run.gibba025.stdout:Setting up ceph-mon (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:51:35.988 INFO:teuthology.orchestra.run.gibba036.stdout:Setting up python-pecan (1.2.1-2) ... 2021-02-13T17:51:36.002 INFO:teuthology.orchestra.run.gibba025.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-02-13T17:51:36.003 INFO:teuthology.orchestra.run.gibba025.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-02-13T17:51:36.063 INFO:teuthology.orchestra.run.gibba036.stdout:update-alternatives: using /usr/bin/python2-pecan to provide /usr/bin/pecan (pecan) in auto mode 2021-02-13T17:51:36.087 INFO:teuthology.orchestra.run.gibba036.stdout:update-alternatives: using /usr/bin/python2-gunicorn_pecan to provide /usr/bin/gunicorn_pecan (gunicorn_pecan) in auto mode 2021-02-13T17:51:36.207 INFO:teuthology.orchestra.run.gibba025.stdout:Setting up ceph-mgr (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:51:36.216 INFO:teuthology.orchestra.run.gibba036.stdout:Setting up ceph-osd (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:51:36.363 INFO:teuthology.orchestra.run.gibba025.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-02-13T17:51:36.363 INFO:teuthology.orchestra.run.gibba025.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-02-13T17:51:36.566 INFO:teuthology.orchestra.run.gibba025.stdout:Setting up ceph-mgr-diskprediction-local (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:51:36.590 INFO:teuthology.orchestra.run.gibba036.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-02-13T17:51:36.590 INFO:teuthology.orchestra.run.gibba036.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-02-13T17:51:36.701 INFO:teuthology.orchestra.run.gibba025.stdout:Setting up ceph-mgr-diskprediction-cloud (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:51:36.785 INFO:teuthology.orchestra.run.gibba036.stdout:Setting up ceph-mds (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:51:36.835 INFO:teuthology.orchestra.run.gibba025.stdout:Setting up ceph-mgr-rook (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:51:36.971 INFO:teuthology.orchestra.run.gibba025.stdout:Setting up ceph (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:51:36.984 INFO:teuthology.orchestra.run.gibba036.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-02-13T17:51:36.984 INFO:teuthology.orchestra.run.gibba036.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-02-13T17:51:37.097 INFO:teuthology.orchestra.run.gibba025.stdout:Setting up ceph-mgr-k8sevents (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:51:37.178 INFO:teuthology.orchestra.run.gibba036.stdout:Setting up ceph-mon (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:51:37.222 INFO:teuthology.orchestra.run.gibba025.stdout:Setting up ceph-mgr-ssh (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:51:37.356 INFO:teuthology.orchestra.run.gibba025.stdout:Setting up ceph-mgr-dashboard (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:51:37.369 INFO:teuthology.orchestra.run.gibba036.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-02-13T17:51:37.370 INFO:teuthology.orchestra.run.gibba036.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-02-13T17:51:37.508 INFO:teuthology.orchestra.run.gibba025.stdout:Processing triggers for libc-bin (2.27-3ubuntu1.3) ... 2021-02-13T17:51:37.563 INFO:teuthology.orchestra.run.gibba036.stdout:Setting up ceph-mgr (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:51:37.644 INFO:teuthology.orchestra.run.gibba025.stdout:Processing triggers for systemd (237-3ubuntu10.42) ... 2021-02-13T17:51:37.802 INFO:teuthology.orchestra.run.gibba025.stdout:Processing triggers for man-db (2.8.3-2ubuntu0.1) ... 2021-02-13T17:51:37.828 INFO:teuthology.orchestra.run.gibba036.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-02-13T17:51:37.828 INFO:teuthology.orchestra.run.gibba036.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-02-13T17:51:38.148 INFO:teuthology.orchestra.run.gibba036.stdout:Setting up ceph-mgr-diskprediction-local (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:51:38.265 INFO:teuthology.orchestra.run.gibba036.stdout:Setting up ceph-mgr-diskprediction-cloud (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:51:38.382 INFO:teuthology.orchestra.run.gibba036.stdout:Setting up ceph-mgr-rook (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:51:38.500 INFO:teuthology.orchestra.run.gibba036.stdout:Setting up ceph (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:51:38.601 INFO:teuthology.orchestra.run.gibba036.stdout:Setting up ceph-mgr-k8sevents (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:51:38.743 INFO:teuthology.orchestra.run.gibba036.stdout:Setting up ceph-mgr-ssh (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:51:38.878 INFO:teuthology.orchestra.run.gibba036.stdout:Setting up ceph-mgr-dashboard (14.2.16-285-g7194982c-1bionic) ... 2021-02-13T17:51:39.013 INFO:teuthology.orchestra.run.gibba036.stdout:Processing triggers for libc-bin (2.27-3ubuntu1.3) ... 2021-02-13T17:51:39.121 INFO:teuthology.orchestra.run.gibba025.stdout:Processing triggers for ureadahead (0.100.0-21) ... 2021-02-13T17:51:39.133 INFO:teuthology.orchestra.run.gibba036.stdout:Processing triggers for systemd (237-3ubuntu10.42) ... 2021-02-13T17:51:39.165 INFO:teuthology.orchestra.run.gibba025.stdout:ureadahead will be reprofiled on next reboot 2021-02-13T17:51:39.298 INFO:teuthology.orchestra.run.gibba036.stdout:Processing triggers for man-db (2.8.3-2ubuntu0.1) ... 2021-02-13T17:51:39.485 INFO:teuthology.orchestra.run.gibba025.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-02-13T17:51:39.487 DEBUG:teuthology.parallel:result is None 2021-02-13T17:51:40.567 INFO:teuthology.orchestra.run.gibba036.stdout:Processing triggers for ureadahead (0.100.0-21) ... 2021-02-13T17:51:40.602 INFO:teuthology.orchestra.run.gibba036.stdout:ureadahead will be reprofiled on next reboot 2021-02-13T17:51:40.879 INFO:teuthology.orchestra.run.gibba036.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-02-13T17:51:40.881 DEBUG:teuthology.parallel:result is None 2021-02-13T17:51:40.882 DEBUG:teuthology.orchestra.run.gibba025:> sudo lsb_release -is 2021-02-13T17:51:40.911 INFO:teuthology.orchestra.run.gibba025.stdout:Ubuntu 2021-02-13T17:51:40.913 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-02-13T17:51:40.913 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1=7194982cc16a1fd51df59ee58e1c54797c4465d1 2021-02-13T17:51:41.090 DEBUG:teuthology.orchestra.run.gibba025:> dpkg-query -W -f '${Version}' ceph 2021-02-13T17:51:41.135 INFO:teuthology.orchestra.run.gibba025.stdout:14.2.16-285-g7194982c-1bionic 2021-02-13T17:51:41.136 INFO:teuthology.packaging:The installed version of ceph is 14.2.16-285-g7194982c-1bionic 2021-02-13T17:51:41.136 INFO:teuthology.task.install:The correct ceph version 14.2.16-285-g7194982c-1bionic is installed. 2021-02-13T17:51:41.136 DEBUG:teuthology.orchestra.run.gibba036:> sudo lsb_release -is 2021-02-13T17:51:41.164 INFO:teuthology.orchestra.run.gibba036.stdout:Ubuntu 2021-02-13T17:51:41.167 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-02-13T17:51:41.167 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1=7194982cc16a1fd51df59ee58e1c54797c4465d1 2021-02-13T17:51:41.332 DEBUG:teuthology.orchestra.run.gibba036:> dpkg-query -W -f '${Version}' ceph 2021-02-13T17:51:41.376 INFO:teuthology.orchestra.run.gibba036.stdout:14.2.16-285-g7194982c-1bionic 2021-02-13T17:51:41.377 INFO:teuthology.packaging:The installed version of ceph is 14.2.16-285-g7194982c-1bionic 2021-02-13T17:51:41.377 INFO:teuthology.task.install:The correct ceph version 14.2.16-285-g7194982c-1bionic is installed. 2021-02-13T17:51:41.377 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2021-02-13T17:51:41.377 DEBUG:teuthology.orchestra.run.gibba025:> set -ex 2021-02-13T17:51:41.377 DEBUG:teuthology.orchestra.run.gibba025:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2021-02-13T17:51:41.397 DEBUG:teuthology.orchestra.run.gibba036:> set -ex 2021-02-13T17:51:41.397 DEBUG:teuthology.orchestra.run.gibba036:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2021-02-13T17:51:41.435 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2021-02-13T17:51:41.435 DEBUG:teuthology.orchestra.run.gibba025:> set -ex 2021-02-13T17:51:41.435 DEBUG:teuthology.orchestra.run.gibba025:> sudo dd of=/usr/bin/daemon-helper 2021-02-13T17:51:41.451 DEBUG:teuthology.orchestra.run.gibba025:> sudo chmod a=rx -- /usr/bin/daemon-helper 2021-02-13T17:51:41.501 DEBUG:teuthology.orchestra.run.gibba036:> set -ex 2021-02-13T17:51:41.501 DEBUG:teuthology.orchestra.run.gibba036:> sudo dd of=/usr/bin/daemon-helper 2021-02-13T17:51:41.519 DEBUG:teuthology.orchestra.run.gibba036:> sudo chmod a=rx -- /usr/bin/daemon-helper 2021-02-13T17:51:41.579 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2021-02-13T17:51:41.579 DEBUG:teuthology.orchestra.run.gibba025:> set -ex 2021-02-13T17:51:41.579 DEBUG:teuthology.orchestra.run.gibba025:> sudo dd of=/usr/bin/adjust-ulimits 2021-02-13T17:51:41.589 DEBUG:teuthology.orchestra.run.gibba025:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2021-02-13T17:51:41.640 DEBUG:teuthology.orchestra.run.gibba036:> set -ex 2021-02-13T17:51:41.641 DEBUG:teuthology.orchestra.run.gibba036:> sudo dd of=/usr/bin/adjust-ulimits 2021-02-13T17:51:41.659 DEBUG:teuthology.orchestra.run.gibba036:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2021-02-13T17:51:41.712 INFO:teuthology.run_tasks:Running task ceph... 2021-02-13T17:51:41.768 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2021-02-13T17:51:41.768 DEBUG:teuthology.orchestra.run.gibba025:> sudo chmod 777 /var/log/ceph 2021-02-13T17:51:41.771 DEBUG:teuthology.orchestra.run.gibba036:> sudo chmod 777 /var/log/ceph 2021-02-13T17:51:41.781 INFO:tasks.ceph:Disabling ceph logrotate... 2021-02-13T17:51:41.781 DEBUG:teuthology.orchestra.run.gibba025:> sudo rm -f -- /etc/logrotate.d/ceph 2021-02-13T17:51:41.823 DEBUG:teuthology.orchestra.run.gibba036:> sudo rm -f -- /etc/logrotate.d/ceph 2021-02-13T17:51:41.833 INFO:tasks.ceph:Creating extra log directories... 2021-02-13T17:51:41.834 DEBUG:teuthology.orchestra.run.gibba025:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2021-02-13T17:51:41.872 DEBUG:teuthology.orchestra.run.gibba036:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2021-02-13T17:51:41.889 INFO:tasks.ceph:Creating ceph cluster c1... 2021-02-13T17:51:41.889 INFO:tasks.ceph:config {'conf': {'client': {'debug rgw': 20, 'rgw crypt require ssl': False, 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo=', 'rgw curl low speed time': 300, 'rgw data log num shards': 4, 'rgw md log max shards': 4, 'rgw sync log trim interval': 0, 'rgw sync obj etag verify': True}, 'global': {'osd heartbeat grace': 40}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon osd crush smoke test': False}, 'osd': {'debug filestore': 20, 'debug journal': 20, 'debug ms': 20, 'debug osd': 25, 'osd fast shutdown': False}, 'osd.0': {'osd_max_omap_entries_per_request': 10}, 'osd.1': {'osd_max_omap_entries_per_request': 1000}, 'osd.2': {'osd_max_omap_entries_per_request': 10000}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'cpu_profile': set(), 'cluster': 'c1', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2021-02-13T17:51:41.890 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2021-02-12_17:45:41-rgw-wip-yuri3-testing-2021-02-12-0757-nautilus-distro-basic-gibba/5877924', 'branch': 'wip-yuri3-testing-2021-02-12-0757-nautilus', 'description': 'rgw/multisite/{clusters frontend/civetweb omap_limits overrides realms/three-zone-plus-pubsub tasks/test_multi valgrind}', 'email': 'ceph-qa@ceph.io', 'first_in_suite': False, 'job_id': '5877924', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'gibba', 'name': 'yuriw-2021-02-12_17:45:41-rgw-wip-yuri3-testing-2021-02-12-0757-nautilus-distro-basic-gibba', 'nuke-on-error': True, 'os_type': 'ubuntu', 'overrides': {'admin_socket': {'branch': 'wip-yuri3-testing-2021-02-12-0757-nautilus'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'rgw crypt require ssl': False, 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo=', 'rgw curl low speed time': 300, 'rgw data log num shards': 4, 'rgw md log max shards': 4, 'rgw sync log trim interval': 0, 'rgw sync obj etag verify': True}, 'global': {'osd heartbeat grace': 40}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon osd crush smoke test': False}, 'osd': {'debug filestore': 20, 'debug journal': 20, 'debug ms': 20, 'debug osd': 25, 'osd fast shutdown': False}, 'osd.0': {'osd_max_omap_entries_per_request': 10}, 'osd.1': {'osd_max_omap_entries_per_request': 1000}, 'osd.2': {'osd_max_omap_entries_per_request': 10000}}, 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': '7194982cc16a1fd51df59ee58e1c54797c4465d1', 'wait-for-scrub': False}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}}}, 'install': {'ceph': {'sha1': '7194982cc16a1fd51df59ee58e1c54797c4465d1'}}, 'rgw': {'compression type': 'random', 'frontend': 'civetweb'}, 'rgw-multisite': {'realm': {'is default': True, 'name': 'test-realm'}, 'zonegroups': [{'endpoints': ['c1.client.0'], 'is_default': True, 'is_master': True, 'name': 'test-zonegroup', 'zones': [{'endpoints': ['c1.client.0'], 'is_default': True, 'is_master': True, 'name': 'test-zone1'}, {'endpoints': ['c2.client.0'], 'is_default': True, 'name': 'test-zone2'}, {'endpoints': ['c1.client.1'], 'name': 'test-zone3'}, {'endpoints': ['c2.client.1'], 'is_pubsub': True, 'name': 'test-zone4'}]}]}, 'workunit': {'branch': 'wip-yuri3-testing-2021-02-12-0757-nautilus', 'sha1': '7194982cc16a1fd51df59ee58e1c54797c4465d1'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 100, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['c1.mon.a', 'c1.mgr.x', 'c1.osd.0', 'c1.osd.1', 'c1.osd.2', 'c1.client.0', 'c1.client.1'], ['c2.mon.a', 'c2.mgr.x', 'c2.osd.0', 'c2.osd.1', 'c2.osd.2', 'c2.client.0', 'c2.client.1']], 'sha1': '7194982cc16a1fd51df59ee58e1c54797c4465d1', 'sleep_before_teardown': 0, 'suite': 'rgw', 'suite_branch': 'wip-yuri3-testing-2021-02-12-0757-nautilus', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_7194982cc16a1fd51df59ee58e1c54797c4465d1/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '7194982cc16a1fd51df59ee58e1c54797c4465d1', 'targets': {'gibba025.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQct/yYRiVyP7xLyZhwP0bImuTNCZqteVFOIsXVClcIP1ZAC/HTIXhbXqwri+YfB05v85zmUldT9kbGVrzpkT7izrkERnEs70Y9+UACfYvKZXbdMdnZcNwpdyHqvXmt9NHcyt/DO7YWDN3WDCyNtsFLRFw1KJ8oeOMMAz0gNAJCrck2wuSsfV7iDofzXJOy+hZD7/NSkcBhCVJD1Ji0GogMlI2idePwXea5jx131oLUvcsP3wDus5XxhcCm4YBELqrrbkFX0Dn3mjazLczPpIqcj1eOmFSmJKKjPf/+wPaiUDREdxuFyM2pLNrX0vrH0GuLx5DraWWgByWEws0fSLP', 'gibba036.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCzmzfuX9HS9ufXoRhqcszlNBlk6kQ7aINmyLfea6KbHvb1lKjgcpcHIRKOdcXWY7hu63FxR7DJYEu9X4+DID8OyrdE/i4C14CL2+MXJWMqMS9jHDtfcRUxqXrx4Tj3JQLQh5ybSltA3djSEkGKfhHHhV3CP/y7NiKqK6uxVGsm3tlpX/TjE1UBYdsR+99a353abLIIwU69bi4NoCFXDi9QiPhn2fDnT6prAur9nBkrWRwKI9KgxLN1TWp7/NrLerLriIShyc03pduExkbph6b5INTocgfKoqcn09wkrLIstLEaoSKOS6DJnY+NiMgPtD/aHjgCAQHsxDNnN1eVaeKP'}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'cluster': 'c1', 'conf': {'client': {'debug rgw': 20, 'rgw crypt require ssl': False, 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo=', 'rgw curl low speed time': 300, 'rgw data log num shards': 4, 'rgw md log max shards': 4, 'rgw sync log trim interval': 0, 'rgw sync obj etag verify': True}, 'global': {'osd heartbeat grace': 40}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon osd crush smoke test': False}, 'osd': {'debug filestore': 20, 'debug journal': 20, 'debug ms': 20, 'debug osd': 25, 'osd fast shutdown': False}, 'osd.0': {'osd_max_omap_entries_per_request': 10}, 'osd.1': {'osd_max_omap_entries_per_request': 1000}, 'osd.2': {'osd_max_omap_entries_per_request': 10000}}, 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': '7194982cc16a1fd51df59ee58e1c54797c4465d1', 'wait-for-scrub': False}}, {'ceph': {'cluster': 'c2'}}, {'rgw': {'c1.client.0': {'port': 8000}, 'c1.client.1': {'port': 8001}, 'c2.client.0': {'port': 8000}, 'c2.client.1': {'port': 8001}}}, {'rgw-multisite': None}, {'rgw-multisite-tests': {'config': {'reconfigure_delay': 60}}}], 'teuthology_branch': 'master', 'teuthology_sha1': '87d40f79d7da6caf6da06c190938773bf745140c', 'timestamp': '2021-02-12_17:45:41', 'tube': 'gibba', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.gibba.29737'} 2021-02-13T17:51:41.890 DEBUG:teuthology.orchestra.run.gibba025:> install -d -m0755 -- /home/ubuntu/cephtest/c1.data 2021-02-13T17:51:41.936 DEBUG:teuthology.orchestra.run.gibba036:> install -d -m0755 -- /home/ubuntu/cephtest/c1.data 2021-02-13T17:51:41.944 DEBUG:teuthology.orchestra.run.gibba025:> sudo install -d -m0777 -- /var/run/ceph 2021-02-13T17:51:41.988 DEBUG:teuthology.orchestra.run.gibba036:> sudo install -d -m0777 -- /var/run/ceph 2021-02-13T17:51:42.000 DEBUG:teuthology.orchestra.run.gibba025:> set -ex 2021-02-13T17:51:42.001 DEBUG:teuthology.orchestra.run.gibba025:> dd if=/scratch_devs of=/dev/stdout 2021-02-13T17:51:42.040 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2021-02-13T17:51:42.041 DEBUG:teuthology.orchestra.run.gibba025:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2021-02-13T17:51:42.090 INFO:teuthology.orchestra.run.gibba025.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2021-02-13T17:51:42.090 INFO:teuthology.orchestra.run.gibba025.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-02-13T17:51:42.090 INFO:teuthology.orchestra.run.gibba025.stdout:Device: 6h/6d Inode: 331 Links: 1 2021-02-13T17:51:42.090 INFO:teuthology.orchestra.run.gibba025.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-02-13T17:51:42.091 INFO:teuthology.orchestra.run.gibba025.stdout:Access: 2021-02-13 17:49:39.278939906 +0000 2021-02-13T17:51:42.091 INFO:teuthology.orchestra.run.gibba025.stdout:Modify: 2021-02-13 17:49:39.234961907 +0000 2021-02-13T17:51:42.091 INFO:teuthology.orchestra.run.gibba025.stdout:Change: 2021-02-13 17:49:39.234961907 +0000 2021-02-13T17:51:42.091 INFO:teuthology.orchestra.run.gibba025.stdout: Birth: - 2021-02-13T17:51:42.098 INFO:teuthology.orchestra.run.gibba025.stderr:1+0 records in 2021-02-13T17:51:42.098 INFO:teuthology.orchestra.run.gibba025.stderr:1+0 records out 2021-02-13T17:51:42.098 INFO:teuthology.orchestra.run.gibba025.stderr:512 bytes copied, 0.000253992 s, 2.0 MB/s 2021-02-13T17:51:42.100 DEBUG:teuthology.orchestra.run.gibba025:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2021-02-13T17:51:42.145 INFO:teuthology.orchestra.run.gibba025.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2021-02-13T17:51:42.145 INFO:teuthology.orchestra.run.gibba025.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-02-13T17:51:42.145 INFO:teuthology.orchestra.run.gibba025.stdout:Device: 6h/6d Inode: 338 Links: 1 2021-02-13T17:51:42.145 INFO:teuthology.orchestra.run.gibba025.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-02-13T17:51:42.146 INFO:teuthology.orchestra.run.gibba025.stdout:Access: 2021-02-13 17:49:39.422867901 +0000 2021-02-13T17:51:42.147 INFO:teuthology.orchestra.run.gibba025.stdout:Modify: 2021-02-13 17:49:39.362897903 +0000 2021-02-13T17:51:42.147 INFO:teuthology.orchestra.run.gibba025.stdout:Change: 2021-02-13 17:49:39.362897903 +0000 2021-02-13T17:51:42.147 INFO:teuthology.orchestra.run.gibba025.stdout: Birth: - 2021-02-13T17:51:42.148 INFO:teuthology.orchestra.run.gibba025.stderr:1+0 records in 2021-02-13T17:51:42.149 INFO:teuthology.orchestra.run.gibba025.stderr:1+0 records out 2021-02-13T17:51:42.149 INFO:teuthology.orchestra.run.gibba025.stderr:512 bytes copied, 0.00017508 s, 2.9 MB/s 2021-02-13T17:51:42.151 DEBUG:teuthology.orchestra.run.gibba025:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2021-02-13T17:51:42.201 INFO:teuthology.orchestra.run.gibba025.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2021-02-13T17:51:42.202 INFO:teuthology.orchestra.run.gibba025.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-02-13T17:51:42.202 INFO:teuthology.orchestra.run.gibba025.stdout:Device: 6h/6d Inode: 344 Links: 1 2021-02-13T17:51:42.202 INFO:teuthology.orchestra.run.gibba025.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-02-13T17:51:42.202 INFO:teuthology.orchestra.run.gibba025.stdout:Access: 2021-02-13 17:49:39.570793898 +0000 2021-02-13T17:51:42.202 INFO:teuthology.orchestra.run.gibba025.stdout:Modify: 2021-02-13 17:49:39.518819900 +0000 2021-02-13T17:51:42.202 INFO:teuthology.orchestra.run.gibba025.stdout:Change: 2021-02-13 17:49:39.518819900 +0000 2021-02-13T17:51:42.202 INFO:teuthology.orchestra.run.gibba025.stdout: Birth: - 2021-02-13T17:51:42.214 INFO:teuthology.orchestra.run.gibba025.stderr:1+0 records in 2021-02-13T17:51:42.214 INFO:teuthology.orchestra.run.gibba025.stderr:1+0 records out 2021-02-13T17:51:42.214 INFO:teuthology.orchestra.run.gibba025.stderr:512 bytes copied, 0.000445252 s, 1.1 MB/s 2021-02-13T17:51:42.220 DEBUG:teuthology.orchestra.run.gibba025:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2021-02-13T17:51:42.270 INFO:teuthology.orchestra.run.gibba025.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2021-02-13T17:51:42.271 INFO:teuthology.orchestra.run.gibba025.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-02-13T17:51:42.271 INFO:teuthology.orchestra.run.gibba025.stdout:Device: 6h/6d Inode: 350 Links: 1 2021-02-13T17:51:42.271 INFO:teuthology.orchestra.run.gibba025.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-02-13T17:51:42.271 INFO:teuthology.orchestra.run.gibba025.stdout:Access: 2021-02-13 17:49:39.718719894 +0000 2021-02-13T17:51:42.271 INFO:teuthology.orchestra.run.gibba025.stdout:Modify: 2021-02-13 17:49:39.678739895 +0000 2021-02-13T17:51:42.272 INFO:teuthology.orchestra.run.gibba025.stdout:Change: 2021-02-13 17:49:39.678739895 +0000 2021-02-13T17:51:42.272 INFO:teuthology.orchestra.run.gibba025.stdout: Birth: - 2021-02-13T17:51:42.278 INFO:teuthology.orchestra.run.gibba025.stderr:1+0 records in 2021-02-13T17:51:42.278 INFO:teuthology.orchestra.run.gibba025.stderr:1+0 records out 2021-02-13T17:51:42.278 INFO:teuthology.orchestra.run.gibba025.stderr:512 bytes copied, 0.000261145 s, 2.0 MB/s 2021-02-13T17:51:42.280 INFO:tasks.ceph:osd dev map: {'c1.osd.0': '/dev/vg_nvme/lv_1', 'c1.osd.1': '/dev/vg_nvme/lv_2', 'c1.osd.2': '/dev/vg_nvme/lv_3'} 2021-02-13T17:51:42.280 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@gibba025.front.sepia.ceph.com'): {'c1.osd.0': '/dev/vg_nvme/lv_1', 'c1.osd.1': '/dev/vg_nvme/lv_2', 'c1.osd.2': '/dev/vg_nvme/lv_3'}} 2021-02-13T17:51:42.280 INFO:tasks.ceph:Generating config... 2021-02-13T17:51:42.281 INFO:tasks.ceph:[client] debug rgw = 20 2021-02-13T17:51:42.282 INFO:tasks.ceph:[client] rgw crypt require ssl = False 2021-02-13T17:51:42.282 INFO:tasks.ceph:[client] rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= 2021-02-13T17:51:42.282 INFO:tasks.ceph:[client] rgw curl low speed time = 300 2021-02-13T17:51:42.282 INFO:tasks.ceph:[client] rgw data log num shards = 4 2021-02-13T17:51:42.282 INFO:tasks.ceph:[client] rgw md log max shards = 4 2021-02-13T17:51:42.282 INFO:tasks.ceph:[client] rgw sync log trim interval = 0 2021-02-13T17:51:42.282 INFO:tasks.ceph:[client] rgw sync obj etag verify = True 2021-02-13T17:51:42.282 INFO:tasks.ceph:[global] osd heartbeat grace = 40 2021-02-13T17:51:42.282 INFO:tasks.ceph:[mgr] debug mgr = 20 2021-02-13T17:51:42.283 INFO:tasks.ceph:[mgr] debug ms = 1 2021-02-13T17:51:42.283 INFO:tasks.ceph:[mon] debug mon = 20 2021-02-13T17:51:42.283 INFO:tasks.ceph:[mon] debug ms = 1 2021-02-13T17:51:42.283 INFO:tasks.ceph:[mon] debug paxos = 20 2021-02-13T17:51:42.283 INFO:tasks.ceph:[mon] mon osd crush smoke test = False 2021-02-13T17:51:42.283 INFO:tasks.ceph:[osd] debug filestore = 20 2021-02-13T17:51:42.283 INFO:tasks.ceph:[osd] debug journal = 20 2021-02-13T17:51:42.283 INFO:tasks.ceph:[osd] debug ms = 20 2021-02-13T17:51:42.283 INFO:tasks.ceph:[osd] debug osd = 25 2021-02-13T17:51:42.283 INFO:tasks.ceph:[osd] osd fast shutdown = False 2021-02-13T17:51:42.283 INFO:tasks.ceph:[osd.0] osd_max_omap_entries_per_request = 10 2021-02-13T17:51:42.283 INFO:tasks.ceph:[osd.1] osd_max_omap_entries_per_request = 1000 2021-02-13T17:51:42.283 INFO:tasks.ceph:[osd.2] osd_max_omap_entries_per_request = 10000 2021-02-13T17:51:42.284 INFO:tasks.ceph:Setting up c1.mon.a... 2021-02-13T17:51:42.284 DEBUG:teuthology.orchestra.run.gibba025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/c1.keyring 2021-02-13T17:51:42.361 INFO:teuthology.orchestra.run.gibba025.stdout:creating /etc/ceph/c1.keyring 2021-02-13T17:51:42.363 DEBUG:teuthology.orchestra.run.gibba025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/c1.keyring 2021-02-13T17:51:42.424 DEBUG:teuthology.orchestra.run.gibba025:> sudo chmod 0644 /etc/ceph/c1.keyring 2021-02-13T17:51:42.473 DEBUG:tasks.ceph:Ceph mon addresses: [('c1.mon.a', '172.21.2.125')] 2021-02-13T17:51:42.474 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool --create --clobber --enable-all-features --add a 172.21.2.125 --print /home/ubuntu/cephtest/c1.monmap 2021-02-13T17:51:42.536 INFO:teuthology.orchestra.run.gibba025.stdout:monmaptool: monmap file /home/ubuntu/cephtest/c1.monmap 2021-02-13T17:51:42.536 INFO:teuthology.orchestra.run.gibba025.stdout:monmaptool: generated fsid bed73c08-798c-4f38-a3f3-1bfc03039602 2021-02-13T17:51:42.537 INFO:teuthology.orchestra.run.gibba025.stdout:epoch 0 2021-02-13T17:51:42.537 INFO:teuthology.orchestra.run.gibba025.stdout:fsid bed73c08-798c-4f38-a3f3-1bfc03039602 2021-02-13T17:51:42.537 INFO:teuthology.orchestra.run.gibba025.stdout:last_changed 2021-02-13 17:51:42.534210 2021-02-13T17:51:42.537 INFO:teuthology.orchestra.run.gibba025.stdout:created 2021-02-13 17:51:42.534210 2021-02-13T17:51:42.537 INFO:teuthology.orchestra.run.gibba025.stdout:min_mon_release 0 (unknown) 2021-02-13T17:51:42.537 INFO:teuthology.orchestra.run.gibba025.stdout:0: [v2:172.21.2.125:3300/0,v1:172.21.2.125:6789/0] mon.a 2021-02-13T17:51:42.537 INFO:teuthology.orchestra.run.gibba025.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/c1.monmap (1 monitors) 2021-02-13T17:51:42.538 INFO:tasks.ceph:Writing /etc/ceph/c1.conf for FSID bed73c08-798c-4f38-a3f3-1bfc03039602... 2021-02-13T17:51:42.539 DEBUG:teuthology.orchestra.run.gibba025:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/c1.conf && sudo chmod 0644 /etc/ceph/c1.conf > /dev/null 2021-02-13T17:51:42.584 DEBUG:teuthology.orchestra.run.gibba036:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/c1.conf && sudo chmod 0644 /etc/ceph/c1.conf > /dev/null 2021-02-13T17:51:42.596 INFO:teuthology.orchestra.run.gibba025.stdout:[global] 2021-02-13T17:51:42.596 INFO:teuthology.orchestra.run.gibba025.stdout: chdir = "" 2021-02-13T17:51:42.596 INFO:teuthology.orchestra.run.gibba025.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-02-13T17:51:42.596 INFO:teuthology.orchestra.run.gibba025.stdout: auth supported = cephx 2021-02-13T17:51:42.597 INFO:teuthology.orchestra.run.gibba025.stdout: 2021-02-13T17:51:42.597 INFO:teuthology.orchestra.run.gibba025.stdout: filestore xattr use omap = true 2021-02-13T17:51:42.597 INFO:teuthology.orchestra.run.gibba025.stdout: 2021-02-13T17:51:42.597 INFO:teuthology.orchestra.run.gibba025.stdout: mon clock drift allowed = 1.000 2021-02-13T17:51:42.597 INFO:teuthology.orchestra.run.gibba025.stdout: 2021-02-13T17:51:42.597 INFO:teuthology.orchestra.run.gibba025.stdout: osd crush chooseleaf type = 0 2021-02-13T17:51:42.597 INFO:teuthology.orchestra.run.gibba025.stdout: auth debug = true 2021-02-13T17:51:42.597 INFO:teuthology.orchestra.run.gibba025.stdout: 2021-02-13T17:51:42.597 INFO:teuthology.orchestra.run.gibba025.stdout: ms die on old message = true 2021-02-13T17:51:42.597 INFO:teuthology.orchestra.run.gibba025.stdout: ms die on bug = true 2021-02-13T17:51:42.598 INFO:teuthology.orchestra.run.gibba025.stdout: 2021-02-13T17:51:42.598 INFO:teuthology.orchestra.run.gibba025.stdout: mon max pg per osd = 10000 # >= luminous 2021-02-13T17:51:42.598 INFO:teuthology.orchestra.run.gibba025.stdout: mon pg warn max object skew = 0 2021-02-13T17:51:42.598 INFO:teuthology.orchestra.run.gibba025.stdout: 2021-02-13T17:51:42.598 INFO:teuthology.orchestra.run.gibba025.stdout: osd pool default size = 2 2021-02-13T17:51:42.598 INFO:teuthology.orchestra.run.gibba025.stdout: 2021-02-13T17:51:42.598 INFO:teuthology.orchestra.run.gibba025.stdout: mon osd allow primary affinity = true 2021-02-13T17:51:42.598 INFO:teuthology.orchestra.run.gibba025.stdout: mon osd allow pg remap = true 2021-02-13T17:51:42.598 INFO:teuthology.orchestra.run.gibba025.stdout: mon warn on legacy crush tunables = false 2021-02-13T17:51:42.598 INFO:teuthology.orchestra.run.gibba025.stdout: mon warn on crush straw calc version zero = false 2021-02-13T17:51:42.598 INFO:teuthology.orchestra.run.gibba025.stdout: mon warn on no sortbitwise = false 2021-02-13T17:51:42.599 INFO:teuthology.orchestra.run.gibba025.stdout: mon warn on osd down out interval zero = false 2021-02-13T17:51:42.599 INFO:teuthology.orchestra.run.gibba025.stdout: mon warn on too few osds = false 2021-02-13T17:51:42.599 INFO:teuthology.orchestra.run.gibba025.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-02-13T17:51:42.599 INFO:teuthology.orchestra.run.gibba025.stdout: mon_warn_on_pool_no_redundancy = false 2021-02-13T17:51:42.599 INFO:teuthology.orchestra.run.gibba025.stdout: 2021-02-13T17:51:42.599 INFO:teuthology.orchestra.run.gibba025.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-02-13T17:51:42.599 INFO:teuthology.orchestra.run.gibba025.stdout: 2021-02-13T17:51:42.599 INFO:teuthology.orchestra.run.gibba025.stdout: osd default data pool replay window = 5 2021-02-13T17:51:42.599 INFO:teuthology.orchestra.run.gibba025.stdout: 2021-02-13T17:51:42.599 INFO:teuthology.orchestra.run.gibba025.stdout: mon allow pool delete = true 2021-02-13T17:51:42.599 INFO:teuthology.orchestra.run.gibba025.stdout: 2021-02-13T17:51:42.599 INFO:teuthology.orchestra.run.gibba025.stdout: mon cluster log file level = debug 2021-02-13T17:51:42.599 INFO:teuthology.orchestra.run.gibba025.stdout: debug asserts on shutdown = true 2021-02-13T17:51:42.600 INFO:teuthology.orchestra.run.gibba025.stdout: mon health detail to clog = false 2021-02-13T17:51:42.600 INFO:teuthology.orchestra.run.gibba025.stdout: 2021-02-13T17:51:42.600 INFO:teuthology.orchestra.run.gibba025.stdout: # we see this fail in qa on *nautilus*; bump up retries 2021-02-13T17:51:42.600 INFO:teuthology.orchestra.run.gibba025.stdout: mon_client_directed_command_retry = 4 2021-02-13T17:51:42.600 INFO:teuthology.orchestra.run.gibba025.stdout: mon host = 172.21.2.125 2021-02-13T17:51:42.600 INFO:teuthology.orchestra.run.gibba025.stdout: osd heartbeat grace = 40 2021-02-13T17:51:42.600 INFO:teuthology.orchestra.run.gibba025.stdout: fsid = bed73c08-798c-4f38-a3f3-1bfc03039602 2021-02-13T17:51:42.600 INFO:teuthology.orchestra.run.gibba025.stdout: 2021-02-13T17:51:42.600 INFO:teuthology.orchestra.run.gibba025.stdout:[osd] 2021-02-13T17:51:42.600 INFO:teuthology.orchestra.run.gibba025.stdout: osd journal size = 100 2021-02-13T17:51:42.600 INFO:teuthology.orchestra.run.gibba025.stdout: 2021-02-13T17:51:42.600 INFO:teuthology.orchestra.run.gibba025.stdout: osd scrub load threshold = 5.0 2021-02-13T17:51:42.600 INFO:teuthology.orchestra.run.gibba025.stdout: osd scrub max interval = 600 2021-02-13T17:51:42.601 INFO:teuthology.orchestra.run.gibba025.stdout: 2021-02-13T17:51:42.601 INFO:teuthology.orchestra.run.gibba025.stdout: osd recover clone overlap = true 2021-02-13T17:51:42.601 INFO:teuthology.orchestra.run.gibba025.stdout: osd recovery max chunk = 1048576 2021-02-13T17:51:42.601 INFO:teuthology.orchestra.run.gibba025.stdout: 2021-02-13T17:51:42.601 INFO:teuthology.orchestra.run.gibba025.stdout: osd debug shutdown = true 2021-02-13T17:51:42.601 INFO:teuthology.orchestra.run.gibba025.stdout: osd debug op order = true 2021-02-13T17:51:42.601 INFO:teuthology.orchestra.run.gibba025.stdout: osd debug verify stray on activate = true 2021-02-13T17:51:42.601 INFO:teuthology.orchestra.run.gibba025.stdout: 2021-02-13T17:51:42.601 INFO:teuthology.orchestra.run.gibba025.stdout: osd open classes on start = true 2021-02-13T17:51:42.601 INFO:teuthology.orchestra.run.gibba025.stdout: osd debug pg log writeout = true 2021-02-13T17:51:42.601 INFO:teuthology.orchestra.run.gibba025.stdout: 2021-02-13T17:51:42.601 INFO:teuthology.orchestra.run.gibba025.stdout: osd deep scrub update digest min age = 30 2021-02-13T17:51:42.601 INFO:teuthology.orchestra.run.gibba025.stdout: 2021-02-13T17:51:42.602 INFO:teuthology.orchestra.run.gibba025.stdout: osd map max advance = 10 2021-02-13T17:51:42.602 INFO:teuthology.orchestra.run.gibba025.stdout: 2021-02-13T17:51:42.602 INFO:teuthology.orchestra.run.gibba025.stdout: journal zero on create = true 2021-02-13T17:51:42.602 INFO:teuthology.orchestra.run.gibba025.stdout: 2021-02-13T17:51:42.602 INFO:teuthology.orchestra.run.gibba025.stdout: filestore ondisk finisher threads = 3 2021-02-13T17:51:42.602 INFO:teuthology.orchestra.run.gibba025.stdout: filestore apply finisher threads = 3 2021-02-13T17:51:42.602 INFO:teuthology.orchestra.run.gibba025.stdout: 2021-02-13T17:51:42.602 INFO:teuthology.orchestra.run.gibba025.stdout: bdev debug aio = true 2021-02-13T17:51:42.602 INFO:teuthology.orchestra.run.gibba025.stdout: osd debug misdirected ops = true 2021-02-13T17:51:42.602 INFO:teuthology.orchestra.run.gibba025.stdout: debug filestore = 20 2021-02-13T17:51:42.602 INFO:teuthology.orchestra.run.gibba025.stdout: debug journal = 20 2021-02-13T17:51:42.602 INFO:teuthology.orchestra.run.gibba025.stdout: debug ms = 20 2021-02-13T17:51:42.603 INFO:teuthology.orchestra.run.gibba025.stdout: debug osd = 25 2021-02-13T17:51:42.603 INFO:teuthology.orchestra.run.gibba025.stdout: osd fast shutdown = False 2021-02-13T17:51:42.603 INFO:teuthology.orchestra.run.gibba025.stdout: 2021-02-13T17:51:42.603 INFO:teuthology.orchestra.run.gibba025.stdout:[mgr] 2021-02-13T17:51:42.603 INFO:teuthology.orchestra.run.gibba025.stdout: debug ms = 1 2021-02-13T17:51:42.603 INFO:teuthology.orchestra.run.gibba025.stdout: debug mgr = 20 2021-02-13T17:51:42.603 INFO:teuthology.orchestra.run.gibba025.stdout: debug mon = 20 2021-02-13T17:51:42.603 INFO:teuthology.orchestra.run.gibba025.stdout: debug auth = 20 2021-02-13T17:51:42.603 INFO:teuthology.orchestra.run.gibba025.stdout: mon reweight min pgs per osd = 4 2021-02-13T17:51:42.603 INFO:teuthology.orchestra.run.gibba025.stdout: mon reweight min bytes per osd = 10 2021-02-13T17:51:42.603 INFO:teuthology.orchestra.run.gibba025.stdout: 2021-02-13T17:51:42.603 INFO:teuthology.orchestra.run.gibba025.stdout:[mon] 2021-02-13T17:51:42.603 INFO:teuthology.orchestra.run.gibba025.stdout: debug ms = 1 2021-02-13T17:51:42.603 INFO:teuthology.orchestra.run.gibba025.stdout: debug mon = 20 2021-02-13T17:51:42.604 INFO:teuthology.orchestra.run.gibba025.stdout: debug paxos = 20 2021-02-13T17:51:42.604 INFO:teuthology.orchestra.run.gibba025.stdout: debug auth = 20 2021-02-13T17:51:42.604 INFO:teuthology.orchestra.run.gibba025.stdout: mon data avail warn = 5 2021-02-13T17:51:42.604 INFO:teuthology.orchestra.run.gibba025.stdout: mon mgr mkfs grace = 240 2021-02-13T17:51:42.604 INFO:teuthology.orchestra.run.gibba025.stdout: mon reweight min pgs per osd = 4 2021-02-13T17:51:42.604 INFO:teuthology.orchestra.run.gibba025.stdout: mon osd reporter subtree level = osd 2021-02-13T17:51:42.604 INFO:teuthology.orchestra.run.gibba025.stdout: mon osd prime pg temp = true 2021-02-13T17:51:42.604 INFO:teuthology.orchestra.run.gibba025.stdout: mon reweight min bytes per osd = 10 2021-02-13T17:51:42.604 INFO:teuthology.orchestra.run.gibba025.stdout: mon osd crush smoke test = False 2021-02-13T17:51:42.604 INFO:teuthology.orchestra.run.gibba025.stdout: 2021-02-13T17:51:42.604 INFO:teuthology.orchestra.run.gibba025.stdout:[client] 2021-02-13T17:51:42.604 INFO:teuthology.orchestra.run.gibba025.stdout: rgw cache enabled = true 2021-02-13T17:51:42.604 INFO:teuthology.orchestra.run.gibba025.stdout: rgw enable ops log = true 2021-02-13T17:51:42.605 INFO:teuthology.orchestra.run.gibba025.stdout: rgw enable usage log = true 2021-02-13T17:51:42.605 INFO:teuthology.orchestra.run.gibba025.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-02-13T17:51:42.605 INFO:teuthology.orchestra.run.gibba025.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-02-13T17:51:42.605 INFO:teuthology.orchestra.run.gibba025.stdout: debug rgw = 20 2021-02-13T17:51:42.605 INFO:teuthology.orchestra.run.gibba025.stdout: rgw crypt require ssl = False 2021-02-13T17:51:42.605 INFO:teuthology.orchestra.run.gibba025.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= 2021-02-13T17:51:42.605 INFO:teuthology.orchestra.run.gibba025.stdout: rgw curl low speed time = 300 2021-02-13T17:51:42.605 INFO:teuthology.orchestra.run.gibba025.stdout: rgw data log num shards = 4 2021-02-13T17:51:42.605 INFO:teuthology.orchestra.run.gibba025.stdout: rgw md log max shards = 4 2021-02-13T17:51:42.605 INFO:teuthology.orchestra.run.gibba025.stdout: rgw sync log trim interval = 0 2021-02-13T17:51:42.605 INFO:teuthology.orchestra.run.gibba025.stdout: rgw sync obj etag verify = True 2021-02-13T17:51:42.605 INFO:teuthology.orchestra.run.gibba025.stdout:[mon.a] 2021-02-13T17:51:42.605 INFO:teuthology.orchestra.run.gibba025.stdout:[osd.0] 2021-02-13T17:51:42.605 INFO:teuthology.orchestra.run.gibba025.stdout: osd_max_omap_entries_per_request = 10 2021-02-13T17:51:42.606 INFO:teuthology.orchestra.run.gibba025.stdout:[osd.1] 2021-02-13T17:51:42.606 INFO:teuthology.orchestra.run.gibba025.stdout: osd_max_omap_entries_per_request = 1000 2021-02-13T17:51:42.606 INFO:teuthology.orchestra.run.gibba025.stdout:[osd.2] 2021-02-13T17:51:42.606 INFO:teuthology.orchestra.run.gibba025.stdout: osd_max_omap_entries_per_request = 10000 2021-02-13T17:51:42.607 INFO:teuthology.orchestra.run.gibba036.stdout:[global] 2021-02-13T17:51:42.607 INFO:teuthology.orchestra.run.gibba036.stdout: chdir = "" 2021-02-13T17:51:42.607 INFO:teuthology.orchestra.run.gibba036.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-02-13T17:51:42.607 INFO:teuthology.orchestra.run.gibba036.stdout: auth supported = cephx 2021-02-13T17:51:42.607 INFO:teuthology.orchestra.run.gibba036.stdout: 2021-02-13T17:51:42.607 INFO:teuthology.orchestra.run.gibba036.stdout: filestore xattr use omap = true 2021-02-13T17:51:42.608 INFO:teuthology.orchestra.run.gibba036.stdout: 2021-02-13T17:51:42.608 INFO:teuthology.orchestra.run.gibba036.stdout: mon clock drift allowed = 1.000 2021-02-13T17:51:42.608 INFO:teuthology.orchestra.run.gibba036.stdout: 2021-02-13T17:51:42.608 INFO:teuthology.orchestra.run.gibba036.stdout: osd crush chooseleaf type = 0 2021-02-13T17:51:42.608 INFO:teuthology.orchestra.run.gibba036.stdout: auth debug = true 2021-02-13T17:51:42.608 INFO:teuthology.orchestra.run.gibba036.stdout: 2021-02-13T17:51:42.608 INFO:teuthology.orchestra.run.gibba036.stdout: ms die on old message = true 2021-02-13T17:51:42.608 INFO:teuthology.orchestra.run.gibba036.stdout: ms die on bug = true 2021-02-13T17:51:42.608 INFO:teuthology.orchestra.run.gibba036.stdout: 2021-02-13T17:51:42.608 INFO:teuthology.orchestra.run.gibba036.stdout: mon max pg per osd = 10000 # >= luminous 2021-02-13T17:51:42.608 INFO:teuthology.orchestra.run.gibba036.stdout: mon pg warn max object skew = 0 2021-02-13T17:51:42.608 INFO:teuthology.orchestra.run.gibba036.stdout: 2021-02-13T17:51:42.609 INFO:teuthology.orchestra.run.gibba036.stdout: osd pool default size = 2 2021-02-13T17:51:42.609 INFO:teuthology.orchestra.run.gibba036.stdout: 2021-02-13T17:51:42.609 INFO:teuthology.orchestra.run.gibba036.stdout: mon osd allow primary affinity = true 2021-02-13T17:51:42.609 INFO:teuthology.orchestra.run.gibba036.stdout: mon osd allow pg remap = true 2021-02-13T17:51:42.609 INFO:teuthology.orchestra.run.gibba036.stdout: mon warn on legacy crush tunables = false 2021-02-13T17:51:42.609 INFO:teuthology.orchestra.run.gibba036.stdout: mon warn on crush straw calc version zero = false 2021-02-13T17:51:42.609 INFO:teuthology.orchestra.run.gibba036.stdout: mon warn on no sortbitwise = false 2021-02-13T17:51:42.609 INFO:teuthology.orchestra.run.gibba036.stdout: mon warn on osd down out interval zero = false 2021-02-13T17:51:42.609 INFO:teuthology.orchestra.run.gibba036.stdout: mon warn on too few osds = false 2021-02-13T17:51:42.609 INFO:teuthology.orchestra.run.gibba036.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-02-13T17:51:42.609 INFO:teuthology.orchestra.run.gibba036.stdout: mon_warn_on_pool_no_redundancy = false 2021-02-13T17:51:42.610 INFO:teuthology.orchestra.run.gibba036.stdout: 2021-02-13T17:51:42.610 INFO:teuthology.orchestra.run.gibba036.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-02-13T17:51:42.610 INFO:teuthology.orchestra.run.gibba036.stdout: 2021-02-13T17:51:42.610 INFO:teuthology.orchestra.run.gibba036.stdout: osd default data pool replay window = 5 2021-02-13T17:51:42.610 INFO:teuthology.orchestra.run.gibba036.stdout: 2021-02-13T17:51:42.610 INFO:teuthology.orchestra.run.gibba036.stdout: mon allow pool delete = true 2021-02-13T17:51:42.610 INFO:teuthology.orchestra.run.gibba036.stdout: 2021-02-13T17:51:42.610 INFO:teuthology.orchestra.run.gibba036.stdout: mon cluster log file level = debug 2021-02-13T17:51:42.610 INFO:teuthology.orchestra.run.gibba036.stdout: debug asserts on shutdown = true 2021-02-13T17:51:42.611 INFO:teuthology.orchestra.run.gibba036.stdout: mon health detail to clog = false 2021-02-13T17:51:42.611 INFO:teuthology.orchestra.run.gibba036.stdout: 2021-02-13T17:51:42.611 INFO:teuthology.orchestra.run.gibba036.stdout: # we see this fail in qa on *nautilus*; bump up retries 2021-02-13T17:51:42.611 INFO:teuthology.orchestra.run.gibba036.stdout: mon_client_directed_command_retry = 4 2021-02-13T17:51:42.611 INFO:teuthology.orchestra.run.gibba036.stdout: mon host = 172.21.2.125 2021-02-13T17:51:42.611 INFO:teuthology.orchestra.run.gibba036.stdout: osd heartbeat grace = 40 2021-02-13T17:51:42.611 INFO:teuthology.orchestra.run.gibba036.stdout: fsid = bed73c08-798c-4f38-a3f3-1bfc03039602 2021-02-13T17:51:42.612 INFO:teuthology.orchestra.run.gibba036.stdout: 2021-02-13T17:51:42.612 INFO:teuthology.orchestra.run.gibba036.stdout:[osd] 2021-02-13T17:51:42.612 INFO:teuthology.orchestra.run.gibba036.stdout: osd journal size = 100 2021-02-13T17:51:42.612 INFO:teuthology.orchestra.run.gibba036.stdout: 2021-02-13T17:51:42.612 INFO:teuthology.orchestra.run.gibba036.stdout: osd scrub load threshold = 5.0 2021-02-13T17:51:42.612 INFO:teuthology.orchestra.run.gibba036.stdout: osd scrub max interval = 600 2021-02-13T17:51:42.612 INFO:teuthology.orchestra.run.gibba036.stdout: 2021-02-13T17:51:42.612 INFO:teuthology.orchestra.run.gibba036.stdout: osd recover clone overlap = true 2021-02-13T17:51:42.612 INFO:teuthology.orchestra.run.gibba036.stdout: osd recovery max chunk = 1048576 2021-02-13T17:51:42.612 INFO:teuthology.orchestra.run.gibba036.stdout: 2021-02-13T17:51:42.612 INFO:teuthology.orchestra.run.gibba036.stdout: osd debug shutdown = true 2021-02-13T17:51:42.612 INFO:teuthology.orchestra.run.gibba036.stdout: osd debug op order = true 2021-02-13T17:51:42.613 INFO:teuthology.orchestra.run.gibba036.stdout: osd debug verify stray on activate = true 2021-02-13T17:51:42.613 INFO:teuthology.orchestra.run.gibba036.stdout: 2021-02-13T17:51:42.613 INFO:teuthology.orchestra.run.gibba036.stdout: osd open classes on start = true 2021-02-13T17:51:42.613 INFO:teuthology.orchestra.run.gibba036.stdout: osd debug pg log writeout = true 2021-02-13T17:51:42.613 INFO:teuthology.orchestra.run.gibba036.stdout: 2021-02-13T17:51:42.613 INFO:teuthology.orchestra.run.gibba036.stdout: osd deep scrub update digest min age = 30 2021-02-13T17:51:42.613 INFO:teuthology.orchestra.run.gibba036.stdout: 2021-02-13T17:51:42.613 INFO:teuthology.orchestra.run.gibba036.stdout: osd map max advance = 10 2021-02-13T17:51:42.613 INFO:teuthology.orchestra.run.gibba036.stdout: 2021-02-13T17:51:42.613 INFO:teuthology.orchestra.run.gibba036.stdout: journal zero on create = true 2021-02-13T17:51:42.613 INFO:teuthology.orchestra.run.gibba036.stdout: 2021-02-13T17:51:42.613 INFO:teuthology.orchestra.run.gibba036.stdout: filestore ondisk finisher threads = 3 2021-02-13T17:51:42.613 INFO:teuthology.orchestra.run.gibba036.stdout: filestore apply finisher threads = 3 2021-02-13T17:51:42.614 INFO:teuthology.orchestra.run.gibba036.stdout: 2021-02-13T17:51:42.614 INFO:teuthology.orchestra.run.gibba036.stdout: bdev debug aio = true 2021-02-13T17:51:42.614 INFO:teuthology.orchestra.run.gibba036.stdout: osd debug misdirected ops = true 2021-02-13T17:51:42.614 INFO:teuthology.orchestra.run.gibba036.stdout: debug filestore = 20 2021-02-13T17:51:42.614 INFO:teuthology.orchestra.run.gibba036.stdout: debug journal = 20 2021-02-13T17:51:42.614 INFO:teuthology.orchestra.run.gibba036.stdout: debug ms = 20 2021-02-13T17:51:42.614 INFO:teuthology.orchestra.run.gibba036.stdout: debug osd = 25 2021-02-13T17:51:42.614 INFO:teuthology.orchestra.run.gibba036.stdout: osd fast shutdown = False 2021-02-13T17:51:42.614 INFO:teuthology.orchestra.run.gibba036.stdout: 2021-02-13T17:51:42.614 INFO:teuthology.orchestra.run.gibba036.stdout:[mgr] 2021-02-13T17:51:42.614 INFO:teuthology.orchestra.run.gibba036.stdout: debug ms = 1 2021-02-13T17:51:42.614 INFO:teuthology.orchestra.run.gibba036.stdout: debug mgr = 20 2021-02-13T17:51:42.614 INFO:teuthology.orchestra.run.gibba036.stdout: debug mon = 20 2021-02-13T17:51:42.615 INFO:teuthology.orchestra.run.gibba036.stdout: debug auth = 20 2021-02-13T17:51:42.615 INFO:teuthology.orchestra.run.gibba036.stdout: mon reweight min pgs per osd = 4 2021-02-13T17:51:42.615 INFO:teuthology.orchestra.run.gibba036.stdout: mon reweight min bytes per osd = 10 2021-02-13T17:51:42.615 INFO:teuthology.orchestra.run.gibba036.stdout: 2021-02-13T17:51:42.615 INFO:teuthology.orchestra.run.gibba036.stdout:[mon] 2021-02-13T17:51:42.615 INFO:teuthology.orchestra.run.gibba036.stdout: debug ms = 1 2021-02-13T17:51:42.615 INFO:teuthology.orchestra.run.gibba036.stdout: debug mon = 20 2021-02-13T17:51:42.616 INFO:teuthology.orchestra.run.gibba036.stdout: debug paxos = 20 2021-02-13T17:51:42.616 INFO:teuthology.orchestra.run.gibba036.stdout: debug auth = 20 2021-02-13T17:51:42.616 INFO:teuthology.orchestra.run.gibba036.stdout: mon data avail warn = 5 2021-02-13T17:51:42.616 INFO:teuthology.orchestra.run.gibba036.stdout: mon mgr mkfs grace = 240 2021-02-13T17:51:42.616 INFO:teuthology.orchestra.run.gibba036.stdout: mon reweight min pgs per osd = 4 2021-02-13T17:51:42.616 INFO:teuthology.orchestra.run.gibba036.stdout: mon osd reporter subtree level = osd 2021-02-13T17:51:42.617 INFO:teuthology.orchestra.run.gibba036.stdout: mon osd prime pg temp = true 2021-02-13T17:51:42.617 INFO:teuthology.orchestra.run.gibba036.stdout: mon reweight min bytes per osd = 10 2021-02-13T17:51:42.617 INFO:teuthology.orchestra.run.gibba036.stdout: mon osd crush smoke test = False 2021-02-13T17:51:42.617 INFO:teuthology.orchestra.run.gibba036.stdout: 2021-02-13T17:51:42.617 INFO:teuthology.orchestra.run.gibba036.stdout:[client] 2021-02-13T17:51:42.617 INFO:teuthology.orchestra.run.gibba036.stdout: rgw cache enabled = true 2021-02-13T17:51:42.618 INFO:teuthology.orchestra.run.gibba036.stdout: rgw enable ops log = true 2021-02-13T17:51:42.618 INFO:teuthology.orchestra.run.gibba036.stdout: rgw enable usage log = true 2021-02-13T17:51:42.618 INFO:teuthology.orchestra.run.gibba036.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-02-13T17:51:42.618 INFO:teuthology.orchestra.run.gibba036.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-02-13T17:51:42.618 INFO:teuthology.orchestra.run.gibba036.stdout: debug rgw = 20 2021-02-13T17:51:42.618 INFO:teuthology.orchestra.run.gibba036.stdout: rgw crypt require ssl = False 2021-02-13T17:51:42.619 INFO:teuthology.orchestra.run.gibba036.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= 2021-02-13T17:51:42.619 INFO:teuthology.orchestra.run.gibba036.stdout: rgw curl low speed time = 300 2021-02-13T17:51:42.619 INFO:teuthology.orchestra.run.gibba036.stdout: rgw data log num shards = 4 2021-02-13T17:51:42.619 INFO:teuthology.orchestra.run.gibba036.stdout: rgw md log max shards = 4 2021-02-13T17:51:42.619 INFO:teuthology.orchestra.run.gibba036.stdout: rgw sync log trim interval = 0 2021-02-13T17:51:42.619 INFO:teuthology.orchestra.run.gibba036.stdout: rgw sync obj etag verify = True 2021-02-13T17:51:42.620 INFO:teuthology.orchestra.run.gibba036.stdout:[mon.a] 2021-02-13T17:51:42.620 INFO:teuthology.orchestra.run.gibba036.stdout:[osd.0] 2021-02-13T17:51:42.620 INFO:teuthology.orchestra.run.gibba036.stdout: osd_max_omap_entries_per_request = 10 2021-02-13T17:51:42.620 INFO:teuthology.orchestra.run.gibba036.stdout:[osd.1] 2021-02-13T17:51:42.620 INFO:teuthology.orchestra.run.gibba036.stdout: osd_max_omap_entries_per_request = 1000 2021-02-13T17:51:42.621 INFO:teuthology.orchestra.run.gibba036.stdout:[osd.2] 2021-02-13T17:51:42.621 INFO:teuthology.orchestra.run.gibba036.stdout: osd_max_omap_entries_per_request = 10000 2021-02-13T17:51:42.621 INFO:tasks.ceph:Creating admin key on c1.mon.a... 2021-02-13T17:51:42.622 DEBUG:teuthology.orchestra.run.gibba025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/c1.keyring 2021-02-13T17:51:42.690 INFO:tasks.ceph:Copying monmap to all nodes... 2021-02-13T17:51:42.740 DEBUG:teuthology.orchestra.remote:gibba025:/etc/ceph/c1.keyring is 206B 2021-02-13T17:51:42.802 DEBUG:teuthology.orchestra.remote:gibba025:/home/ubuntu/cephtest/c1.monmap is 177B 2021-02-13T17:51:42.854 INFO:tasks.ceph:Sending monmap to node ubuntu@gibba025.front.sepia.ceph.com 2021-02-13T17:51:42.854 DEBUG:teuthology.orchestra.run.gibba025:> set -ex 2021-02-13T17:51:42.854 DEBUG:teuthology.orchestra.run.gibba025:> sudo dd of=/etc/ceph/c1.keyring 2021-02-13T17:51:42.854 DEBUG:teuthology.orchestra.run.gibba025:> sudo chmod 0644 /etc/ceph/c1.keyring 2021-02-13T17:51:42.872 DEBUG:teuthology.orchestra.run.gibba025:> set -ex 2021-02-13T17:51:42.872 DEBUG:teuthology.orchestra.run.gibba025:> dd of=/home/ubuntu/cephtest/c1.monmap 2021-02-13T17:51:42.921 INFO:tasks.ceph:Sending monmap to node ubuntu@gibba036.front.sepia.ceph.com 2021-02-13T17:51:42.921 DEBUG:teuthology.orchestra.run.gibba036:> set -ex 2021-02-13T17:51:42.922 DEBUG:teuthology.orchestra.run.gibba036:> sudo dd of=/etc/ceph/c1.keyring 2021-02-13T17:51:42.922 DEBUG:teuthology.orchestra.run.gibba036:> sudo chmod 0644 /etc/ceph/c1.keyring 2021-02-13T17:51:42.969 DEBUG:teuthology.orchestra.run.gibba036:> set -ex 2021-02-13T17:51:42.969 DEBUG:teuthology.orchestra.run.gibba036:> dd of=/home/ubuntu/cephtest/c1.monmap 2021-02-13T17:51:43.055 INFO:tasks.ceph:Setting up mon nodes... 2021-02-13T17:51:43.055 INFO:tasks.ceph:Setting up mgr nodes... 2021-02-13T17:51:43.055 DEBUG:teuthology.orchestra.run.gibba025:> sudo mkdir -p /var/lib/ceph/mgr/c1-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/c1-x/keyring 2021-02-13T17:51:43.079 INFO:teuthology.orchestra.run.gibba025.stdout:creating /var/lib/ceph/mgr/c1-x/keyring 2021-02-13T17:51:43.080 INFO:tasks.ceph:Setting up mds nodes... 2021-02-13T17:51:43.080 INFO:tasks.ceph_client:Setting up client nodes... 2021-02-13T17:51:43.081 DEBUG:teuthology.orchestra.run.gibba025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/c1.client.0.keyring && sudo chmod 0644 /etc/ceph/c1.client.0.keyring 2021-02-13T17:51:43.138 INFO:teuthology.orchestra.run.gibba025.stdout:creating /etc/ceph/c1.client.0.keyring 2021-02-13T17:51:43.142 DEBUG:teuthology.orchestra.run.gibba025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/c1.client.1.keyring && sudo chmod 0644 /etc/ceph/c1.client.1.keyring 2021-02-13T17:51:43.210 INFO:teuthology.orchestra.run.gibba025.stdout:creating /etc/ceph/c1.client.1.keyring 2021-02-13T17:51:43.218 INFO:tasks.ceph:Running mkfs on osd nodes... 2021-02-13T17:51:43.219 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@gibba025.front.sepia.ceph.com'): {'c1.osd.0': '/dev/vg_nvme/lv_1', 'c1.osd.1': '/dev/vg_nvme/lv_2', 'c1.osd.2': '/dev/vg_nvme/lv_3'}} 2021-02-13T17:51:43.219 DEBUG:teuthology.orchestra.run.gibba025:> sudo mkdir -p /var/lib/ceph/osd/c1-0 2021-02-13T17:51:43.272 INFO:tasks.ceph:roles_to_devs: {'c1.osd.0': '/dev/vg_nvme/lv_1', 'c1.osd.1': '/dev/vg_nvme/lv_2', 'c1.osd.2': '/dev/vg_nvme/lv_3'} 2021-02-13T17:51:43.272 INFO:tasks.ceph:role: c1.osd.0 2021-02-13T17:51:43.272 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@gibba025.front.sepia.ceph.com 2021-02-13T17:51:43.273 DEBUG:teuthology.orchestra.run.gibba025:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2021-02-13T17:51:43.354 INFO:teuthology.orchestra.run.gibba025.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5505024 blks 2021-02-13T17:51:43.354 INFO:teuthology.orchestra.run.gibba025.stdout: = sectsz=512 attr=2, projid32bit=1 2021-02-13T17:51:43.354 INFO:teuthology.orchestra.run.gibba025.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2021-02-13T17:51:43.354 INFO:teuthology.orchestra.run.gibba025.stdout:data = bsize=4096 blocks=22020096, imaxpct=25 2021-02-13T17:51:43.355 INFO:teuthology.orchestra.run.gibba025.stdout: = sunit=0 swidth=0 blks 2021-02-13T17:51:43.355 INFO:teuthology.orchestra.run.gibba025.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2021-02-13T17:51:43.355 INFO:teuthology.orchestra.run.gibba025.stdout:log =internal log bsize=4096 blocks=10752, version=2 2021-02-13T17:51:43.355 INFO:teuthology.orchestra.run.gibba025.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-02-13T17:51:43.355 INFO:teuthology.orchestra.run.gibba025.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-02-13T17:51:43.356 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@gibba025.front.sepia.ceph.com -o noatime 2021-02-13T17:51:43.357 DEBUG:teuthology.orchestra.run.gibba025:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/c1-0 2021-02-13T17:51:43.427 DEBUG:teuthology.orchestra.run.gibba025:> sudo /sbin/restorecon /var/lib/ceph/osd/c1-0 2021-02-13T17:51:43.484 INFO:teuthology.orchestra.run.gibba025.stderr:sudo: /sbin/restorecon: command not found 2021-02-13T17:51:43.484 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-13T17:51:43.485 DEBUG:teuthology.orchestra.run.gibba025:> sudo mkdir -p /var/lib/ceph/osd/c1-1 2021-02-13T17:51:43.545 INFO:tasks.ceph:roles_to_devs: {'c1.osd.0': '/dev/vg_nvme/lv_1', 'c1.osd.1': '/dev/vg_nvme/lv_2', 'c1.osd.2': '/dev/vg_nvme/lv_3'} 2021-02-13T17:51:43.545 INFO:tasks.ceph:role: c1.osd.1 2021-02-13T17:51:43.545 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@gibba025.front.sepia.ceph.com 2021-02-13T17:51:43.545 DEBUG:teuthology.orchestra.run.gibba025:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2021-02-13T17:51:43.629 INFO:teuthology.orchestra.run.gibba025.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5505024 blks 2021-02-13T17:51:43.629 INFO:teuthology.orchestra.run.gibba025.stdout: = sectsz=512 attr=2, projid32bit=1 2021-02-13T17:51:43.629 INFO:teuthology.orchestra.run.gibba025.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2021-02-13T17:51:43.629 INFO:teuthology.orchestra.run.gibba025.stdout:data = bsize=4096 blocks=22020096, imaxpct=25 2021-02-13T17:51:43.629 INFO:teuthology.orchestra.run.gibba025.stdout: = sunit=0 swidth=0 blks 2021-02-13T17:51:43.629 INFO:teuthology.orchestra.run.gibba025.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2021-02-13T17:51:43.629 INFO:teuthology.orchestra.run.gibba025.stdout:log =internal log bsize=4096 blocks=10752, version=2 2021-02-13T17:51:43.629 INFO:teuthology.orchestra.run.gibba025.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-02-13T17:51:43.630 INFO:teuthology.orchestra.run.gibba025.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-02-13T17:51:43.630 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@gibba025.front.sepia.ceph.com -o noatime 2021-02-13T17:51:43.631 DEBUG:teuthology.orchestra.run.gibba025:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/c1-1 2021-02-13T17:51:43.703 DEBUG:teuthology.orchestra.run.gibba025:> sudo /sbin/restorecon /var/lib/ceph/osd/c1-1 2021-02-13T17:51:43.754 INFO:teuthology.orchestra.run.gibba025.stderr:sudo: /sbin/restorecon: command not found 2021-02-13T17:51:43.754 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-13T17:51:43.754 DEBUG:teuthology.orchestra.run.gibba025:> sudo mkdir -p /var/lib/ceph/osd/c1-2 2021-02-13T17:51:43.805 INFO:tasks.ceph:roles_to_devs: {'c1.osd.0': '/dev/vg_nvme/lv_1', 'c1.osd.1': '/dev/vg_nvme/lv_2', 'c1.osd.2': '/dev/vg_nvme/lv_3'} 2021-02-13T17:51:43.805 INFO:tasks.ceph:role: c1.osd.2 2021-02-13T17:51:43.806 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@gibba025.front.sepia.ceph.com 2021-02-13T17:51:43.806 DEBUG:teuthology.orchestra.run.gibba025:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2021-02-13T17:51:43.888 INFO:teuthology.orchestra.run.gibba025.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5505024 blks 2021-02-13T17:51:43.889 INFO:teuthology.orchestra.run.gibba025.stdout: = sectsz=512 attr=2, projid32bit=1 2021-02-13T17:51:43.889 INFO:teuthology.orchestra.run.gibba025.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2021-02-13T17:51:43.889 INFO:teuthology.orchestra.run.gibba025.stdout:data = bsize=4096 blocks=22020096, imaxpct=25 2021-02-13T17:51:43.889 INFO:teuthology.orchestra.run.gibba025.stdout: = sunit=0 swidth=0 blks 2021-02-13T17:51:43.889 INFO:teuthology.orchestra.run.gibba025.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2021-02-13T17:51:43.889 INFO:teuthology.orchestra.run.gibba025.stdout:log =internal log bsize=4096 blocks=10752, version=2 2021-02-13T17:51:43.889 INFO:teuthology.orchestra.run.gibba025.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-02-13T17:51:43.889 INFO:teuthology.orchestra.run.gibba025.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-02-13T17:51:43.890 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@gibba025.front.sepia.ceph.com -o noatime 2021-02-13T17:51:43.890 DEBUG:teuthology.orchestra.run.gibba025:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/c1-2 2021-02-13T17:51:43.961 DEBUG:teuthology.orchestra.run.gibba025:> sudo /sbin/restorecon /var/lib/ceph/osd/c1-2 2021-02-13T17:51:44.014 INFO:teuthology.orchestra.run.gibba025.stderr:sudo: /sbin/restorecon: command not found 2021-02-13T17:51:44.014 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-13T17:51:44.014 DEBUG:teuthology.orchestra.run.gibba025:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster c1 --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/c1.monmap 2021-02-13T17:51:44.130 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:51:44.126 7f638104cc00 -1 auth: error reading file: /var/lib/ceph/osd/c1-0/keyring: can't open /var/lib/ceph/osd/c1-0/keyring: (2) No such file or directory 2021-02-13T17:51:44.130 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:51:44.126 7f638104cc00 -1 created new key in keyring /var/lib/ceph/osd/c1-0/keyring 2021-02-13T17:51:44.130 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:51:44.126 7f638104cc00 -1 bluestore(/var/lib/ceph/osd/c1-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-0/block: (2) No such file or directory 2021-02-13T17:51:44.130 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:51:44.126 7f638104cc00 -1 bluestore(/var/lib/ceph/osd/c1-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-0/block: (2) No such file or directory 2021-02-13T17:51:44.130 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:51:44.126 7f638104cc00 -1 bluestore(/var/lib/ceph/osd/c1-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-0/block: (2) No such file or directory 2021-02-13T17:51:44.131 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:51:44.126 7f638104cc00 -1 bluestore(/var/lib/ceph/osd/c1-0) _read_fsid unparsable uuid 2021-02-13T17:51:46.294 DEBUG:teuthology.orchestra.run.gibba025:> sudo chown -R ceph:ceph /var/lib/ceph/osd/c1-0 2021-02-13T17:51:46.301 DEBUG:teuthology.orchestra.run.gibba025:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster c1 --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/c1.monmap 2021-02-13T17:51:46.360 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:51:46.354 7febc54b2c00 -1 auth: error reading file: /var/lib/ceph/osd/c1-1/keyring: can't open /var/lib/ceph/osd/c1-1/keyring: (2) No such file or directory 2021-02-13T17:51:46.360 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:51:46.354 7febc54b2c00 -1 created new key in keyring /var/lib/ceph/osd/c1-1/keyring 2021-02-13T17:51:46.360 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:51:46.354 7febc54b2c00 -1 bluestore(/var/lib/ceph/osd/c1-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-1/block: (2) No such file or directory 2021-02-13T17:51:46.360 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:51:46.354 7febc54b2c00 -1 bluestore(/var/lib/ceph/osd/c1-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-1/block: (2) No such file or directory 2021-02-13T17:51:46.360 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:51:46.354 7febc54b2c00 -1 bluestore(/var/lib/ceph/osd/c1-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-1/block: (2) No such file or directory 2021-02-13T17:51:46.360 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:51:46.354 7febc54b2c00 -1 bluestore(/var/lib/ceph/osd/c1-1) _read_fsid unparsable uuid 2021-02-13T17:51:48.550 DEBUG:teuthology.orchestra.run.gibba025:> sudo chown -R ceph:ceph /var/lib/ceph/osd/c1-1 2021-02-13T17:51:48.604 DEBUG:teuthology.orchestra.run.gibba025:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster c1 --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/c1.monmap 2021-02-13T17:51:48.665 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:51:48.658 7fe436b2ec00 -1 auth: error reading file: /var/lib/ceph/osd/c1-2/keyring: can't open /var/lib/ceph/osd/c1-2/keyring: (2) No such file or directory 2021-02-13T17:51:48.665 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:51:48.658 7fe436b2ec00 -1 created new key in keyring /var/lib/ceph/osd/c1-2/keyring 2021-02-13T17:51:48.665 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:51:48.658 7fe436b2ec00 -1 bluestore(/var/lib/ceph/osd/c1-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-2/block: (2) No such file or directory 2021-02-13T17:51:48.665 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:51:48.658 7fe436b2ec00 -1 bluestore(/var/lib/ceph/osd/c1-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-2/block: (2) No such file or directory 2021-02-13T17:51:48.665 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:51:48.658 7fe436b2ec00 -1 bluestore(/var/lib/ceph/osd/c1-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-2/block: (2) No such file or directory 2021-02-13T17:51:48.665 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:51:48.662 7fe436b2ec00 -1 bluestore(/var/lib/ceph/osd/c1-2) _read_fsid unparsable uuid 2021-02-13T17:51:50.859 DEBUG:teuthology.orchestra.run.gibba025:> sudo chown -R ceph:ceph /var/lib/ceph/osd/c1-2 2021-02-13T17:51:50.912 INFO:tasks.ceph:Reading keys from all nodes... 2021-02-13T17:51:50.912 DEBUG:teuthology.orchestra.run.gibba025:> mktemp 2021-02-13T17:51:50.957 INFO:teuthology.orchestra.run.gibba025.stdout:/tmp/tmp.vi03hjY5FA 2021-02-13T17:51:50.957 DEBUG:teuthology.orchestra.run.gibba025:> sudo cp /var/lib/ceph/mgr/c1-x/keyring /tmp/tmp.vi03hjY5FA 2021-02-13T17:51:51.007 DEBUG:teuthology.orchestra.run.gibba025:> sudo chmod 0666 /tmp/tmp.vi03hjY5FA 2021-02-13T17:51:51.108 DEBUG:teuthology.orchestra.remote:gibba025:/tmp/tmp.vi03hjY5FA is 56B 2021-02-13T17:51:51.122 DEBUG:teuthology.orchestra.run.gibba025:> rm -fr /tmp/tmp.vi03hjY5FA 2021-02-13T17:51:51.125 DEBUG:teuthology.orchestra.run.gibba025:> mktemp 2021-02-13T17:51:51.169 INFO:teuthology.orchestra.run.gibba025.stdout:/tmp/tmp.Z7Li08WOfW 2021-02-13T17:51:51.169 DEBUG:teuthology.orchestra.run.gibba025:> sudo cp /var/lib/ceph/osd/c1-0/keyring /tmp/tmp.Z7Li08WOfW 2021-02-13T17:51:51.229 DEBUG:teuthology.orchestra.run.gibba025:> sudo chmod 0666 /tmp/tmp.Z7Li08WOfW 2021-02-13T17:51:51.340 DEBUG:teuthology.orchestra.remote:gibba025:/tmp/tmp.Z7Li08WOfW is 56B 2021-02-13T17:51:51.353 DEBUG:teuthology.orchestra.run.gibba025:> rm -fr /tmp/tmp.Z7Li08WOfW 2021-02-13T17:51:51.361 DEBUG:teuthology.orchestra.run.gibba025:> mktemp 2021-02-13T17:51:51.405 INFO:teuthology.orchestra.run.gibba025.stdout:/tmp/tmp.w3boXnp3Aj 2021-02-13T17:51:51.406 DEBUG:teuthology.orchestra.run.gibba025:> sudo cp /var/lib/ceph/osd/c1-1/keyring /tmp/tmp.w3boXnp3Aj 2021-02-13T17:51:51.460 DEBUG:teuthology.orchestra.run.gibba025:> sudo chmod 0666 /tmp/tmp.w3boXnp3Aj 2021-02-13T17:51:51.560 DEBUG:teuthology.orchestra.remote:gibba025:/tmp/tmp.w3boXnp3Aj is 56B 2021-02-13T17:51:51.574 DEBUG:teuthology.orchestra.run.gibba025:> rm -fr /tmp/tmp.w3boXnp3Aj 2021-02-13T17:51:51.582 DEBUG:teuthology.orchestra.run.gibba025:> mktemp 2021-02-13T17:51:51.633 INFO:teuthology.orchestra.run.gibba025.stdout:/tmp/tmp.4TnusLA9j4 2021-02-13T17:51:51.633 DEBUG:teuthology.orchestra.run.gibba025:> sudo cp /var/lib/ceph/osd/c1-2/keyring /tmp/tmp.4TnusLA9j4 2021-02-13T17:51:51.684 DEBUG:teuthology.orchestra.run.gibba025:> sudo chmod 0666 /tmp/tmp.4TnusLA9j4 2021-02-13T17:51:51.784 DEBUG:teuthology.orchestra.remote:gibba025:/tmp/tmp.4TnusLA9j4 is 56B 2021-02-13T17:51:51.797 DEBUG:teuthology.orchestra.run.gibba025:> rm -fr /tmp/tmp.4TnusLA9j4 2021-02-13T17:51:51.855 DEBUG:teuthology.orchestra.remote:gibba025:/etc/ceph/c1.client.0.keyring is 59B 2021-02-13T17:51:51.957 DEBUG:teuthology.orchestra.remote:gibba025:/etc/ceph/c1.client.1.keyring is 59B 2021-02-13T17:51:51.971 INFO:tasks.ceph:Adding keys to all mons... 2021-02-13T17:51:51.971 DEBUG:teuthology.orchestra.run.gibba025:> sudo tee -a /etc/ceph/c1.keyring 2021-02-13T17:51:52.022 INFO:teuthology.orchestra.run.gibba025.stdout:[mgr.x] 2021-02-13T17:51:52.022 INFO:teuthology.orchestra.run.gibba025.stdout: key = AQCvEShgB5qVBBAAjKhco0LzB0pDZdVw9d3K0g== 2021-02-13T17:51:52.022 INFO:teuthology.orchestra.run.gibba025.stdout:[osd.0] 2021-02-13T17:51:52.022 INFO:teuthology.orchestra.run.gibba025.stdout: key = AQCwEShgoFOYBxAA/gU3K8ntVwAD2gjoDIOyJQ== 2021-02-13T17:51:52.022 INFO:teuthology.orchestra.run.gibba025.stdout:[osd.1] 2021-02-13T17:51:52.023 INFO:teuthology.orchestra.run.gibba025.stdout: key = AQCyEShgWYhLFRAAv80uCYrHNlUnITbztPiR3A== 2021-02-13T17:51:52.023 INFO:teuthology.orchestra.run.gibba025.stdout:[osd.2] 2021-02-13T17:51:52.023 INFO:teuthology.orchestra.run.gibba025.stdout: key = AQC0EShgevF4JxAAiaWoenYV2VuKptWU8/R3KA== 2021-02-13T17:51:52.023 INFO:teuthology.orchestra.run.gibba025.stdout:[client.0] 2021-02-13T17:51:52.023 INFO:teuthology.orchestra.run.gibba025.stdout: key = AQCvEShgThQkCBAAVRb7qNlZc9cHE31muGxcNQ== 2021-02-13T17:51:52.023 INFO:teuthology.orchestra.run.gibba025.stdout:[client.1] 2021-02-13T17:51:52.023 INFO:teuthology.orchestra.run.gibba025.stdout: key = AQCvEShgN3ZiDBAAzB4RwUUeO8zhtqqe+3aS9Q== 2021-02-13T17:51:52.024 DEBUG:teuthology.orchestra.run.gibba025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c1.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2021-02-13T17:51:52.089 DEBUG:teuthology.orchestra.run.gibba025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c1.keyring --name=osd.0 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-02-13T17:51:52.173 DEBUG:teuthology.orchestra.run.gibba025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c1.keyring --name=osd.1 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-02-13T17:51:52.285 DEBUG:teuthology.orchestra.run.gibba025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c1.keyring --name=osd.2 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-02-13T17:51:52.309 DEBUG:teuthology.orchestra.run.gibba025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c1.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-02-13T17:51:52.381 DEBUG:teuthology.orchestra.run.gibba025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c1.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-02-13T17:51:52.447 INFO:tasks.ceph:Running mkfs on mon nodes... 2021-02-13T17:51:52.447 DEBUG:teuthology.orchestra.run.gibba025:> sudo mkdir -p /var/lib/ceph/mon/c1-a 2021-02-13T17:51:52.498 DEBUG:teuthology.orchestra.run.gibba025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster c1 --mkfs -i a --monmap /home/ubuntu/cephtest/c1.monmap --keyring /etc/ceph/c1.keyring 2021-02-13T17:51:52.617 DEBUG:teuthology.orchestra.run.gibba025:> sudo chown -R ceph:ceph /var/lib/ceph/mon/c1-a 2021-02-13T17:51:52.626 DEBUG:teuthology.orchestra.run.gibba025:> rm -- /home/ubuntu/cephtest/c1.monmap 2021-02-13T17:51:52.677 INFO:tasks.ceph:Starting mon daemons in cluster c1... 2021-02-13T17:51:52.677 INFO:tasks.ceph.c1.mon.a:Restarting daemon 2021-02-13T17:51:52.677 DEBUG:teuthology.orchestra.run.gibba025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster c1 -i a 2021-02-13T17:51:52.720 INFO:tasks.ceph.c1.mon.a:Started 2021-02-13T17:51:52.720 INFO:tasks.ceph:Starting mgr daemons in cluster c1... 2021-02-13T17:51:52.720 INFO:tasks.ceph.c1.mgr.x:Restarting daemon 2021-02-13T17:51:52.721 DEBUG:teuthology.orchestra.run.gibba025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster c1 -i x 2021-02-13T17:51:52.723 INFO:tasks.ceph.c1.mgr.x:Started 2021-02-13T17:51:52.724 INFO:tasks.ceph:Setting crush tunables to default 2021-02-13T17:51:52.724 DEBUG:teuthology.orchestra.run.gibba025:> sudo ceph --cluster c1 osd crush tunables default 2021-02-13T17:51:52.870 INFO:teuthology.orchestra.run.gibba025.stderr:adjusted tunables profile to default 2021-02-13T17:51:52.885 INFO:tasks.ceph:Starting osd daemons in cluster c1... 2021-02-13T17:51:52.885 DEBUG:teuthology.orchestra.run.gibba025:> mktemp 2021-02-13T17:51:52.889 INFO:teuthology.orchestra.run.gibba025.stdout:/tmp/tmp.UwdA7Y1E8S 2021-02-13T17:51:52.889 DEBUG:teuthology.orchestra.run.gibba025:> sudo cp /var/lib/ceph/osd/c1-0/fsid /tmp/tmp.UwdA7Y1E8S 2021-02-13T17:51:52.942 DEBUG:teuthology.orchestra.run.gibba025:> sudo chmod 0666 /tmp/tmp.UwdA7Y1E8S 2021-02-13T17:51:53.047 DEBUG:teuthology.orchestra.remote:gibba025:/tmp/tmp.UwdA7Y1E8S is 37B 2021-02-13T17:51:53.058 DEBUG:teuthology.orchestra.run.gibba025:> rm -fr /tmp/tmp.UwdA7Y1E8S 2021-02-13T17:51:53.061 DEBUG:teuthology.orchestra.run.gibba025:> mktemp 2021-02-13T17:51:53.104 INFO:teuthology.orchestra.run.gibba025.stdout:/tmp/tmp.etZtTbBuSt 2021-02-13T17:51:53.104 DEBUG:teuthology.orchestra.run.gibba025:> sudo cp /var/lib/ceph/osd/c1-1/fsid /tmp/tmp.etZtTbBuSt 2021-02-13T17:51:53.155 DEBUG:teuthology.orchestra.run.gibba025:> sudo chmod 0666 /tmp/tmp.etZtTbBuSt 2021-02-13T17:51:53.264 DEBUG:teuthology.orchestra.remote:gibba025:/tmp/tmp.etZtTbBuSt is 37B 2021-02-13T17:51:53.313 DEBUG:teuthology.orchestra.run.gibba025:> rm -fr /tmp/tmp.etZtTbBuSt 2021-02-13T17:51:53.316 DEBUG:teuthology.orchestra.run.gibba025:> mktemp 2021-02-13T17:51:53.359 INFO:teuthology.orchestra.run.gibba025.stdout:/tmp/tmp.yXeNgS6G8W 2021-02-13T17:51:53.360 DEBUG:teuthology.orchestra.run.gibba025:> sudo cp /var/lib/ceph/osd/c1-2/fsid /tmp/tmp.yXeNgS6G8W 2021-02-13T17:51:53.406 DEBUG:teuthology.orchestra.run.gibba025:> sudo chmod 0666 /tmp/tmp.yXeNgS6G8W 2021-02-13T17:51:53.502 DEBUG:teuthology.orchestra.remote:gibba025:/tmp/tmp.yXeNgS6G8W is 37B 2021-02-13T17:51:53.550 DEBUG:teuthology.orchestra.run.gibba025:> rm -fr /tmp/tmp.yXeNgS6G8W 2021-02-13T17:51:53.553 DEBUG:teuthology.orchestra.run.gibba025:> sudo ceph --cluster c1 osd new 05649d51-bb49-4b5d-b6e6-56ccca9a8461 0 2021-02-13T17:51:53.718 INFO:teuthology.orchestra.run.gibba025.stdout:0 2021-02-13T17:51:53.727 DEBUG:teuthology.orchestra.run.gibba025:> sudo ceph --cluster c1 osd new 137be351-8eee-42cf-bb75-2b693f4157a6 1 2021-02-13T17:51:53.853 INFO:teuthology.orchestra.run.gibba025.stdout:1 2021-02-13T17:51:53.861 DEBUG:teuthology.orchestra.run.gibba025:> sudo ceph --cluster c1 osd new 81558964-ae9d-41d2-8b54-fabf971685c3 2 2021-02-13T17:51:53.986 INFO:teuthology.orchestra.run.gibba025.stdout:2 2021-02-13T17:51:53.995 INFO:tasks.ceph.c1.osd.0:Restarting daemon 2021-02-13T17:51:53.995 DEBUG:teuthology.orchestra.run.gibba025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster c1 -i 0 2021-02-13T17:51:53.996 INFO:tasks.ceph.c1.osd.0:Started 2021-02-13T17:51:53.996 INFO:tasks.ceph.c1.osd.1:Restarting daemon 2021-02-13T17:51:53.997 DEBUG:teuthology.orchestra.run.gibba025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster c1 -i 1 2021-02-13T17:51:53.998 INFO:tasks.ceph.c1.osd.1:Started 2021-02-13T17:51:53.998 INFO:tasks.ceph.c1.osd.2:Restarting daemon 2021-02-13T17:51:53.998 DEBUG:teuthology.orchestra.run.gibba025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster c1 -i 2 2021-02-13T17:51:54.000 INFO:tasks.ceph.c1.osd.2:Started 2021-02-13T17:51:54.000 INFO:tasks.ceph:Waiting for OSDs to come up 2021-02-13T17:51:54.302 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster c1 osd dump --format=json 2021-02-13T17:51:54.425 INFO:teuthology.misc.health.gibba025.stdout: 2021-02-13T17:51:54.425 INFO:teuthology.misc.health.gibba025.stdout:{"epoch":5,"fsid":"bed73c08-798c-4f38-a3f3-1bfc03039602","created":"2021-02-13 17:51:52.784152","modified":"2021-02-13 17:51:53.981057","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[],"osds":[{"osd":0,"uuid":"05649d51-bb49-4b5d-b6e6-56ccca9a8461","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":":/0","cluster_addr":":/0","heartbeat_back_addr":":/0","heartbeat_front_addr":":/0","state":["exists","new"]},{"osd":1,"uuid":"137be351-8eee-42cf-bb75-2b693f4157a6","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":":/0","cluster_addr":":/0","heartbeat_back_addr":":/0","heartbeat_front_addr":":/0","state":["exists","new"]},{"osd":2,"uuid":"81558964-ae9d-41d2-8b54-fabf971685c3","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":":/0","cluster_addr":":/0","heartbeat_back_addr":":/0","heartbeat_front_addr":":/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-13T17:51:54.433 DEBUG:teuthology.misc:0 of 3 OSDs are up 2021-02-13T17:51:54.586 INFO:tasks.ceph.c1.osd.2.gibba025.stderr:2021-02-13 17:51:54.582 7f373ed27c00 -1 Falling back to public interface 2021-02-13T17:51:54.590 INFO:tasks.ceph.c1.osd.0.gibba025.stderr:2021-02-13 17:51:54.586 7f5f5e599c00 -1 Falling back to public interface 2021-02-13T17:51:54.590 INFO:tasks.ceph.c1.osd.1.gibba025.stderr:2021-02-13 17:51:54.586 7fe0e300fc00 -1 Falling back to public interface 2021-02-13T17:51:55.190 INFO:tasks.ceph.c1.osd.2.gibba025.stderr:2021-02-13 17:51:55.186 7f373ed27c00 -1 osd.2 0 log_to_monitors {default=true} 2021-02-13T17:51:55.200 INFO:tasks.ceph.c1.osd.0.gibba025.stderr:2021-02-13 17:51:55.194 7f5f5e599c00 -1 osd.0 0 log_to_monitors {default=true} 2021-02-13T17:51:55.208 INFO:tasks.ceph.c1.osd.1.gibba025.stderr:2021-02-13 17:51:55.202 7fe0e300fc00 -1 osd.1 0 log_to_monitors {default=true} 2021-02-13T17:51:56.912 INFO:tasks.ceph.c1.osd.2.gibba025.stderr:2021-02-13 17:51:56.906 7f3725dc7700 -1 osd.2 0 waiting for initial osdmap 2021-02-13T17:51:56.913 INFO:tasks.ceph.c1.osd.1.gibba025.stderr:2021-02-13 17:51:56.906 7fe0ca0af700 -1 osd.1 0 waiting for initial osdmap 2021-02-13T17:51:56.913 INFO:tasks.ceph.c1.osd.0.gibba025.stderr:2021-02-13 17:51:56.906 7f5f45639700 -1 osd.0 0 waiting for initial osdmap 2021-02-13T17:51:56.915 INFO:tasks.ceph.c1.osd.1.gibba025.stderr:2021-02-13 17:51:56.910 7fe0d68c8700 -1 osd.1 7 set_numa_affinity unable to identify public interface 'enp1s0f0' numa node: (0) Success 2021-02-13T17:51:56.915 INFO:tasks.ceph.c1.osd.2.gibba025.stderr:2021-02-13 17:51:56.910 7f37325e0700 -1 osd.2 7 set_numa_affinity unable to identify public interface 'enp1s0f0' numa node: (0) Success 2021-02-13T17:51:56.915 INFO:tasks.ceph.c1.osd.0.gibba025.stderr:2021-02-13 17:51:56.910 7f5f51e52700 -1 osd.0 7 set_numa_affinity unable to identify public interface 'enp1s0f0' numa node: (0) Success 2021-02-13T17:52:00.737 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster c1 osd dump --format=json 2021-02-13T17:52:00.894 INFO:teuthology.misc.health.gibba025.stdout: 2021-02-13T17:52:00.895 INFO:teuthology.misc.health.gibba025.stdout:{"epoch":8,"fsid":"bed73c08-798c-4f38-a3f3-1bfc03039602","created":"2021-02-13 17:51:52.784152","modified":"2021-02-13 17:51:57.899067","last_up_change":"2021-02-13 17:51:57.899067","last_in_change":"2021-02-13 17:51:57.899067","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[],"osds":[{"osd":0,"uuid":"05649d51-bb49-4b5d-b6e6-56ccca9a8461","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.125:6809","nonce":14219},{"type":"v1","addr":"172.21.2.125:6811","nonce":14219}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.125:6813","nonce":14219},{"type":"v1","addr":"172.21.2.125:6815","nonce":14219}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.125:6822","nonce":14219},{"type":"v1","addr":"172.21.2.125:6823","nonce":14219}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.125:6817","nonce":14219},{"type":"v1","addr":"172.21.2.125:6819","nonce":14219}]},"public_addr":"172.21.2.125:6811/14219","cluster_addr":"172.21.2.125:6815/14219","heartbeat_back_addr":"172.21.2.125:6823/14219","heartbeat_front_addr":"172.21.2.125:6819/14219","state":["exists","up"]},{"osd":1,"uuid":"137be351-8eee-42cf-bb75-2b693f4157a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.125:6808","nonce":14220},{"type":"v1","addr":"172.21.2.125:6810","nonce":14220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.125:6812","nonce":14220},{"type":"v1","addr":"172.21.2.125:6814","nonce":14220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.125:6820","nonce":14220},{"type":"v1","addr":"172.21.2.125:6821","nonce":14220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.125:6816","nonce":14220},{"type":"v1","addr":"172.21.2.125:6818","nonce":14220}]},"public_addr":"172.21.2.125:6810/14220","cluster_addr":"172.21.2.125:6814/14220","heartbeat_back_addr":"172.21.2.125:6821/14220","heartbeat_front_addr":"172.21.2.125:6818/14220","state":["exists","up"]},{"osd":2,"uuid":"81558964-ae9d-41d2-8b54-fabf971685c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.125:6800","nonce":14221},{"type":"v1","addr":"172.21.2.125:6801","nonce":14221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.125:6802","nonce":14221},{"type":"v1","addr":"172.21.2.125:6803","nonce":14221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.125:6806","nonce":14221},{"type":"v1","addr":"172.21.2.125:6807","nonce":14221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.125:6804","nonce":14221},{"type":"v1","addr":"172.21.2.125:6805","nonce":14221}]},"public_addr":"172.21.2.125:6801/14221","cluster_addr":"172.21.2.125:6803/14221","heartbeat_back_addr":"172.21.2.125:6807/14221","heartbeat_front_addr":"172.21.2.125:6805/14221","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-13T17:52:00.908 DEBUG:teuthology.misc:3 of 3 OSDs are up 2021-02-13T17:52:00.909 INFO:tasks.ceph:Creating RBD pool 2021-02-13T17:52:00.909 DEBUG:teuthology.orchestra.run.gibba025:> sudo ceph --cluster c1 osd pool create rbd 8 2021-02-13T17:52:01.981 INFO:teuthology.orchestra.run.gibba025.stderr:pool 'rbd' created 2021-02-13T17:52:01.991 DEBUG:teuthology.orchestra.run.gibba025:> sudo ceph --cluster c1 osd pool application enable rbd rbd --yes-i-really-mean-it 2021-02-13T17:52:02.968 INFO:teuthology.orchestra.run.gibba025.stderr:enabled application 'rbd' on pool 'rbd' 2021-02-13T17:52:02.974 INFO:tasks.ceph:Starting mds daemons in cluster c1... 2021-02-13T17:52:02.975 DEBUG:teuthology.orchestra.run.gibba025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster c1 osd dump --format=json 2021-02-13T17:52:03.135 INFO:teuthology.orchestra.run.gibba025.stdout: 2021-02-13T17:52:03.135 INFO:teuthology.orchestra.run.gibba025.stdout:{"epoch":10,"fsid":"bed73c08-798c-4f38-a3f3-1bfc03039602","created":"2021-02-13 17:51:52.784152","modified":"2021-02-13 17:52:02.950547","last_up_change":"2021-02-13 17:51:57.899067","last_in_change":"2021-02-13 17:51:57.899067","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-02-13 17:52:01.057885","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"10","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"05649d51-bb49-4b5d-b6e6-56ccca9a8461","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.125:6809","nonce":14219},{"type":"v1","addr":"172.21.2.125:6811","nonce":14219}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.125:6813","nonce":14219},{"type":"v1","addr":"172.21.2.125:6815","nonce":14219}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.125:6822","nonce":14219},{"type":"v1","addr":"172.21.2.125:6823","nonce":14219}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.125:6817","nonce":14219},{"type":"v1","addr":"172.21.2.125:6819","nonce":14219}]},"public_addr":"172.21.2.125:6811/14219","cluster_addr":"172.21.2.125:6815/14219","heartbeat_back_addr":"172.21.2.125:6823/14219","heartbeat_front_addr":"172.21.2.125:6819/14219","state":["exists","up"]},{"osd":1,"uuid":"137be351-8eee-42cf-bb75-2b693f4157a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.125:6808","nonce":14220},{"type":"v1","addr":"172.21.2.125:6810","nonce":14220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.125:6812","nonce":14220},{"type":"v1","addr":"172.21.2.125:6814","nonce":14220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.125:6820","nonce":14220},{"type":"v1","addr":"172.21.2.125:6821","nonce":14220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.125:6816","nonce":14220},{"type":"v1","addr":"172.21.2.125:6818","nonce":14220}]},"public_addr":"172.21.2.125:6810/14220","cluster_addr":"172.21.2.125:6814/14220","heartbeat_back_addr":"172.21.2.125:6821/14220","heartbeat_front_addr":"172.21.2.125:6818/14220","state":["exists","up"]},{"osd":2,"uuid":"81558964-ae9d-41d2-8b54-fabf971685c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.125:6800","nonce":14221},{"type":"v1","addr":"172.21.2.125:6801","nonce":14221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.125:6802","nonce":14221},{"type":"v1","addr":"172.21.2.125:6803","nonce":14221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.125:6806","nonce":14221},{"type":"v1","addr":"172.21.2.125:6807","nonce":14221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.125:6804","nonce":14221},{"type":"v1","addr":"172.21.2.125:6805","nonce":14221}]},"public_addr":"172.21.2.125:6801/14221","cluster_addr":"172.21.2.125:6803/14221","heartbeat_back_addr":"172.21.2.125:6807/14221","heartbeat_front_addr":"172.21.2.125:6805/14221","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-13T17:52:03.143 INFO:tasks.ceph.ceph_manager.c1:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2021-02-13 17:52:01.057885', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '10', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-02-13T17:52:03.143 DEBUG:teuthology.orchestra.run.gibba025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster c1 osd pool get rbd pg_num 2021-02-13T17:52:03.293 INFO:teuthology.orchestra.run.gibba025.stdout:pg_num: 8 2021-02-13T17:52:03.308 INFO:tasks.ceph:Waiting until c1 daemons up and pgs clean... 2021-02-13T17:52:03.309 INFO:tasks.ceph.ceph_manager.c1:waiting for mgr available 2021-02-13T17:52:03.309 DEBUG:teuthology.orchestra.run.gibba025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster c1 mgr dump --format=json 2021-02-13T17:52:03.491 INFO:teuthology.orchestra.run.gibba025.stdout: 2021-02-13T17:52:03.505 INFO:teuthology.orchestra.run.gibba025.stdout:{"epoch":3,"active_gid":4098,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.125:6824","nonce":13998},{"type":"v1","addr":"172.21.2.125:6825","nonce":13998}]},"active_addr":"172.21.2.125:6825/13998","active_change":"2021-02-13 17:51:54.888096","available":true,"standbys":[],"modules":["iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"ansible","can_run":true,"error_string":"","module_options":{"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_url":{"name":"server_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_server":{"name":"verify_server","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_iterations":{"name":"upmap_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimization iterations","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"deepsea","can_run":true,"error_string":"","module_options":{"salt_api_eauth":{"name":"salt_api_eauth","type":"str","level":"advanced","flags":0,"default_value":"sharedsecret","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_password":{"name":"salt_api_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_url":{"name":"salt_api_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_username":{"name":"salt_api_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_cloud","can_run":true,"error_string":"","module_options":{"diskprediction_cert_context":{"name":"diskprediction_cert_context","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_default_authority":{"name":"diskprediction_default_authority","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_password":{"name":"diskprediction_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_port":{"name":"diskprediction_port","type":"str","level":"advanced","flags":0,"default_value":"31400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_retrieve_prediction_interval":{"name":"diskprediction_retrieve_prediction_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_server":{"name":"diskprediction_server","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_ssl_target_name_override":{"name":"diskprediction_ssl_target_name_override","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_metrics_interval":{"name":"diskprediction_upload_metrics_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_smart_interval":{"name":"diskprediction_upload_smart_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_user":{"name":"diskprediction_user","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{}},{"name":"iostat","can_run":true,"error_string":"","module_options":{}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator_cli","can_run":true,"error_string":"","module_options":{"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"ssh","can_run":true,"error_string":"","module_options":{"inventory_cache_timeout_min":{"name":"inventory_cache_timeout_min","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"]}} 2021-02-13T17:52:03.506 INFO:tasks.ceph.ceph_manager.c1:mgr available! 2021-02-13T17:52:03.809 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster c1 osd dump --format=json 2021-02-13T17:52:03.963 INFO:teuthology.misc.health.gibba025.stdout: 2021-02-13T17:52:03.963 INFO:teuthology.misc.health.gibba025.stdout:{"epoch":11,"fsid":"bed73c08-798c-4f38-a3f3-1bfc03039602","created":"2021-02-13 17:51:52.784152","modified":"2021-02-13 17:52:03.955578","last_up_change":"2021-02-13 17:51:57.899067","last_in_change":"2021-02-13 17:51:57.899067","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-02-13 17:52:01.057885","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"05649d51-bb49-4b5d-b6e6-56ccca9a8461","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.125:6809","nonce":14219},{"type":"v1","addr":"172.21.2.125:6811","nonce":14219}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.125:6813","nonce":14219},{"type":"v1","addr":"172.21.2.125:6815","nonce":14219}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.125:6822","nonce":14219},{"type":"v1","addr":"172.21.2.125:6823","nonce":14219}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.125:6817","nonce":14219},{"type":"v1","addr":"172.21.2.125:6819","nonce":14219}]},"public_addr":"172.21.2.125:6811/14219","cluster_addr":"172.21.2.125:6815/14219","heartbeat_back_addr":"172.21.2.125:6823/14219","heartbeat_front_addr":"172.21.2.125:6819/14219","state":["exists","up"]},{"osd":1,"uuid":"137be351-8eee-42cf-bb75-2b693f4157a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.125:6808","nonce":14220},{"type":"v1","addr":"172.21.2.125:6810","nonce":14220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.125:6812","nonce":14220},{"type":"v1","addr":"172.21.2.125:6814","nonce":14220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.125:6820","nonce":14220},{"type":"v1","addr":"172.21.2.125:6821","nonce":14220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.125:6816","nonce":14220},{"type":"v1","addr":"172.21.2.125:6818","nonce":14220}]},"public_addr":"172.21.2.125:6810/14220","cluster_addr":"172.21.2.125:6814/14220","heartbeat_back_addr":"172.21.2.125:6821/14220","heartbeat_front_addr":"172.21.2.125:6818/14220","state":["exists","up"]},{"osd":2,"uuid":"81558964-ae9d-41d2-8b54-fabf971685c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.125:6800","nonce":14221},{"type":"v1","addr":"172.21.2.125:6801","nonce":14221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.125:6802","nonce":14221},{"type":"v1","addr":"172.21.2.125:6803","nonce":14221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.125:6806","nonce":14221},{"type":"v1","addr":"172.21.2.125:6807","nonce":14221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.125:6804","nonce":14221},{"type":"v1","addr":"172.21.2.125:6805","nonce":14221}]},"public_addr":"172.21.2.125:6801/14221","cluster_addr":"172.21.2.125:6803/14221","heartbeat_back_addr":"172.21.2.125:6807/14221","heartbeat_front_addr":"172.21.2.125:6805/14221","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-13T17:52:03.971 DEBUG:teuthology.misc:3 of 3 OSDs are up 2021-02-13T17:52:03.971 DEBUG:teuthology.orchestra.run.gibba025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster c1 osd dump --format=json 2021-02-13T17:52:04.121 INFO:teuthology.orchestra.run.gibba025.stdout: 2021-02-13T17:52:04.122 INFO:teuthology.orchestra.run.gibba025.stdout:{"epoch":11,"fsid":"bed73c08-798c-4f38-a3f3-1bfc03039602","created":"2021-02-13 17:51:52.784152","modified":"2021-02-13 17:52:03.955578","last_up_change":"2021-02-13 17:51:57.899067","last_in_change":"2021-02-13 17:51:57.899067","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-02-13 17:52:01.057885","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"05649d51-bb49-4b5d-b6e6-56ccca9a8461","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.125:6809","nonce":14219},{"type":"v1","addr":"172.21.2.125:6811","nonce":14219}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.125:6813","nonce":14219},{"type":"v1","addr":"172.21.2.125:6815","nonce":14219}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.125:6822","nonce":14219},{"type":"v1","addr":"172.21.2.125:6823","nonce":14219}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.125:6817","nonce":14219},{"type":"v1","addr":"172.21.2.125:6819","nonce":14219}]},"public_addr":"172.21.2.125:6811/14219","cluster_addr":"172.21.2.125:6815/14219","heartbeat_back_addr":"172.21.2.125:6823/14219","heartbeat_front_addr":"172.21.2.125:6819/14219","state":["exists","up"]},{"osd":1,"uuid":"137be351-8eee-42cf-bb75-2b693f4157a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.125:6808","nonce":14220},{"type":"v1","addr":"172.21.2.125:6810","nonce":14220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.125:6812","nonce":14220},{"type":"v1","addr":"172.21.2.125:6814","nonce":14220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.125:6820","nonce":14220},{"type":"v1","addr":"172.21.2.125:6821","nonce":14220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.125:6816","nonce":14220},{"type":"v1","addr":"172.21.2.125:6818","nonce":14220}]},"public_addr":"172.21.2.125:6810/14220","cluster_addr":"172.21.2.125:6814/14220","heartbeat_back_addr":"172.21.2.125:6821/14220","heartbeat_front_addr":"172.21.2.125:6818/14220","state":["exists","up"]},{"osd":2,"uuid":"81558964-ae9d-41d2-8b54-fabf971685c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.125:6800","nonce":14221},{"type":"v1","addr":"172.21.2.125:6801","nonce":14221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.125:6802","nonce":14221},{"type":"v1","addr":"172.21.2.125:6803","nonce":14221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.125:6806","nonce":14221},{"type":"v1","addr":"172.21.2.125:6807","nonce":14221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.125:6804","nonce":14221},{"type":"v1","addr":"172.21.2.125:6805","nonce":14221}]},"public_addr":"172.21.2.125:6801/14221","cluster_addr":"172.21.2.125:6803/14221","heartbeat_back_addr":"172.21.2.125:6807/14221","heartbeat_front_addr":"172.21.2.125:6805/14221","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-13T17:52:04.130 DEBUG:teuthology.orchestra.run.gibba025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster c1 tell osd.0 flush_pg_stats 2021-02-13T17:52:04.188 INFO:teuthology.orchestra.run.gibba025.stdout:34359738372 2021-02-13T17:52:04.195 DEBUG:teuthology.orchestra.run.gibba025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster c1 tell osd.1 flush_pg_stats 2021-02-13T17:52:04.250 INFO:teuthology.orchestra.run.gibba025.stdout:34359738372 2021-02-13T17:52:04.258 DEBUG:teuthology.orchestra.run.gibba025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster c1 tell osd.2 flush_pg_stats 2021-02-13T17:52:04.315 INFO:teuthology.orchestra.run.gibba025.stdout:34359738372 2021-02-13T17:52:04.323 DEBUG:teuthology.orchestra.run.gibba025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster c1 osd last-stat-seq osd.0 2021-02-13T17:52:04.485 INFO:teuthology.orchestra.run.gibba025.stdout:34359738370 2021-02-13T17:52:04.494 INFO:tasks.ceph.ceph_manager.c1:need seq 34359738372 got 34359738370 for osd.0 2021-02-13T17:52:05.495 DEBUG:teuthology.orchestra.run.gibba025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster c1 osd last-stat-seq osd.0 2021-02-13T17:52:05.661 INFO:teuthology.orchestra.run.gibba025.stdout:34359738372 2021-02-13T17:52:05.670 INFO:tasks.ceph.ceph_manager.c1:need seq 34359738372 got 34359738372 for osd.0 2021-02-13T17:52:05.670 DEBUG:teuthology.orchestra.run.gibba025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster c1 osd last-stat-seq osd.1 2021-02-13T17:52:05.832 INFO:teuthology.orchestra.run.gibba025.stdout:34359738372 2021-02-13T17:52:05.840 INFO:tasks.ceph.ceph_manager.c1:need seq 34359738372 got 34359738372 for osd.1 2021-02-13T17:52:05.841 DEBUG:teuthology.orchestra.run.gibba025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster c1 osd last-stat-seq osd.2 2021-02-13T17:52:06.002 INFO:teuthology.orchestra.run.gibba025.stdout:34359738372 2021-02-13T17:52:06.011 INFO:tasks.ceph.ceph_manager.c1:need seq 34359738372 got 34359738372 for osd.2 2021-02-13T17:52:06.011 INFO:tasks.ceph.ceph_manager.c1:waiting for clean 2021-02-13T17:52:06.011 DEBUG:teuthology.orchestra.run.gibba025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster c1 pg dump --format=json 2021-02-13T17:52:06.167 INFO:teuthology.orchestra.run.gibba025.stdout: 2021-02-13T17:52:06.167 INFO:teuthology.orchestra.run.gibba025.stderr:dumped all 2021-02-13T17:52:06.174 INFO:teuthology.orchestra.run.gibba025.stdout:{"pg_ready":true,"pg_map":{"version":13,"stamp":"2021-02-13 17:52:04.892913","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":3,"num_per_pool_osds":3,"kb":314572800,"kb_used":3146024,"kb_used_data":272,"kb_used_omap":0,"kb_used_meta":3145728,"kb_avail":311426776,"statfs":{"total":322122547200,"available":318901018624,"internally_reserved":3221225472,"allocated":278528,"data_stored":65370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":3221225472},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"9","reported_epoch":"10","state":"active+clean","last_fresh":"2021-02-13 17:52:02.964724","last_change":"2021-02-13 17:52:02.964248","last_active":"2021-02-13 17:52:02.964724","last_peered":"2021-02-13 17:52:02.964724","last_clean":"2021-02-13 17:52:02.964724","last_became_active":"2021-02-13 17:52:02.964037","last_became_peered":"2021-02-13 17:52:02.964037","last_unstale":"2021-02-13 17:52:02.964724","last_undegraded":"2021-02-13 17:52:02.964724","last_fullsized":"2021-02-13 17:52:02.964724","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-13 17:52:01.944199","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-13 17:52:01.944199","last_clean_scrub_stamp":"2021-02-13 17:52:01.944199","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"9","reported_epoch":"10","state":"active+clean","last_fresh":"2021-02-13 17:52:02.965109","last_change":"2021-02-13 17:52:02.964807","last_active":"2021-02-13 17:52:02.965109","last_peered":"2021-02-13 17:52:02.965109","last_clean":"2021-02-13 17:52:02.965109","last_became_active":"2021-02-13 17:52:02.964616","last_became_peered":"2021-02-13 17:52:02.964616","last_unstale":"2021-02-13 17:52:02.965109","last_undegraded":"2021-02-13 17:52:02.965109","last_fullsized":"2021-02-13 17:52:02.965109","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-13 17:52:01.944199","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-13 17:52:01.944199","last_clean_scrub_stamp":"2021-02-13 17:52:01.944199","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"10","state":"active+clean","last_fresh":"2021-02-13 17:52:02.964554","last_change":"2021-02-13 17:52:02.964554","last_active":"2021-02-13 17:52:02.964554","last_peered":"2021-02-13 17:52:02.964554","last_clean":"2021-02-13 17:52:02.964554","last_became_active":"2021-02-13 17:52:02.964283","last_became_peered":"2021-02-13 17:52:02.964283","last_unstale":"2021-02-13 17:52:02.964554","last_undegraded":"2021-02-13 17:52:02.964554","last_fullsized":"2021-02-13 17:52:02.964554","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-13 17:52:01.944199","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-13 17:52:01.944199","last_clean_scrub_stamp":"2021-02-13 17:52:01.944199","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"9","reported_epoch":"10","state":"active+clean","last_fresh":"2021-02-13 17:52:02.964899","last_change":"2021-02-13 17:52:02.964594","last_active":"2021-02-13 17:52:02.964899","last_peered":"2021-02-13 17:52:02.964899","last_clean":"2021-02-13 17:52:02.964899","last_became_active":"2021-02-13 17:52:02.964420","last_became_peered":"2021-02-13 17:52:02.964420","last_unstale":"2021-02-13 17:52:02.964899","last_undegraded":"2021-02-13 17:52:02.964899","last_fullsized":"2021-02-13 17:52:02.964899","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-13 17:52:01.944199","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-13 17:52:01.944199","last_clean_scrub_stamp":"2021-02-13 17:52:01.944199","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"10","state":"active+clean","last_fresh":"2021-02-13 17:52:02.963821","last_change":"2021-02-13 17:52:02.963821","last_active":"2021-02-13 17:52:02.963821","last_peered":"2021-02-13 17:52:02.963821","last_clean":"2021-02-13 17:52:02.963821","last_became_active":"2021-02-13 17:52:02.963658","last_became_peered":"2021-02-13 17:52:02.963658","last_unstale":"2021-02-13 17:52:02.963821","last_undegraded":"2021-02-13 17:52:02.963821","last_fullsized":"2021-02-13 17:52:02.963821","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-13 17:52:01.944199","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-13 17:52:01.944199","last_clean_scrub_stamp":"2021-02-13 17:52:01.944199","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"9","reported_epoch":"10","state":"active+clean","last_fresh":"2021-02-13 17:52:02.964717","last_change":"2021-02-13 17:52:02.964201","last_active":"2021-02-13 17:52:02.964717","last_peered":"2021-02-13 17:52:02.964717","last_clean":"2021-02-13 17:52:02.964717","last_became_active":"2021-02-13 17:52:02.963996","last_became_peered":"2021-02-13 17:52:02.963996","last_unstale":"2021-02-13 17:52:02.964717","last_undegraded":"2021-02-13 17:52:02.964717","last_fullsized":"2021-02-13 17:52:02.964717","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-13 17:52:01.944199","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-13 17:52:01.944199","last_clean_scrub_stamp":"2021-02-13 17:52:01.944199","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"9","reported_epoch":"10","state":"active+clean","last_fresh":"2021-02-13 17:52:02.964492","last_change":"2021-02-13 17:52:02.964065","last_active":"2021-02-13 17:52:02.964492","last_peered":"2021-02-13 17:52:02.964492","last_clean":"2021-02-13 17:52:02.964492","last_became_active":"2021-02-13 17:52:02.963812","last_became_peered":"2021-02-13 17:52:02.963812","last_unstale":"2021-02-13 17:52:02.964492","last_undegraded":"2021-02-13 17:52:02.964492","last_fullsized":"2021-02-13 17:52:02.964492","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-13 17:52:01.944199","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-13 17:52:01.944199","last_clean_scrub_stamp":"2021-02-13 17:52:01.944199","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"10","state":"active+clean","last_fresh":"2021-02-13 17:52:02.964652","last_change":"2021-02-13 17:52:02.964652","last_active":"2021-02-13 17:52:02.964652","last_peered":"2021-02-13 17:52:02.964652","last_clean":"2021-02-13 17:52:02.964652","last_became_active":"2021-02-13 17:52:02.964502","last_became_peered":"2021-02-13 17:52:02.964502","last_unstale":"2021-02-13 17:52:02.964652","last_undegraded":"2021-02-13 17:52:02.964652","last_fullsized":"2021-02-13 17:52:02.964652","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-13 17:52:01.944199","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-13 17:52:01.944199","last_clean_scrub_stamp":"2021-02-13 17:52:01.944199","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738372,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"kb":104857600,"kb_used":1048672,"kb_used_data":88,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":103808928,"statfs":{"total":107374182400,"available":106300342272,"internally_reserved":1073741824,"allocated":90112,"data_stored":20765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5489999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1659999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738372,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"kb":104857600,"kb_used":1048672,"kb_used_data":88,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":103808928,"statfs":{"total":107374182400,"available":106300342272,"internally_reserved":1073741824,"allocated":90112,"data_stored":20765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.363}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.653}]}]},{"osd":1,"up_from":8,"seq":34359738372,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"kb":104857600,"kb_used":1048680,"kb_used_data":96,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":103808920,"statfs":{"total":107374182400,"available":106300334080,"internally_reserved":1073741824,"allocated":98304,"data_stored":23840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.391}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7509999999999999}]}]}]}} 2021-02-13T17:52:06.175 DEBUG:teuthology.orchestra.run.gibba025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster c1 pg dump --format=json 2021-02-13T17:52:06.333 INFO:teuthology.orchestra.run.gibba025.stdout: 2021-02-13T17:52:06.333 INFO:teuthology.orchestra.run.gibba025.stderr:dumped all 2021-02-13T17:52:06.341 INFO:teuthology.orchestra.run.gibba025.stdout:{"pg_ready":true,"pg_map":{"version":13,"stamp":"2021-02-13 17:52:04.892913","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":0,"num_osds":3,"num_per_pool_osds":3,"kb":314572800,"kb_used":3146024,"kb_used_data":272,"kb_used_omap":0,"kb_used_meta":3145728,"kb_avail":311426776,"statfs":{"total":322122547200,"available":318901018624,"internally_reserved":3221225472,"allocated":278528,"data_stored":65370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":3221225472},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"9","reported_epoch":"10","state":"active+clean","last_fresh":"2021-02-13 17:52:02.964724","last_change":"2021-02-13 17:52:02.964248","last_active":"2021-02-13 17:52:02.964724","last_peered":"2021-02-13 17:52:02.964724","last_clean":"2021-02-13 17:52:02.964724","last_became_active":"2021-02-13 17:52:02.964037","last_became_peered":"2021-02-13 17:52:02.964037","last_unstale":"2021-02-13 17:52:02.964724","last_undegraded":"2021-02-13 17:52:02.964724","last_fullsized":"2021-02-13 17:52:02.964724","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-13 17:52:01.944199","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-13 17:52:01.944199","last_clean_scrub_stamp":"2021-02-13 17:52:01.944199","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"9","reported_epoch":"10","state":"active+clean","last_fresh":"2021-02-13 17:52:02.965109","last_change":"2021-02-13 17:52:02.964807","last_active":"2021-02-13 17:52:02.965109","last_peered":"2021-02-13 17:52:02.965109","last_clean":"2021-02-13 17:52:02.965109","last_became_active":"2021-02-13 17:52:02.964616","last_became_peered":"2021-02-13 17:52:02.964616","last_unstale":"2021-02-13 17:52:02.965109","last_undegraded":"2021-02-13 17:52:02.965109","last_fullsized":"2021-02-13 17:52:02.965109","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-13 17:52:01.944199","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-13 17:52:01.944199","last_clean_scrub_stamp":"2021-02-13 17:52:01.944199","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"10","state":"active+clean","last_fresh":"2021-02-13 17:52:02.964554","last_change":"2021-02-13 17:52:02.964554","last_active":"2021-02-13 17:52:02.964554","last_peered":"2021-02-13 17:52:02.964554","last_clean":"2021-02-13 17:52:02.964554","last_became_active":"2021-02-13 17:52:02.964283","last_became_peered":"2021-02-13 17:52:02.964283","last_unstale":"2021-02-13 17:52:02.964554","last_undegraded":"2021-02-13 17:52:02.964554","last_fullsized":"2021-02-13 17:52:02.964554","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-13 17:52:01.944199","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-13 17:52:01.944199","last_clean_scrub_stamp":"2021-02-13 17:52:01.944199","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"9","reported_epoch":"10","state":"active+clean","last_fresh":"2021-02-13 17:52:02.964899","last_change":"2021-02-13 17:52:02.964594","last_active":"2021-02-13 17:52:02.964899","last_peered":"2021-02-13 17:52:02.964899","last_clean":"2021-02-13 17:52:02.964899","last_became_active":"2021-02-13 17:52:02.964420","last_became_peered":"2021-02-13 17:52:02.964420","last_unstale":"2021-02-13 17:52:02.964899","last_undegraded":"2021-02-13 17:52:02.964899","last_fullsized":"2021-02-13 17:52:02.964899","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-13 17:52:01.944199","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-13 17:52:01.944199","last_clean_scrub_stamp":"2021-02-13 17:52:01.944199","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"10","state":"active+clean","last_fresh":"2021-02-13 17:52:02.963821","last_change":"2021-02-13 17:52:02.963821","last_active":"2021-02-13 17:52:02.963821","last_peered":"2021-02-13 17:52:02.963821","last_clean":"2021-02-13 17:52:02.963821","last_became_active":"2021-02-13 17:52:02.963658","last_became_peered":"2021-02-13 17:52:02.963658","last_unstale":"2021-02-13 17:52:02.963821","last_undegraded":"2021-02-13 17:52:02.963821","last_fullsized":"2021-02-13 17:52:02.963821","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-13 17:52:01.944199","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-13 17:52:01.944199","last_clean_scrub_stamp":"2021-02-13 17:52:01.944199","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"9","reported_epoch":"10","state":"active+clean","last_fresh":"2021-02-13 17:52:02.964717","last_change":"2021-02-13 17:52:02.964201","last_active":"2021-02-13 17:52:02.964717","last_peered":"2021-02-13 17:52:02.964717","last_clean":"2021-02-13 17:52:02.964717","last_became_active":"2021-02-13 17:52:02.963996","last_became_peered":"2021-02-13 17:52:02.963996","last_unstale":"2021-02-13 17:52:02.964717","last_undegraded":"2021-02-13 17:52:02.964717","last_fullsized":"2021-02-13 17:52:02.964717","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-13 17:52:01.944199","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-13 17:52:01.944199","last_clean_scrub_stamp":"2021-02-13 17:52:01.944199","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"9","reported_epoch":"10","state":"active+clean","last_fresh":"2021-02-13 17:52:02.964492","last_change":"2021-02-13 17:52:02.964065","last_active":"2021-02-13 17:52:02.964492","last_peered":"2021-02-13 17:52:02.964492","last_clean":"2021-02-13 17:52:02.964492","last_became_active":"2021-02-13 17:52:02.963812","last_became_peered":"2021-02-13 17:52:02.963812","last_unstale":"2021-02-13 17:52:02.964492","last_undegraded":"2021-02-13 17:52:02.964492","last_fullsized":"2021-02-13 17:52:02.964492","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-13 17:52:01.944199","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-13 17:52:01.944199","last_clean_scrub_stamp":"2021-02-13 17:52:01.944199","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"10","state":"active+clean","last_fresh":"2021-02-13 17:52:02.964652","last_change":"2021-02-13 17:52:02.964652","last_active":"2021-02-13 17:52:02.964652","last_peered":"2021-02-13 17:52:02.964652","last_clean":"2021-02-13 17:52:02.964652","last_became_active":"2021-02-13 17:52:02.964502","last_became_peered":"2021-02-13 17:52:02.964502","last_unstale":"2021-02-13 17:52:02.964652","last_undegraded":"2021-02-13 17:52:02.964652","last_fullsized":"2021-02-13 17:52:02.964652","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-13 17:52:01.944199","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-13 17:52:01.944199","last_clean_scrub_stamp":"2021-02-13 17:52:01.944199","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738372,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"kb":104857600,"kb_used":1048672,"kb_used_data":88,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":103808928,"statfs":{"total":107374182400,"available":106300342272,"internally_reserved":1073741824,"allocated":90112,"data_stored":20765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5489999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1659999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738372,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"kb":104857600,"kb_used":1048672,"kb_used_data":88,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":103808928,"statfs":{"total":107374182400,"available":106300342272,"internally_reserved":1073741824,"allocated":90112,"data_stored":20765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.363}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.653}]}]},{"osd":1,"up_from":8,"seq":34359738372,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"kb":104857600,"kb_used":1048680,"kb_used_data":96,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":103808920,"statfs":{"total":107374182400,"available":106300334080,"internally_reserved":1073741824,"allocated":98304,"data_stored":23840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.391}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7509999999999999}]}]}]}} 2021-02-13T17:52:06.342 DEBUG:teuthology.orchestra.run.gibba025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster c1 status --format=json-pretty 2021-02-13T17:52:06.496 INFO:teuthology.orchestra.run.gibba025.stdout: 2021-02-13T17:52:06.633 INFO:teuthology.orchestra.run.gibba025.stdout:{ 2021-02-13T17:52:06.633 INFO:teuthology.orchestra.run.gibba025.stdout: "fsid": "bed73c08-798c-4f38-a3f3-1bfc03039602", 2021-02-13T17:52:06.633 INFO:teuthology.orchestra.run.gibba025.stdout: "health": { 2021-02-13T17:52:06.633 INFO:teuthology.orchestra.run.gibba025.stdout: "checks": {}, 2021-02-13T17:52:06.633 INFO:teuthology.orchestra.run.gibba025.stdout: "status": "HEALTH_OK" 2021-02-13T17:52:06.633 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.633 INFO:teuthology.orchestra.run.gibba025.stdout: "election_epoch": 3, 2021-02-13T17:52:06.634 INFO:teuthology.orchestra.run.gibba025.stdout: "quorum": [ 2021-02-13T17:52:06.634 INFO:teuthology.orchestra.run.gibba025.stdout: 0 2021-02-13T17:52:06.634 INFO:teuthology.orchestra.run.gibba025.stdout: ], 2021-02-13T17:52:06.634 INFO:teuthology.orchestra.run.gibba025.stdout: "quorum_names": [ 2021-02-13T17:52:06.634 INFO:teuthology.orchestra.run.gibba025.stdout: "a" 2021-02-13T17:52:06.634 INFO:teuthology.orchestra.run.gibba025.stdout: ], 2021-02-13T17:52:06.634 INFO:teuthology.orchestra.run.gibba025.stdout: "quorum_age": 13, 2021-02-13T17:52:06.634 INFO:teuthology.orchestra.run.gibba025.stdout: "monmap": { 2021-02-13T17:52:06.634 INFO:teuthology.orchestra.run.gibba025.stdout: "epoch": 1, 2021-02-13T17:52:06.634 INFO:teuthology.orchestra.run.gibba025.stdout: "min_mon_release_name": "14", 2021-02-13T17:52:06.634 INFO:teuthology.orchestra.run.gibba025.stdout: "num_mons": 1 2021-02-13T17:52:06.634 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.634 INFO:teuthology.orchestra.run.gibba025.stdout: "osdmap": { 2021-02-13T17:52:06.635 INFO:teuthology.orchestra.run.gibba025.stdout: "osdmap": { 2021-02-13T17:52:06.635 INFO:teuthology.orchestra.run.gibba025.stdout: "epoch": 11, 2021-02-13T17:52:06.635 INFO:teuthology.orchestra.run.gibba025.stdout: "num_osds": 3, 2021-02-13T17:52:06.635 INFO:teuthology.orchestra.run.gibba025.stdout: "num_up_osds": 3, 2021-02-13T17:52:06.635 INFO:teuthology.orchestra.run.gibba025.stdout: "num_in_osds": 3, 2021-02-13T17:52:06.635 INFO:teuthology.orchestra.run.gibba025.stdout: "num_remapped_pgs": 0 2021-02-13T17:52:06.635 INFO:teuthology.orchestra.run.gibba025.stdout: } 2021-02-13T17:52:06.635 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.635 INFO:teuthology.orchestra.run.gibba025.stdout: "pgmap": { 2021-02-13T17:52:06.635 INFO:teuthology.orchestra.run.gibba025.stdout: "pgs_by_state": [ 2021-02-13T17:52:06.635 INFO:teuthology.orchestra.run.gibba025.stdout: { 2021-02-13T17:52:06.635 INFO:teuthology.orchestra.run.gibba025.stdout: "state_name": "active+clean", 2021-02-13T17:52:06.635 INFO:teuthology.orchestra.run.gibba025.stdout: "count": 8 2021-02-13T17:52:06.636 INFO:teuthology.orchestra.run.gibba025.stdout: } 2021-02-13T17:52:06.636 INFO:teuthology.orchestra.run.gibba025.stdout: ], 2021-02-13T17:52:06.636 INFO:teuthology.orchestra.run.gibba025.stdout: "num_pgs": 8, 2021-02-13T17:52:06.636 INFO:teuthology.orchestra.run.gibba025.stdout: "num_pools": 1, 2021-02-13T17:52:06.636 INFO:teuthology.orchestra.run.gibba025.stdout: "num_objects": 0, 2021-02-13T17:52:06.636 INFO:teuthology.orchestra.run.gibba025.stdout: "data_bytes": 0, 2021-02-13T17:52:06.636 INFO:teuthology.orchestra.run.gibba025.stdout: "bytes_used": 3221528576, 2021-02-13T17:52:06.636 INFO:teuthology.orchestra.run.gibba025.stdout: "bytes_avail": 318901018624, 2021-02-13T17:52:06.636 INFO:teuthology.orchestra.run.gibba025.stdout: "bytes_total": 322122547200 2021-02-13T17:52:06.636 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.636 INFO:teuthology.orchestra.run.gibba025.stdout: "fsmap": { 2021-02-13T17:52:06.636 INFO:teuthology.orchestra.run.gibba025.stdout: "epoch": 1, 2021-02-13T17:52:06.636 INFO:teuthology.orchestra.run.gibba025.stdout: "by_rank": [], 2021-02-13T17:52:06.636 INFO:teuthology.orchestra.run.gibba025.stdout: "up:standby": 0 2021-02-13T17:52:06.637 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.637 INFO:teuthology.orchestra.run.gibba025.stdout: "mgrmap": { 2021-02-13T17:52:06.637 INFO:teuthology.orchestra.run.gibba025.stdout: "epoch": 3, 2021-02-13T17:52:06.637 INFO:teuthology.orchestra.run.gibba025.stdout: "active_gid": 4098, 2021-02-13T17:52:06.637 INFO:teuthology.orchestra.run.gibba025.stdout: "active_name": "x", 2021-02-13T17:52:06.637 INFO:teuthology.orchestra.run.gibba025.stdout: "active_addrs": { 2021-02-13T17:52:06.637 INFO:teuthology.orchestra.run.gibba025.stdout: "addrvec": [ 2021-02-13T17:52:06.637 INFO:teuthology.orchestra.run.gibba025.stdout: { 2021-02-13T17:52:06.637 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "v2", 2021-02-13T17:52:06.637 INFO:teuthology.orchestra.run.gibba025.stdout: "addr": "172.21.2.125:6824", 2021-02-13T17:52:06.637 INFO:teuthology.orchestra.run.gibba025.stdout: "nonce": 13998 2021-02-13T17:52:06.637 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.637 INFO:teuthology.orchestra.run.gibba025.stdout: { 2021-02-13T17:52:06.637 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "v1", 2021-02-13T17:52:06.638 INFO:teuthology.orchestra.run.gibba025.stdout: "addr": "172.21.2.125:6825", 2021-02-13T17:52:06.638 INFO:teuthology.orchestra.run.gibba025.stdout: "nonce": 13998 2021-02-13T17:52:06.638 INFO:teuthology.orchestra.run.gibba025.stdout: } 2021-02-13T17:52:06.638 INFO:teuthology.orchestra.run.gibba025.stdout: ] 2021-02-13T17:52:06.638 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.638 INFO:teuthology.orchestra.run.gibba025.stdout: "active_addr": "172.21.2.125:6825/13998", 2021-02-13T17:52:06.638 INFO:teuthology.orchestra.run.gibba025.stdout: "active_change": "2021-02-13 17:51:54.888096", 2021-02-13T17:52:06.638 INFO:teuthology.orchestra.run.gibba025.stdout: "available": true, 2021-02-13T17:52:06.638 INFO:teuthology.orchestra.run.gibba025.stdout: "standbys": [], 2021-02-13T17:52:06.638 INFO:teuthology.orchestra.run.gibba025.stdout: "modules": [ 2021-02-13T17:52:06.638 INFO:teuthology.orchestra.run.gibba025.stdout: "iostat", 2021-02-13T17:52:06.638 INFO:teuthology.orchestra.run.gibba025.stdout: "restful" 2021-02-13T17:52:06.638 INFO:teuthology.orchestra.run.gibba025.stdout: ], 2021-02-13T17:52:06.639 INFO:teuthology.orchestra.run.gibba025.stdout: "available_modules": [ 2021-02-13T17:52:06.639 INFO:teuthology.orchestra.run.gibba025.stdout: { 2021-02-13T17:52:06.639 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "alerts", 2021-02-13T17:52:06.639 INFO:teuthology.orchestra.run.gibba025.stdout: "can_run": true, 2021-02-13T17:52:06.639 INFO:teuthology.orchestra.run.gibba025.stdout: "error_string": "", 2021-02-13T17:52:06.639 INFO:teuthology.orchestra.run.gibba025.stdout: "module_options": { 2021-02-13T17:52:06.639 INFO:teuthology.orchestra.run.gibba025.stdout: "interval": { 2021-02-13T17:52:06.639 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "interval", 2021-02-13T17:52:06.639 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "secs", 2021-02-13T17:52:06.639 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.639 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 1, 2021-02-13T17:52:06.639 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "60", 2021-02-13T17:52:06.639 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.640 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.640 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.640 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "How frequently to reexamine health status", 2021-02-13T17:52:06.640 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.640 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.640 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.640 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.640 INFO:teuthology.orchestra.run.gibba025.stdout: "smtp_destination": { 2021-02-13T17:52:06.640 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "smtp_destination", 2021-02-13T17:52:06.640 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "str", 2021-02-13T17:52:06.640 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.640 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 1, 2021-02-13T17:52:06.640 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "", 2021-02-13T17:52:06.641 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.641 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.641 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.641 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "Email address to send alerts to", 2021-02-13T17:52:06.641 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.641 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.641 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.641 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.641 INFO:teuthology.orchestra.run.gibba025.stdout: "smtp_from_name": { 2021-02-13T17:52:06.641 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "smtp_from_name", 2021-02-13T17:52:06.641 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "str", 2021-02-13T17:52:06.641 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.641 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 1, 2021-02-13T17:52:06.642 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "Ceph", 2021-02-13T17:52:06.642 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.642 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.642 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.642 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "Email From: name", 2021-02-13T17:52:06.642 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.642 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.642 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.642 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.642 INFO:teuthology.orchestra.run.gibba025.stdout: "smtp_host": { 2021-02-13T17:52:06.642 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "smtp_host", 2021-02-13T17:52:06.642 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "str", 2021-02-13T17:52:06.642 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.643 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 1, 2021-02-13T17:52:06.643 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "", 2021-02-13T17:52:06.643 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.643 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.643 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.643 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "SMTP server", 2021-02-13T17:52:06.643 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.643 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.643 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.643 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.643 INFO:teuthology.orchestra.run.gibba025.stdout: "smtp_password": { 2021-02-13T17:52:06.643 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "smtp_password", 2021-02-13T17:52:06.643 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "str", 2021-02-13T17:52:06.643 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.644 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 1, 2021-02-13T17:52:06.644 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "", 2021-02-13T17:52:06.644 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.644 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.644 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.644 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "Password to authenticate with", 2021-02-13T17:52:06.644 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.644 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.644 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.644 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.644 INFO:teuthology.orchestra.run.gibba025.stdout: "smtp_port": { 2021-02-13T17:52:06.644 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "smtp_port", 2021-02-13T17:52:06.644 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "int", 2021-02-13T17:52:06.645 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.645 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 1, 2021-02-13T17:52:06.645 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "465", 2021-02-13T17:52:06.645 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.645 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.645 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.645 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "SMTP port", 2021-02-13T17:52:06.645 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.645 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.645 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.645 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.645 INFO:teuthology.orchestra.run.gibba025.stdout: "smtp_sender": { 2021-02-13T17:52:06.645 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "smtp_sender", 2021-02-13T17:52:06.645 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "str", 2021-02-13T17:52:06.646 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.646 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 1, 2021-02-13T17:52:06.646 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "", 2021-02-13T17:52:06.646 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.646 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.646 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.646 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "SMTP envelope sender", 2021-02-13T17:52:06.646 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.646 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.646 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.646 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.646 INFO:teuthology.orchestra.run.gibba025.stdout: "smtp_ssl": { 2021-02-13T17:52:06.646 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "smtp_ssl", 2021-02-13T17:52:06.647 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "bool", 2021-02-13T17:52:06.647 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.647 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 1, 2021-02-13T17:52:06.647 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "True", 2021-02-13T17:52:06.647 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.647 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.647 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.647 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "Use SSL to connect to SMTP server", 2021-02-13T17:52:06.647 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.647 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.647 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.647 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.647 INFO:teuthology.orchestra.run.gibba025.stdout: "smtp_user": { 2021-02-13T17:52:06.647 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "smtp_user", 2021-02-13T17:52:06.648 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "str", 2021-02-13T17:52:06.648 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.648 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 1, 2021-02-13T17:52:06.648 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "", 2021-02-13T17:52:06.648 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.648 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.648 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.648 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "User to authenticate as", 2021-02-13T17:52:06.648 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.648 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.648 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.648 INFO:teuthology.orchestra.run.gibba025.stdout: } 2021-02-13T17:52:06.648 INFO:teuthology.orchestra.run.gibba025.stdout: } 2021-02-13T17:52:06.648 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.649 INFO:teuthology.orchestra.run.gibba025.stdout: { 2021-02-13T17:52:06.649 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "ansible", 2021-02-13T17:52:06.649 INFO:teuthology.orchestra.run.gibba025.stdout: "can_run": true, 2021-02-13T17:52:06.649 INFO:teuthology.orchestra.run.gibba025.stdout: "error_string": "", 2021-02-13T17:52:06.649 INFO:teuthology.orchestra.run.gibba025.stdout: "module_options": { 2021-02-13T17:52:06.649 INFO:teuthology.orchestra.run.gibba025.stdout: "password": { 2021-02-13T17:52:06.649 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "password", 2021-02-13T17:52:06.649 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "str", 2021-02-13T17:52:06.649 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.649 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.649 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "", 2021-02-13T17:52:06.649 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.649 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.649 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.650 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.650 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.650 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.650 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.650 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.650 INFO:teuthology.orchestra.run.gibba025.stdout: "server_url": { 2021-02-13T17:52:06.650 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "server_url", 2021-02-13T17:52:06.650 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "str", 2021-02-13T17:52:06.650 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.650 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.650 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "", 2021-02-13T17:52:06.650 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.650 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.650 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.651 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.651 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.651 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.651 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.651 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.651 INFO:teuthology.orchestra.run.gibba025.stdout: "username": { 2021-02-13T17:52:06.651 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "username", 2021-02-13T17:52:06.651 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "str", 2021-02-13T17:52:06.651 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.651 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.651 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "", 2021-02-13T17:52:06.651 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.651 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.652 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.652 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.652 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.652 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.652 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.652 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.652 INFO:teuthology.orchestra.run.gibba025.stdout: "verify_server": { 2021-02-13T17:52:06.652 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "verify_server", 2021-02-13T17:52:06.652 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "str", 2021-02-13T17:52:06.652 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.652 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.652 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "", 2021-02-13T17:52:06.652 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.653 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.653 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.653 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.653 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.653 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.653 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.653 INFO:teuthology.orchestra.run.gibba025.stdout: } 2021-02-13T17:52:06.653 INFO:teuthology.orchestra.run.gibba025.stdout: } 2021-02-13T17:52:06.653 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.653 INFO:teuthology.orchestra.run.gibba025.stdout: { 2021-02-13T17:52:06.653 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "balancer", 2021-02-13T17:52:06.653 INFO:teuthology.orchestra.run.gibba025.stdout: "can_run": true, 2021-02-13T17:52:06.653 INFO:teuthology.orchestra.run.gibba025.stdout: "error_string": "", 2021-02-13T17:52:06.654 INFO:teuthology.orchestra.run.gibba025.stdout: "module_options": { 2021-02-13T17:52:06.654 INFO:teuthology.orchestra.run.gibba025.stdout: "active": { 2021-02-13T17:52:06.654 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "active", 2021-02-13T17:52:06.654 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "bool", 2021-02-13T17:52:06.654 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.654 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 1, 2021-02-13T17:52:06.654 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "False", 2021-02-13T17:52:06.654 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.654 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.654 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.655 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "automatically balance PGs across cluster", 2021-02-13T17:52:06.655 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.655 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.655 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.655 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.655 INFO:teuthology.orchestra.run.gibba025.stdout: "begin_time": { 2021-02-13T17:52:06.655 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "begin_time", 2021-02-13T17:52:06.655 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "str", 2021-02-13T17:52:06.655 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.655 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 1, 2021-02-13T17:52:06.655 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "0000", 2021-02-13T17:52:06.655 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.655 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.655 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.656 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "beginning time of day to automatically balance", 2021-02-13T17:52:06.656 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "This is a time of day in the format HHMM.", 2021-02-13T17:52:06.656 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.656 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.656 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.656 INFO:teuthology.orchestra.run.gibba025.stdout: "begin_weekday": { 2021-02-13T17:52:06.656 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "begin_weekday", 2021-02-13T17:52:06.656 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "uint", 2021-02-13T17:52:06.656 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.656 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 1, 2021-02-13T17:52:06.656 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "0", 2021-02-13T17:52:06.656 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "0", 2021-02-13T17:52:06.656 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "7", 2021-02-13T17:52:06.657 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.657 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2021-02-13T17:52:06.657 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "0 or 7 = Sunday, 1 = Monday, etc.", 2021-02-13T17:52:06.657 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.657 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.657 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.657 INFO:teuthology.orchestra.run.gibba025.stdout: "crush_compat_max_iterations": { 2021-02-13T17:52:06.657 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "crush_compat_max_iterations", 2021-02-13T17:52:06.657 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "uint", 2021-02-13T17:52:06.657 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.657 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 1, 2021-02-13T17:52:06.657 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "25", 2021-02-13T17:52:06.657 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "1", 2021-02-13T17:52:06.657 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "250", 2021-02-13T17:52:06.658 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.658 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "maximum number of iterations to attempt optimization", 2021-02-13T17:52:06.658 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.658 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.658 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.658 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.658 INFO:teuthology.orchestra.run.gibba025.stdout: "crush_compat_metrics": { 2021-02-13T17:52:06.658 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "crush_compat_metrics", 2021-02-13T17:52:06.658 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "str", 2021-02-13T17:52:06.658 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.658 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 1, 2021-02-13T17:52:06.658 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "pgs,objects,bytes", 2021-02-13T17:52:06.658 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.659 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.659 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.659 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "metrics with which to calculate OSD utilization", 2021-02-13T17:52:06.659 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2021-02-13T17:52:06.659 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.659 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.659 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.659 INFO:teuthology.orchestra.run.gibba025.stdout: "crush_compat_step": { 2021-02-13T17:52:06.659 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "crush_compat_step", 2021-02-13T17:52:06.659 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "float", 2021-02-13T17:52:06.659 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.659 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 1, 2021-02-13T17:52:06.659 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "0.5", 2021-02-13T17:52:06.659 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "0.001", 2021-02-13T17:52:06.660 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "0.999", 2021-02-13T17:52:06.660 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.660 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "aggressiveness of optimization", 2021-02-13T17:52:06.660 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2021-02-13T17:52:06.660 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.660 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.660 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.660 INFO:teuthology.orchestra.run.gibba025.stdout: "end_time": { 2021-02-13T17:52:06.660 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "end_time", 2021-02-13T17:52:06.660 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "str", 2021-02-13T17:52:06.660 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.660 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 1, 2021-02-13T17:52:06.660 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "2400", 2021-02-13T17:52:06.660 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.661 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.661 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.661 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "ending time of day to automatically balance", 2021-02-13T17:52:06.661 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "This is a time of day in the format HHMM.", 2021-02-13T17:52:06.661 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.661 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.661 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.661 INFO:teuthology.orchestra.run.gibba025.stdout: "end_weekday": { 2021-02-13T17:52:06.661 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "end_weekday", 2021-02-13T17:52:06.661 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "uint", 2021-02-13T17:52:06.661 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.661 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 1, 2021-02-13T17:52:06.661 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "7", 2021-02-13T17:52:06.662 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "0", 2021-02-13T17:52:06.662 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "7", 2021-02-13T17:52:06.662 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.662 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2021-02-13T17:52:06.662 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "0 or 7 = Sunday, 1 = Monday, etc.", 2021-02-13T17:52:06.662 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.662 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.662 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.662 INFO:teuthology.orchestra.run.gibba025.stdout: "min_score": { 2021-02-13T17:52:06.662 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "min_score", 2021-02-13T17:52:06.662 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "float", 2021-02-13T17:52:06.662 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.662 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 1, 2021-02-13T17:52:06.663 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "0", 2021-02-13T17:52:06.663 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.663 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.663 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.663 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "minimum score, below which no optimization is attempted", 2021-02-13T17:52:06.663 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.663 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.663 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.663 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.663 INFO:teuthology.orchestra.run.gibba025.stdout: "mode": { 2021-02-13T17:52:06.663 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "mode", 2021-02-13T17:52:06.663 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "str", 2021-02-13T17:52:06.663 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.663 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 1, 2021-02-13T17:52:06.664 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "none", 2021-02-13T17:52:06.664 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.664 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.664 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [ 2021-02-13T17:52:06.664 INFO:teuthology.orchestra.run.gibba025.stdout: "crush-compat", 2021-02-13T17:52:06.664 INFO:teuthology.orchestra.run.gibba025.stdout: "none", 2021-02-13T17:52:06.664 INFO:teuthology.orchestra.run.gibba025.stdout: "upmap" 2021-02-13T17:52:06.664 INFO:teuthology.orchestra.run.gibba025.stdout: ], 2021-02-13T17:52:06.664 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "Balancer mode", 2021-02-13T17:52:06.664 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.664 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.664 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.664 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.664 INFO:teuthology.orchestra.run.gibba025.stdout: "pool_ids": { 2021-02-13T17:52:06.665 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "pool_ids", 2021-02-13T17:52:06.665 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "str", 2021-02-13T17:52:06.665 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.665 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 1, 2021-02-13T17:52:06.665 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "", 2021-02-13T17:52:06.665 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.665 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.665 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.665 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "pools which the automatic balancing will be limited to", 2021-02-13T17:52:06.665 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.665 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.665 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.665 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.666 INFO:teuthology.orchestra.run.gibba025.stdout: "sleep_interval": { 2021-02-13T17:52:06.666 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "sleep_interval", 2021-02-13T17:52:06.666 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "secs", 2021-02-13T17:52:06.666 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.666 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 1, 2021-02-13T17:52:06.666 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "60", 2021-02-13T17:52:06.666 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.666 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.666 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.666 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "how frequently to wake up and attempt optimization", 2021-02-13T17:52:06.666 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.666 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.666 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.667 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.667 INFO:teuthology.orchestra.run.gibba025.stdout: "upmap_max_deviation": { 2021-02-13T17:52:06.667 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "upmap_max_deviation", 2021-02-13T17:52:06.667 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "int", 2021-02-13T17:52:06.667 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.667 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 1, 2021-02-13T17:52:06.667 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "5", 2021-02-13T17:52:06.667 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "1", 2021-02-13T17:52:06.667 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.667 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.667 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "deviation below which no optimization is attempted", 2021-02-13T17:52:06.667 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2021-02-13T17:52:06.668 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.668 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.668 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.668 INFO:teuthology.orchestra.run.gibba025.stdout: "upmap_max_iterations": { 2021-02-13T17:52:06.668 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "upmap_max_iterations", 2021-02-13T17:52:06.668 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "uint", 2021-02-13T17:52:06.668 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.668 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 1, 2021-02-13T17:52:06.669 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "10", 2021-02-13T17:52:06.669 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.669 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.669 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.669 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "maximum upmap optimization iterations", 2021-02-13T17:52:06.669 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.669 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.669 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.669 INFO:teuthology.orchestra.run.gibba025.stdout: } 2021-02-13T17:52:06.669 INFO:teuthology.orchestra.run.gibba025.stdout: } 2021-02-13T17:52:06.669 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.669 INFO:teuthology.orchestra.run.gibba025.stdout: { 2021-02-13T17:52:06.669 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "crash", 2021-02-13T17:52:06.670 INFO:teuthology.orchestra.run.gibba025.stdout: "can_run": true, 2021-02-13T17:52:06.670 INFO:teuthology.orchestra.run.gibba025.stdout: "error_string": "", 2021-02-13T17:52:06.670 INFO:teuthology.orchestra.run.gibba025.stdout: "module_options": { 2021-02-13T17:52:06.670 INFO:teuthology.orchestra.run.gibba025.stdout: "retain_interval": { 2021-02-13T17:52:06.670 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "retain_interval", 2021-02-13T17:52:06.670 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "secs", 2021-02-13T17:52:06.670 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.670 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 1, 2021-02-13T17:52:06.670 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "31536000", 2021-02-13T17:52:06.670 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.670 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.670 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.670 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "how long to retain crashes before pruning them", 2021-02-13T17:52:06.671 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.671 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.671 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.671 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.671 INFO:teuthology.orchestra.run.gibba025.stdout: "warn_recent_interval": { 2021-02-13T17:52:06.671 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "warn_recent_interval", 2021-02-13T17:52:06.671 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "secs", 2021-02-13T17:52:06.671 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.671 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 1, 2021-02-13T17:52:06.671 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "1209600", 2021-02-13T17:52:06.671 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.671 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.671 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.672 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "time interval in which to warn about recent crashes", 2021-02-13T17:52:06.672 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.672 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.672 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.672 INFO:teuthology.orchestra.run.gibba025.stdout: } 2021-02-13T17:52:06.672 INFO:teuthology.orchestra.run.gibba025.stdout: } 2021-02-13T17:52:06.672 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.672 INFO:teuthology.orchestra.run.gibba025.stdout: { 2021-02-13T17:52:06.672 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "dashboard", 2021-02-13T17:52:06.672 INFO:teuthology.orchestra.run.gibba025.stdout: "can_run": true, 2021-02-13T17:52:06.672 INFO:teuthology.orchestra.run.gibba025.stdout: "error_string": "", 2021-02-13T17:52:06.672 INFO:teuthology.orchestra.run.gibba025.stdout: "module_options": { 2021-02-13T17:52:06.672 INFO:teuthology.orchestra.run.gibba025.stdout: "ALERTMANAGER_API_HOST": { 2021-02-13T17:52:06.673 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "ALERTMANAGER_API_HOST", 2021-02-13T17:52:06.673 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "str", 2021-02-13T17:52:06.673 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.673 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.673 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "", 2021-02-13T17:52:06.673 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.673 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.673 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.673 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.673 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.673 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.673 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.673 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.673 INFO:teuthology.orchestra.run.gibba025.stdout: "AUDIT_API_ENABLED": { 2021-02-13T17:52:06.674 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "AUDIT_API_ENABLED", 2021-02-13T17:52:06.674 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "bool", 2021-02-13T17:52:06.674 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.674 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.674 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "False", 2021-02-13T17:52:06.674 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.674 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.674 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.674 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.674 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.674 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.674 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.674 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.675 INFO:teuthology.orchestra.run.gibba025.stdout: "AUDIT_API_LOG_PAYLOAD": { 2021-02-13T17:52:06.675 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2021-02-13T17:52:06.675 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "bool", 2021-02-13T17:52:06.675 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.675 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.675 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "True", 2021-02-13T17:52:06.675 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.675 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.675 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.675 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.675 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.675 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.675 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.676 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.676 INFO:teuthology.orchestra.run.gibba025.stdout: "ENABLE_BROWSABLE_API": { 2021-02-13T17:52:06.676 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "ENABLE_BROWSABLE_API", 2021-02-13T17:52:06.676 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "bool", 2021-02-13T17:52:06.676 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.676 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.676 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "True", 2021-02-13T17:52:06.676 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.676 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.676 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.676 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.676 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.676 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.676 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.677 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.677 INFO:teuthology.orchestra.run.gibba025.stdout: "FEATURE_TOGGLE_cephfs": { 2021-02-13T17:52:06.677 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "FEATURE_TOGGLE_cephfs", 2021-02-13T17:52:06.677 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "bool", 2021-02-13T17:52:06.677 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.677 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.677 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "True", 2021-02-13T17:52:06.677 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.677 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.677 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.677 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.677 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.677 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.677 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.678 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.678 INFO:teuthology.orchestra.run.gibba025.stdout: "FEATURE_TOGGLE_iscsi": { 2021-02-13T17:52:06.678 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "FEATURE_TOGGLE_iscsi", 2021-02-13T17:52:06.678 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "bool", 2021-02-13T17:52:06.678 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.678 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.678 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "True", 2021-02-13T17:52:06.678 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.678 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.678 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.678 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.678 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.679 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.679 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.679 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.679 INFO:teuthology.orchestra.run.gibba025.stdout: "FEATURE_TOGGLE_mirroring": { 2021-02-13T17:52:06.679 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "FEATURE_TOGGLE_mirroring", 2021-02-13T17:52:06.679 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "bool", 2021-02-13T17:52:06.679 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.679 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.679 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "True", 2021-02-13T17:52:06.679 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.679 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.679 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.679 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.679 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.680 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.680 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.680 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.680 INFO:teuthology.orchestra.run.gibba025.stdout: "FEATURE_TOGGLE_rbd": { 2021-02-13T17:52:06.680 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "FEATURE_TOGGLE_rbd", 2021-02-13T17:52:06.680 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "bool", 2021-02-13T17:52:06.680 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.680 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.680 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "True", 2021-02-13T17:52:06.680 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.680 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.680 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.680 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.680 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.681 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.681 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.681 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.681 INFO:teuthology.orchestra.run.gibba025.stdout: "FEATURE_TOGGLE_rgw": { 2021-02-13T17:52:06.681 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "FEATURE_TOGGLE_rgw", 2021-02-13T17:52:06.681 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "bool", 2021-02-13T17:52:06.681 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.681 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.681 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "True", 2021-02-13T17:52:06.681 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.681 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.681 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.681 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.681 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.682 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.682 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.682 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.682 INFO:teuthology.orchestra.run.gibba025.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2021-02-13T17:52:06.682 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2021-02-13T17:52:06.682 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "str", 2021-02-13T17:52:06.682 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.682 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.682 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "", 2021-02-13T17:52:06.682 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.682 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.682 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.683 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.683 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.683 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.683 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.683 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.683 INFO:teuthology.orchestra.run.gibba025.stdout: "GRAFANA_API_PASSWORD": { 2021-02-13T17:52:06.683 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "GRAFANA_API_PASSWORD", 2021-02-13T17:52:06.683 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "str", 2021-02-13T17:52:06.683 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.683 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.683 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "admin", 2021-02-13T17:52:06.683 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.683 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.683 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.684 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.684 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.684 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.684 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.684 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.684 INFO:teuthology.orchestra.run.gibba025.stdout: "GRAFANA_API_SSL_VERIFY": { 2021-02-13T17:52:06.684 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2021-02-13T17:52:06.684 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "bool", 2021-02-13T17:52:06.684 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.684 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.684 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "True", 2021-02-13T17:52:06.684 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.684 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.685 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.685 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.685 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.685 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.685 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.685 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.685 INFO:teuthology.orchestra.run.gibba025.stdout: "GRAFANA_API_URL": { 2021-02-13T17:52:06.685 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "GRAFANA_API_URL", 2021-02-13T17:52:06.685 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "str", 2021-02-13T17:52:06.685 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.685 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.685 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "", 2021-02-13T17:52:06.685 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.685 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.686 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.686 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.686 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.686 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.686 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.686 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.686 INFO:teuthology.orchestra.run.gibba025.stdout: "GRAFANA_API_USERNAME": { 2021-02-13T17:52:06.686 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "GRAFANA_API_USERNAME", 2021-02-13T17:52:06.686 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "str", 2021-02-13T17:52:06.686 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.686 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.686 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "admin", 2021-02-13T17:52:06.686 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.687 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.687 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.687 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.687 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.687 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.687 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.687 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.687 INFO:teuthology.orchestra.run.gibba025.stdout: "GRAFANA_FRONTEND_API_URL": { 2021-02-13T17:52:06.687 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2021-02-13T17:52:06.687 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "str", 2021-02-13T17:52:06.687 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.687 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.688 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "", 2021-02-13T17:52:06.688 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.688 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.688 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.688 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.688 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.688 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.688 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.688 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.688 INFO:teuthology.orchestra.run.gibba025.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2021-02-13T17:52:06.688 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2021-02-13T17:52:06.688 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "bool", 2021-02-13T17:52:06.688 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.688 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.689 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "False", 2021-02-13T17:52:06.689 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.689 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.689 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.689 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.689 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.689 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.689 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.689 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.689 INFO:teuthology.orchestra.run.gibba025.stdout: "ISCSI_API_SSL_VERIFICATION": { 2021-02-13T17:52:06.689 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2021-02-13T17:52:06.689 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "bool", 2021-02-13T17:52:06.689 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.690 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.690 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "True", 2021-02-13T17:52:06.690 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.690 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.690 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.690 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.690 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.690 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.690 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.690 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.690 INFO:teuthology.orchestra.run.gibba025.stdout: "PROMETHEUS_API_HOST": { 2021-02-13T17:52:06.690 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "PROMETHEUS_API_HOST", 2021-02-13T17:52:06.690 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "str", 2021-02-13T17:52:06.691 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.691 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.691 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "", 2021-02-13T17:52:06.691 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.691 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.691 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.691 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.691 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.691 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.691 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.691 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.691 INFO:teuthology.orchestra.run.gibba025.stdout: "REST_REQUESTS_TIMEOUT": { 2021-02-13T17:52:06.691 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "REST_REQUESTS_TIMEOUT", 2021-02-13T17:52:06.691 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "int", 2021-02-13T17:52:06.692 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.692 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.692 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "45", 2021-02-13T17:52:06.692 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.692 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.692 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.692 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.692 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.692 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.692 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.692 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.692 INFO:teuthology.orchestra.run.gibba025.stdout: "RGW_API_ACCESS_KEY": { 2021-02-13T17:52:06.692 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "RGW_API_ACCESS_KEY", 2021-02-13T17:52:06.693 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "str", 2021-02-13T17:52:06.693 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.693 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.693 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "", 2021-02-13T17:52:06.693 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.693 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.693 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.693 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.693 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.693 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.693 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.693 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.693 INFO:teuthology.orchestra.run.gibba025.stdout: "RGW_API_ADMIN_RESOURCE": { 2021-02-13T17:52:06.694 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2021-02-13T17:52:06.694 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "str", 2021-02-13T17:52:06.694 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.694 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.694 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "admin", 2021-02-13T17:52:06.694 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.694 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.694 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.694 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.694 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.694 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.694 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.694 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.695 INFO:teuthology.orchestra.run.gibba025.stdout: "RGW_API_HOST": { 2021-02-13T17:52:06.695 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "RGW_API_HOST", 2021-02-13T17:52:06.695 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "str", 2021-02-13T17:52:06.695 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.695 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.695 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "", 2021-02-13T17:52:06.695 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.695 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.695 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.695 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.695 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.695 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.695 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.695 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.696 INFO:teuthology.orchestra.run.gibba025.stdout: "RGW_API_PORT": { 2021-02-13T17:52:06.696 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "RGW_API_PORT", 2021-02-13T17:52:06.696 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "int", 2021-02-13T17:52:06.696 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.696 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.696 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "80", 2021-02-13T17:52:06.696 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.696 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.696 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.696 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.696 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.696 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.696 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.696 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.697 INFO:teuthology.orchestra.run.gibba025.stdout: "RGW_API_SCHEME": { 2021-02-13T17:52:06.697 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "RGW_API_SCHEME", 2021-02-13T17:52:06.697 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "str", 2021-02-13T17:52:06.697 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.697 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.697 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "http", 2021-02-13T17:52:06.697 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.697 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.697 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.697 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.697 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.697 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.697 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.698 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.698 INFO:teuthology.orchestra.run.gibba025.stdout: "RGW_API_SECRET_KEY": { 2021-02-13T17:52:06.698 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "RGW_API_SECRET_KEY", 2021-02-13T17:52:06.698 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "str", 2021-02-13T17:52:06.698 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.698 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.698 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "", 2021-02-13T17:52:06.698 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.698 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.698 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.698 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.698 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.698 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.699 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.699 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.699 INFO:teuthology.orchestra.run.gibba025.stdout: "RGW_API_SSL_VERIFY": { 2021-02-13T17:52:06.699 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "RGW_API_SSL_VERIFY", 2021-02-13T17:52:06.699 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "bool", 2021-02-13T17:52:06.699 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.699 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.699 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "True", 2021-02-13T17:52:06.699 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.699 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.699 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.699 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.699 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.699 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.700 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.700 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.700 INFO:teuthology.orchestra.run.gibba025.stdout: "RGW_API_USER_ID": { 2021-02-13T17:52:06.700 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "RGW_API_USER_ID", 2021-02-13T17:52:06.700 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "str", 2021-02-13T17:52:06.700 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.700 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.700 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "", 2021-02-13T17:52:06.700 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.700 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.700 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.700 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.700 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.700 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.701 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.701 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.701 INFO:teuthology.orchestra.run.gibba025.stdout: "crt_file": { 2021-02-13T17:52:06.701 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "crt_file", 2021-02-13T17:52:06.701 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "str", 2021-02-13T17:52:06.701 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.701 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.701 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "", 2021-02-13T17:52:06.701 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.701 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.701 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.701 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.701 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.702 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.702 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.702 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.702 INFO:teuthology.orchestra.run.gibba025.stdout: "debug": { 2021-02-13T17:52:06.702 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "debug", 2021-02-13T17:52:06.702 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "bool", 2021-02-13T17:52:06.702 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.702 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.702 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "False", 2021-02-13T17:52:06.702 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.702 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.702 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.703 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "Enable/disable debug options", 2021-02-13T17:52:06.703 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.703 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.703 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.703 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.703 INFO:teuthology.orchestra.run.gibba025.stdout: "jwt_token_ttl": { 2021-02-13T17:52:06.703 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "jwt_token_ttl", 2021-02-13T17:52:06.703 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "int", 2021-02-13T17:52:06.703 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.703 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.703 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "28800", 2021-02-13T17:52:06.703 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.703 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.703 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.704 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.704 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.704 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.704 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.704 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.704 INFO:teuthology.orchestra.run.gibba025.stdout: "key_file": { 2021-02-13T17:52:06.704 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "key_file", 2021-02-13T17:52:06.704 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "str", 2021-02-13T17:52:06.704 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.704 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.704 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "", 2021-02-13T17:52:06.704 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.704 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.705 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.705 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.705 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.705 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.705 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.705 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.705 INFO:teuthology.orchestra.run.gibba025.stdout: "password": { 2021-02-13T17:52:06.705 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "password", 2021-02-13T17:52:06.705 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "str", 2021-02-13T17:52:06.705 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.705 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.705 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "", 2021-02-13T17:52:06.705 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.706 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.706 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.706 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.706 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.706 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.706 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.706 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.706 INFO:teuthology.orchestra.run.gibba025.stdout: "server_addr": { 2021-02-13T17:52:06.706 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "server_addr", 2021-02-13T17:52:06.706 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "str", 2021-02-13T17:52:06.706 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.706 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.706 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "::", 2021-02-13T17:52:06.707 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.707 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.707 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.707 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.707 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.707 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.707 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.707 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.707 INFO:teuthology.orchestra.run.gibba025.stdout: "server_port": { 2021-02-13T17:52:06.707 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "server_port", 2021-02-13T17:52:06.707 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "int", 2021-02-13T17:52:06.707 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.707 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.708 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "8080", 2021-02-13T17:52:06.708 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.708 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.708 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.708 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.708 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.708 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.708 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.708 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.708 INFO:teuthology.orchestra.run.gibba025.stdout: "ssl": { 2021-02-13T17:52:06.708 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "ssl", 2021-02-13T17:52:06.708 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "bool", 2021-02-13T17:52:06.708 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.708 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.709 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "True", 2021-02-13T17:52:06.709 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.709 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.709 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.709 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.709 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.709 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.709 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.709 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.709 INFO:teuthology.orchestra.run.gibba025.stdout: "ssl_server_port": { 2021-02-13T17:52:06.709 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "ssl_server_port", 2021-02-13T17:52:06.709 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "int", 2021-02-13T17:52:06.709 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.709 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.710 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "8443", 2021-02-13T17:52:06.710 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.710 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.710 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.710 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.710 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.710 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.710 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.710 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.710 INFO:teuthology.orchestra.run.gibba025.stdout: "standby_behaviour": { 2021-02-13T17:52:06.710 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "standby_behaviour", 2021-02-13T17:52:06.710 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "str", 2021-02-13T17:52:06.710 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.710 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.711 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "redirect", 2021-02-13T17:52:06.711 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.711 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.711 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [ 2021-02-13T17:52:06.711 INFO:teuthology.orchestra.run.gibba025.stdout: "error", 2021-02-13T17:52:06.711 INFO:teuthology.orchestra.run.gibba025.stdout: "redirect" 2021-02-13T17:52:06.711 INFO:teuthology.orchestra.run.gibba025.stdout: ], 2021-02-13T17:52:06.711 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.711 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.711 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.711 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.711 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.711 INFO:teuthology.orchestra.run.gibba025.stdout: "standby_error_status_code": { 2021-02-13T17:52:06.711 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "standby_error_status_code", 2021-02-13T17:52:06.712 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "int", 2021-02-13T17:52:06.712 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.712 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.712 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "500", 2021-02-13T17:52:06.712 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "400", 2021-02-13T17:52:06.712 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "599", 2021-02-13T17:52:06.712 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.712 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.712 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.712 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.712 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.712 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.712 INFO:teuthology.orchestra.run.gibba025.stdout: "url_prefix": { 2021-02-13T17:52:06.713 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "url_prefix", 2021-02-13T17:52:06.713 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "str", 2021-02-13T17:52:06.713 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.713 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.713 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "", 2021-02-13T17:52:06.713 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.713 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.713 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.713 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.713 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.713 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.713 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.713 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.713 INFO:teuthology.orchestra.run.gibba025.stdout: "username": { 2021-02-13T17:52:06.714 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "username", 2021-02-13T17:52:06.714 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "str", 2021-02-13T17:52:06.714 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.714 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.714 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "", 2021-02-13T17:52:06.714 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.714 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.714 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.714 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.714 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.714 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.714 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.714 INFO:teuthology.orchestra.run.gibba025.stdout: } 2021-02-13T17:52:06.715 INFO:teuthology.orchestra.run.gibba025.stdout: } 2021-02-13T17:52:06.715 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.715 INFO:teuthology.orchestra.run.gibba025.stdout: { 2021-02-13T17:52:06.715 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "deepsea", 2021-02-13T17:52:06.715 INFO:teuthology.orchestra.run.gibba025.stdout: "can_run": true, 2021-02-13T17:52:06.715 INFO:teuthology.orchestra.run.gibba025.stdout: "error_string": "", 2021-02-13T17:52:06.715 INFO:teuthology.orchestra.run.gibba025.stdout: "module_options": { 2021-02-13T17:52:06.715 INFO:teuthology.orchestra.run.gibba025.stdout: "salt_api_eauth": { 2021-02-13T17:52:06.715 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "salt_api_eauth", 2021-02-13T17:52:06.715 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "str", 2021-02-13T17:52:06.715 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.715 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.715 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "sharedsecret", 2021-02-13T17:52:06.716 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.716 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.716 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.716 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.716 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.716 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.716 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.716 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.716 INFO:teuthology.orchestra.run.gibba025.stdout: "salt_api_password": { 2021-02-13T17:52:06.716 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "salt_api_password", 2021-02-13T17:52:06.716 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "str", 2021-02-13T17:52:06.716 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.716 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.716 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "", 2021-02-13T17:52:06.717 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.717 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.717 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.717 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.717 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.717 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.717 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.717 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.717 INFO:teuthology.orchestra.run.gibba025.stdout: "salt_api_url": { 2021-02-13T17:52:06.717 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "salt_api_url", 2021-02-13T17:52:06.717 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "str", 2021-02-13T17:52:06.717 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.717 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.717 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "", 2021-02-13T17:52:06.718 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.718 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.718 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.718 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.718 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.718 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.718 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.718 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.718 INFO:teuthology.orchestra.run.gibba025.stdout: "salt_api_username": { 2021-02-13T17:52:06.718 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "salt_api_username", 2021-02-13T17:52:06.718 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "str", 2021-02-13T17:52:06.718 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.718 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.719 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "", 2021-02-13T17:52:06.719 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.719 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.719 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.719 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.719 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.719 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.719 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.719 INFO:teuthology.orchestra.run.gibba025.stdout: } 2021-02-13T17:52:06.719 INFO:teuthology.orchestra.run.gibba025.stdout: } 2021-02-13T17:52:06.719 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.719 INFO:teuthology.orchestra.run.gibba025.stdout: { 2021-02-13T17:52:06.719 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "devicehealth", 2021-02-13T17:52:06.719 INFO:teuthology.orchestra.run.gibba025.stdout: "can_run": true, 2021-02-13T17:52:06.720 INFO:teuthology.orchestra.run.gibba025.stdout: "error_string": "", 2021-02-13T17:52:06.720 INFO:teuthology.orchestra.run.gibba025.stdout: "module_options": { 2021-02-13T17:52:06.720 INFO:teuthology.orchestra.run.gibba025.stdout: "enable_monitoring": { 2021-02-13T17:52:06.720 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "enable_monitoring", 2021-02-13T17:52:06.720 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "bool", 2021-02-13T17:52:06.720 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.720 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 1, 2021-02-13T17:52:06.720 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "False", 2021-02-13T17:52:06.720 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.720 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.720 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.720 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "monitor device health metrics", 2021-02-13T17:52:06.720 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.720 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.721 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.721 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.721 INFO:teuthology.orchestra.run.gibba025.stdout: "mark_out_threshold": { 2021-02-13T17:52:06.721 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "mark_out_threshold", 2021-02-13T17:52:06.721 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "secs", 2021-02-13T17:52:06.721 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.721 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 1, 2021-02-13T17:52:06.721 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "2419200", 2021-02-13T17:52:06.721 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.721 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.721 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.721 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "automatically mark OSD if it may fail before this long", 2021-02-13T17:52:06.721 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.721 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.722 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.722 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.722 INFO:teuthology.orchestra.run.gibba025.stdout: "pool_name": { 2021-02-13T17:52:06.722 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "pool_name", 2021-02-13T17:52:06.722 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "str", 2021-02-13T17:52:06.722 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.722 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 1, 2021-02-13T17:52:06.722 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "device_health_metrics", 2021-02-13T17:52:06.722 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.722 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.722 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.722 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "name of pool in which to store device health metrics", 2021-02-13T17:52:06.722 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.722 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.723 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.723 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.723 INFO:teuthology.orchestra.run.gibba025.stdout: "retention_period": { 2021-02-13T17:52:06.723 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "retention_period", 2021-02-13T17:52:06.723 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "secs", 2021-02-13T17:52:06.723 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.723 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 1, 2021-02-13T17:52:06.723 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "15552000", 2021-02-13T17:52:06.723 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.723 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.723 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.723 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "how long to retain device health metrics", 2021-02-13T17:52:06.723 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.723 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.724 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.724 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.724 INFO:teuthology.orchestra.run.gibba025.stdout: "scrape_frequency": { 2021-02-13T17:52:06.724 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "scrape_frequency", 2021-02-13T17:52:06.724 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "secs", 2021-02-13T17:52:06.724 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.724 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 1, 2021-02-13T17:52:06.724 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "86400", 2021-02-13T17:52:06.724 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.724 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.724 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.724 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "how frequently to scrape device health metrics", 2021-02-13T17:52:06.724 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.724 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.725 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.725 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.725 INFO:teuthology.orchestra.run.gibba025.stdout: "self_heal": { 2021-02-13T17:52:06.725 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "self_heal", 2021-02-13T17:52:06.725 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "bool", 2021-02-13T17:52:06.725 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.725 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 1, 2021-02-13T17:52:06.725 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "True", 2021-02-13T17:52:06.725 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.725 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.725 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.725 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "preemptively heal cluster around devices that may fail", 2021-02-13T17:52:06.725 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.725 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.726 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.726 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.726 INFO:teuthology.orchestra.run.gibba025.stdout: "sleep_interval": { 2021-02-13T17:52:06.726 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "sleep_interval", 2021-02-13T17:52:06.726 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "secs", 2021-02-13T17:52:06.726 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.726 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 1, 2021-02-13T17:52:06.726 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "600", 2021-02-13T17:52:06.726 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.726 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.726 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.726 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "how frequently to wake up and check device health", 2021-02-13T17:52:06.726 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.727 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.727 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.727 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.727 INFO:teuthology.orchestra.run.gibba025.stdout: "warn_threshold": { 2021-02-13T17:52:06.727 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "warn_threshold", 2021-02-13T17:52:06.727 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "secs", 2021-02-13T17:52:06.727 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.728 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 1, 2021-02-13T17:52:06.728 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "7257600", 2021-02-13T17:52:06.729 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.729 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.729 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.729 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "raise health warning if OSD may fail before this long", 2021-02-13T17:52:06.729 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.729 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.729 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.729 INFO:teuthology.orchestra.run.gibba025.stdout: } 2021-02-13T17:52:06.729 INFO:teuthology.orchestra.run.gibba025.stdout: } 2021-02-13T17:52:06.729 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.729 INFO:teuthology.orchestra.run.gibba025.stdout: { 2021-02-13T17:52:06.729 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "diskprediction_cloud", 2021-02-13T17:52:06.729 INFO:teuthology.orchestra.run.gibba025.stdout: "can_run": true, 2021-02-13T17:52:06.729 INFO:teuthology.orchestra.run.gibba025.stdout: "error_string": "", 2021-02-13T17:52:06.730 INFO:teuthology.orchestra.run.gibba025.stdout: "module_options": { 2021-02-13T17:52:06.730 INFO:teuthology.orchestra.run.gibba025.stdout: "diskprediction_cert_context": { 2021-02-13T17:52:06.730 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "diskprediction_cert_context", 2021-02-13T17:52:06.730 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "str", 2021-02-13T17:52:06.730 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.730 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.730 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "", 2021-02-13T17:52:06.730 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.730 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.730 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.730 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.730 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.730 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.731 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.731 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.731 INFO:teuthology.orchestra.run.gibba025.stdout: "diskprediction_default_authority": { 2021-02-13T17:52:06.731 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "diskprediction_default_authority", 2021-02-13T17:52:06.731 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "str", 2021-02-13T17:52:06.731 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.731 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.731 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "localhost", 2021-02-13T17:52:06.731 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.731 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.731 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.731 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.731 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.731 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.732 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.732 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.732 INFO:teuthology.orchestra.run.gibba025.stdout: "diskprediction_password": { 2021-02-13T17:52:06.732 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "diskprediction_password", 2021-02-13T17:52:06.732 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "str", 2021-02-13T17:52:06.732 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.732 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.732 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "", 2021-02-13T17:52:06.732 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.732 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.732 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.732 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.732 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.733 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.733 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.733 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.733 INFO:teuthology.orchestra.run.gibba025.stdout: "diskprediction_port": { 2021-02-13T17:52:06.733 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "diskprediction_port", 2021-02-13T17:52:06.733 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "str", 2021-02-13T17:52:06.733 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.733 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.733 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "31400", 2021-02-13T17:52:06.733 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.733 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.733 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.733 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.733 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.734 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.734 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.734 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.734 INFO:teuthology.orchestra.run.gibba025.stdout: "diskprediction_retrieve_prediction_interval": { 2021-02-13T17:52:06.734 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "diskprediction_retrieve_prediction_interval", 2021-02-13T17:52:06.734 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "str", 2021-02-13T17:52:06.734 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.734 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.734 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "43200", 2021-02-13T17:52:06.734 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.734 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.734 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.734 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.735 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.735 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.735 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.735 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.735 INFO:teuthology.orchestra.run.gibba025.stdout: "diskprediction_server": { 2021-02-13T17:52:06.735 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "diskprediction_server", 2021-02-13T17:52:06.735 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "str", 2021-02-13T17:52:06.735 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.735 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.735 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "", 2021-02-13T17:52:06.735 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.735 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.735 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.735 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.736 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.736 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.736 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.736 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.736 INFO:teuthology.orchestra.run.gibba025.stdout: "diskprediction_ssl_target_name_override": { 2021-02-13T17:52:06.736 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "diskprediction_ssl_target_name_override", 2021-02-13T17:52:06.736 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "str", 2021-02-13T17:52:06.736 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.736 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.736 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "localhost", 2021-02-13T17:52:06.736 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.736 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.736 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.736 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.737 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.737 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.737 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.737 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.737 INFO:teuthology.orchestra.run.gibba025.stdout: "diskprediction_upload_metrics_interval": { 2021-02-13T17:52:06.737 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "diskprediction_upload_metrics_interval", 2021-02-13T17:52:06.737 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "str", 2021-02-13T17:52:06.737 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.737 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.737 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "600", 2021-02-13T17:52:06.737 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.737 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.737 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.737 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.738 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.738 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.738 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.738 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.738 INFO:teuthology.orchestra.run.gibba025.stdout: "diskprediction_upload_smart_interval": { 2021-02-13T17:52:06.738 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "diskprediction_upload_smart_interval", 2021-02-13T17:52:06.738 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "str", 2021-02-13T17:52:06.738 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.738 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.738 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "43200", 2021-02-13T17:52:06.738 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.738 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.738 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.739 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.739 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.739 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.739 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.739 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.739 INFO:teuthology.orchestra.run.gibba025.stdout: "diskprediction_user": { 2021-02-13T17:52:06.739 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "diskprediction_user", 2021-02-13T17:52:06.739 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "str", 2021-02-13T17:52:06.739 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.739 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.739 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "", 2021-02-13T17:52:06.739 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.739 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.740 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.740 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.740 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.740 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.740 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.740 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.740 INFO:teuthology.orchestra.run.gibba025.stdout: "sleep_interval": { 2021-02-13T17:52:06.740 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "sleep_interval", 2021-02-13T17:52:06.740 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "str", 2021-02-13T17:52:06.740 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.740 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.740 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "600", 2021-02-13T17:52:06.740 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.741 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.741 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.741 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.741 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.741 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.741 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.741 INFO:teuthology.orchestra.run.gibba025.stdout: } 2021-02-13T17:52:06.741 INFO:teuthology.orchestra.run.gibba025.stdout: } 2021-02-13T17:52:06.741 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.741 INFO:teuthology.orchestra.run.gibba025.stdout: { 2021-02-13T17:52:06.741 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "diskprediction_local", 2021-02-13T17:52:06.741 INFO:teuthology.orchestra.run.gibba025.stdout: "can_run": true, 2021-02-13T17:52:06.741 INFO:teuthology.orchestra.run.gibba025.stdout: "error_string": "", 2021-02-13T17:52:06.741 INFO:teuthology.orchestra.run.gibba025.stdout: "module_options": { 2021-02-13T17:52:06.742 INFO:teuthology.orchestra.run.gibba025.stdout: "predict_interval": { 2021-02-13T17:52:06.742 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "predict_interval", 2021-02-13T17:52:06.742 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "str", 2021-02-13T17:52:06.742 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.742 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.742 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "86400", 2021-02-13T17:52:06.742 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.742 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.742 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.742 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.742 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.742 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.742 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.742 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.743 INFO:teuthology.orchestra.run.gibba025.stdout: "sleep_interval": { 2021-02-13T17:52:06.743 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "sleep_interval", 2021-02-13T17:52:06.743 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "str", 2021-02-13T17:52:06.743 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.743 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.743 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "600", 2021-02-13T17:52:06.743 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.743 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.743 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.743 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.743 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.743 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.743 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.744 INFO:teuthology.orchestra.run.gibba025.stdout: } 2021-02-13T17:52:06.744 INFO:teuthology.orchestra.run.gibba025.stdout: } 2021-02-13T17:52:06.744 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.744 INFO:teuthology.orchestra.run.gibba025.stdout: { 2021-02-13T17:52:06.744 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "influx", 2021-02-13T17:52:06.744 INFO:teuthology.orchestra.run.gibba025.stdout: "can_run": false, 2021-02-13T17:52:06.744 INFO:teuthology.orchestra.run.gibba025.stdout: "error_string": "influxdb python module not found", 2021-02-13T17:52:06.744 INFO:teuthology.orchestra.run.gibba025.stdout: "module_options": { 2021-02-13T17:52:06.744 INFO:teuthology.orchestra.run.gibba025.stdout: "batch_size": { 2021-02-13T17:52:06.744 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "batch_size", 2021-02-13T17:52:06.744 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "str", 2021-02-13T17:52:06.744 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.744 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.744 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "5000", 2021-02-13T17:52:06.745 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.745 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.745 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.745 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.745 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.745 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.745 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.745 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.745 INFO:teuthology.orchestra.run.gibba025.stdout: "database": { 2021-02-13T17:52:06.745 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "database", 2021-02-13T17:52:06.745 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "str", 2021-02-13T17:52:06.745 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.745 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.746 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "ceph", 2021-02-13T17:52:06.746 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.746 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.746 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.746 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.746 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.746 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.746 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.746 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.746 INFO:teuthology.orchestra.run.gibba025.stdout: "hostname": { 2021-02-13T17:52:06.746 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "hostname", 2021-02-13T17:52:06.746 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "str", 2021-02-13T17:52:06.746 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.747 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.747 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "None", 2021-02-13T17:52:06.747 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.747 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.747 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.747 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.747 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.747 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.747 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.747 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.747 INFO:teuthology.orchestra.run.gibba025.stdout: "interval": { 2021-02-13T17:52:06.747 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "interval", 2021-02-13T17:52:06.747 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "str", 2021-02-13T17:52:06.747 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.748 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.748 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "30", 2021-02-13T17:52:06.748 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.748 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.748 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.748 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.748 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.748 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.748 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.748 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.748 INFO:teuthology.orchestra.run.gibba025.stdout: "password": { 2021-02-13T17:52:06.748 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "password", 2021-02-13T17:52:06.748 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "str", 2021-02-13T17:52:06.749 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.749 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.749 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "None", 2021-02-13T17:52:06.749 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.749 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.749 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.749 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.749 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.749 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.749 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.749 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.749 INFO:teuthology.orchestra.run.gibba025.stdout: "port": { 2021-02-13T17:52:06.749 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "port", 2021-02-13T17:52:06.749 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "str", 2021-02-13T17:52:06.750 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.750 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.750 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "8086", 2021-02-13T17:52:06.750 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.750 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.750 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.750 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.750 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.750 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.750 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.750 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.750 INFO:teuthology.orchestra.run.gibba025.stdout: "ssl": { 2021-02-13T17:52:06.750 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "ssl", 2021-02-13T17:52:06.750 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "str", 2021-02-13T17:52:06.751 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.751 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.751 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "false", 2021-02-13T17:52:06.751 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.751 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.751 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.751 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.751 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.751 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.751 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.751 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.751 INFO:teuthology.orchestra.run.gibba025.stdout: "threads": { 2021-02-13T17:52:06.751 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "threads", 2021-02-13T17:52:06.751 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "str", 2021-02-13T17:52:06.752 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.752 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.752 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "5", 2021-02-13T17:52:06.752 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.752 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.752 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.752 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.752 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.752 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.752 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.752 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.752 INFO:teuthology.orchestra.run.gibba025.stdout: "username": { 2021-02-13T17:52:06.752 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "username", 2021-02-13T17:52:06.753 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "str", 2021-02-13T17:52:06.753 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.753 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.753 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "None", 2021-02-13T17:52:06.753 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.753 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.753 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.753 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.753 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.753 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.753 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.753 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.753 INFO:teuthology.orchestra.run.gibba025.stdout: "verify_ssl": { 2021-02-13T17:52:06.753 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "verify_ssl", 2021-02-13T17:52:06.754 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "str", 2021-02-13T17:52:06.754 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.754 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.754 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "true", 2021-02-13T17:52:06.754 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.754 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.754 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.754 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.754 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.754 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.754 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.754 INFO:teuthology.orchestra.run.gibba025.stdout: } 2021-02-13T17:52:06.754 INFO:teuthology.orchestra.run.gibba025.stdout: } 2021-02-13T17:52:06.755 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.755 INFO:teuthology.orchestra.run.gibba025.stdout: { 2021-02-13T17:52:06.755 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "insights", 2021-02-13T17:52:06.755 INFO:teuthology.orchestra.run.gibba025.stdout: "can_run": true, 2021-02-13T17:52:06.755 INFO:teuthology.orchestra.run.gibba025.stdout: "error_string": "", 2021-02-13T17:52:06.755 INFO:teuthology.orchestra.run.gibba025.stdout: "module_options": {} 2021-02-13T17:52:06.755 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.755 INFO:teuthology.orchestra.run.gibba025.stdout: { 2021-02-13T17:52:06.755 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "iostat", 2021-02-13T17:52:06.755 INFO:teuthology.orchestra.run.gibba025.stdout: "can_run": true, 2021-02-13T17:52:06.755 INFO:teuthology.orchestra.run.gibba025.stdout: "error_string": "", 2021-02-13T17:52:06.755 INFO:teuthology.orchestra.run.gibba025.stdout: "module_options": {} 2021-02-13T17:52:06.755 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.755 INFO:teuthology.orchestra.run.gibba025.stdout: { 2021-02-13T17:52:06.756 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "localpool", 2021-02-13T17:52:06.756 INFO:teuthology.orchestra.run.gibba025.stdout: "can_run": true, 2021-02-13T17:52:06.756 INFO:teuthology.orchestra.run.gibba025.stdout: "error_string": "", 2021-02-13T17:52:06.756 INFO:teuthology.orchestra.run.gibba025.stdout: "module_options": { 2021-02-13T17:52:06.756 INFO:teuthology.orchestra.run.gibba025.stdout: "failure_domain": { 2021-02-13T17:52:06.756 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "failure_domain", 2021-02-13T17:52:06.756 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "str", 2021-02-13T17:52:06.756 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.756 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 1, 2021-02-13T17:52:06.756 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "host", 2021-02-13T17:52:06.756 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.756 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.756 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.756 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "failure domain for any created local pool", 2021-02-13T17:52:06.757 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.757 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.757 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.757 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.757 INFO:teuthology.orchestra.run.gibba025.stdout: "min_size": { 2021-02-13T17:52:06.757 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "min_size", 2021-02-13T17:52:06.757 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "int", 2021-02-13T17:52:06.757 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.757 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 1, 2021-02-13T17:52:06.757 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "", 2021-02-13T17:52:06.757 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.757 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.757 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.757 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "default min_size for any created local pool", 2021-02-13T17:52:06.758 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.758 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.758 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.758 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.758 INFO:teuthology.orchestra.run.gibba025.stdout: "num_rep": { 2021-02-13T17:52:06.758 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "num_rep", 2021-02-13T17:52:06.758 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "int", 2021-02-13T17:52:06.758 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.758 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 1, 2021-02-13T17:52:06.758 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "3", 2021-02-13T17:52:06.758 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.758 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.758 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.759 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "default replica count for any created local pool", 2021-02-13T17:52:06.759 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.759 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.759 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.759 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.759 INFO:teuthology.orchestra.run.gibba025.stdout: "pg_num": { 2021-02-13T17:52:06.759 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "pg_num", 2021-02-13T17:52:06.759 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "int", 2021-02-13T17:52:06.759 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.759 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 1, 2021-02-13T17:52:06.759 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "128", 2021-02-13T17:52:06.759 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.759 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.759 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.760 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "default pg_num for any created local pool", 2021-02-13T17:52:06.760 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.760 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.760 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.760 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.760 INFO:teuthology.orchestra.run.gibba025.stdout: "prefix": { 2021-02-13T17:52:06.760 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "prefix", 2021-02-13T17:52:06.760 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "str", 2021-02-13T17:52:06.760 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.760 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 1, 2021-02-13T17:52:06.760 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "", 2021-02-13T17:52:06.760 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.760 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.760 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.761 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "name prefix for any created local pool", 2021-02-13T17:52:06.761 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.761 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.761 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.761 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.761 INFO:teuthology.orchestra.run.gibba025.stdout: "subtree": { 2021-02-13T17:52:06.761 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "subtree", 2021-02-13T17:52:06.761 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "str", 2021-02-13T17:52:06.761 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.761 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 1, 2021-02-13T17:52:06.761 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "rack", 2021-02-13T17:52:06.761 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.761 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.761 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.762 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "CRUSH level for which to create a local pool", 2021-02-13T17:52:06.762 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.762 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.762 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.762 INFO:teuthology.orchestra.run.gibba025.stdout: } 2021-02-13T17:52:06.762 INFO:teuthology.orchestra.run.gibba025.stdout: } 2021-02-13T17:52:06.762 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.762 INFO:teuthology.orchestra.run.gibba025.stdout: { 2021-02-13T17:52:06.762 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "orchestrator_cli", 2021-02-13T17:52:06.762 INFO:teuthology.orchestra.run.gibba025.stdout: "can_run": true, 2021-02-13T17:52:06.762 INFO:teuthology.orchestra.run.gibba025.stdout: "error_string": "", 2021-02-13T17:52:06.762 INFO:teuthology.orchestra.run.gibba025.stdout: "module_options": { 2021-02-13T17:52:06.762 INFO:teuthology.orchestra.run.gibba025.stdout: "orchestrator": { 2021-02-13T17:52:06.763 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "orchestrator", 2021-02-13T17:52:06.763 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "str", 2021-02-13T17:52:06.763 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.763 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.763 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "", 2021-02-13T17:52:06.763 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.763 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.763 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.763 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.763 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.763 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.763 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.763 INFO:teuthology.orchestra.run.gibba025.stdout: } 2021-02-13T17:52:06.763 INFO:teuthology.orchestra.run.gibba025.stdout: } 2021-02-13T17:52:06.764 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.764 INFO:teuthology.orchestra.run.gibba025.stdout: { 2021-02-13T17:52:06.764 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "pg_autoscaler", 2021-02-13T17:52:06.764 INFO:teuthology.orchestra.run.gibba025.stdout: "can_run": true, 2021-02-13T17:52:06.764 INFO:teuthology.orchestra.run.gibba025.stdout: "error_string": "", 2021-02-13T17:52:06.764 INFO:teuthology.orchestra.run.gibba025.stdout: "module_options": { 2021-02-13T17:52:06.764 INFO:teuthology.orchestra.run.gibba025.stdout: "sleep_interval": { 2021-02-13T17:52:06.764 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "sleep_interval", 2021-02-13T17:52:06.764 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "str", 2021-02-13T17:52:06.764 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.764 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.764 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "60", 2021-02-13T17:52:06.764 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.764 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.765 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.765 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.765 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.765 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.765 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.765 INFO:teuthology.orchestra.run.gibba025.stdout: } 2021-02-13T17:52:06.765 INFO:teuthology.orchestra.run.gibba025.stdout: } 2021-02-13T17:52:06.765 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.765 INFO:teuthology.orchestra.run.gibba025.stdout: { 2021-02-13T17:52:06.765 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "progress", 2021-02-13T17:52:06.765 INFO:teuthology.orchestra.run.gibba025.stdout: "can_run": true, 2021-02-13T17:52:06.765 INFO:teuthology.orchestra.run.gibba025.stdout: "error_string": "", 2021-02-13T17:52:06.765 INFO:teuthology.orchestra.run.gibba025.stdout: "module_options": { 2021-02-13T17:52:06.766 INFO:teuthology.orchestra.run.gibba025.stdout: "enabled": { 2021-02-13T17:52:06.766 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "enabled", 2021-02-13T17:52:06.766 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "bool", 2021-02-13T17:52:06.766 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.766 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.766 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "True", 2021-02-13T17:52:06.766 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.766 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.766 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.766 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.766 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.766 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.766 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.766 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.767 INFO:teuthology.orchestra.run.gibba025.stdout: "max_completed_events": { 2021-02-13T17:52:06.767 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "max_completed_events", 2021-02-13T17:52:06.767 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "int", 2021-02-13T17:52:06.767 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.767 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 1, 2021-02-13T17:52:06.767 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "50", 2021-02-13T17:52:06.767 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.767 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.767 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.767 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "number of past completed events to remember", 2021-02-13T17:52:06.767 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.767 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.767 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.767 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.768 INFO:teuthology.orchestra.run.gibba025.stdout: "persist_interval": { 2021-02-13T17:52:06.768 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "persist_interval", 2021-02-13T17:52:06.768 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "secs", 2021-02-13T17:52:06.768 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.768 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 1, 2021-02-13T17:52:06.768 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "5", 2021-02-13T17:52:06.768 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.768 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.768 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.768 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "how frequently to persist completed events", 2021-02-13T17:52:06.768 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.768 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.768 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.769 INFO:teuthology.orchestra.run.gibba025.stdout: } 2021-02-13T17:52:06.769 INFO:teuthology.orchestra.run.gibba025.stdout: } 2021-02-13T17:52:06.769 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.769 INFO:teuthology.orchestra.run.gibba025.stdout: { 2021-02-13T17:52:06.769 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "prometheus", 2021-02-13T17:52:06.769 INFO:teuthology.orchestra.run.gibba025.stdout: "can_run": true, 2021-02-13T17:52:06.769 INFO:teuthology.orchestra.run.gibba025.stdout: "error_string": "", 2021-02-13T17:52:06.769 INFO:teuthology.orchestra.run.gibba025.stdout: "module_options": { 2021-02-13T17:52:06.769 INFO:teuthology.orchestra.run.gibba025.stdout: "rbd_stats_pools": { 2021-02-13T17:52:06.769 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "rbd_stats_pools", 2021-02-13T17:52:06.769 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "str", 2021-02-13T17:52:06.769 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.769 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.769 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "", 2021-02-13T17:52:06.770 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.770 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.770 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.770 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.770 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.770 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.770 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.770 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.770 INFO:teuthology.orchestra.run.gibba025.stdout: "rbd_stats_pools_refresh_interval": { 2021-02-13T17:52:06.770 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "rbd_stats_pools_refresh_interval", 2021-02-13T17:52:06.770 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "int", 2021-02-13T17:52:06.770 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.770 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.770 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "300", 2021-02-13T17:52:06.771 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.771 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.771 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.771 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.771 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.771 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.771 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.771 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.771 INFO:teuthology.orchestra.run.gibba025.stdout: "scrape_interval": { 2021-02-13T17:52:06.771 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "scrape_interval", 2021-02-13T17:52:06.771 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "str", 2021-02-13T17:52:06.771 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.771 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.771 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "", 2021-02-13T17:52:06.772 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.772 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.772 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.772 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.772 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.772 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.772 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.772 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.772 INFO:teuthology.orchestra.run.gibba025.stdout: "server_addr": { 2021-02-13T17:52:06.772 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "server_addr", 2021-02-13T17:52:06.772 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "str", 2021-02-13T17:52:06.772 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.772 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.772 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "", 2021-02-13T17:52:06.773 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.773 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.773 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.773 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.773 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.773 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.773 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.773 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.773 INFO:teuthology.orchestra.run.gibba025.stdout: "server_port": { 2021-02-13T17:52:06.773 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "server_port", 2021-02-13T17:52:06.773 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "str", 2021-02-13T17:52:06.773 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.773 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.773 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "", 2021-02-13T17:52:06.774 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.774 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.774 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.774 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.774 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.774 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.774 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.774 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.774 INFO:teuthology.orchestra.run.gibba025.stdout: "stale_cache_strategy": { 2021-02-13T17:52:06.774 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "stale_cache_strategy", 2021-02-13T17:52:06.774 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "str", 2021-02-13T17:52:06.774 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.774 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.775 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "", 2021-02-13T17:52:06.775 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.775 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.775 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.775 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.775 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.775 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.775 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.775 INFO:teuthology.orchestra.run.gibba025.stdout: } 2021-02-13T17:52:06.775 INFO:teuthology.orchestra.run.gibba025.stdout: } 2021-02-13T17:52:06.775 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.775 INFO:teuthology.orchestra.run.gibba025.stdout: { 2021-02-13T17:52:06.775 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "rbd_support", 2021-02-13T17:52:06.775 INFO:teuthology.orchestra.run.gibba025.stdout: "can_run": true, 2021-02-13T17:52:06.776 INFO:teuthology.orchestra.run.gibba025.stdout: "error_string": "", 2021-02-13T17:52:06.776 INFO:teuthology.orchestra.run.gibba025.stdout: "module_options": {} 2021-02-13T17:52:06.776 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.776 INFO:teuthology.orchestra.run.gibba025.stdout: { 2021-02-13T17:52:06.776 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "restful", 2021-02-13T17:52:06.776 INFO:teuthology.orchestra.run.gibba025.stdout: "can_run": true, 2021-02-13T17:52:06.776 INFO:teuthology.orchestra.run.gibba025.stdout: "error_string": "", 2021-02-13T17:52:06.776 INFO:teuthology.orchestra.run.gibba025.stdout: "module_options": { 2021-02-13T17:52:06.776 INFO:teuthology.orchestra.run.gibba025.stdout: "key_file": { 2021-02-13T17:52:06.776 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "key_file", 2021-02-13T17:52:06.776 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "str", 2021-02-13T17:52:06.776 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.776 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.776 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "", 2021-02-13T17:52:06.777 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.777 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.777 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.777 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.777 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.777 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.777 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.777 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.777 INFO:teuthology.orchestra.run.gibba025.stdout: "server_addr": { 2021-02-13T17:52:06.777 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "server_addr", 2021-02-13T17:52:06.777 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "str", 2021-02-13T17:52:06.777 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.777 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.777 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "", 2021-02-13T17:52:06.778 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.778 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.778 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.778 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.778 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.778 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.778 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.778 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.778 INFO:teuthology.orchestra.run.gibba025.stdout: "server_port": { 2021-02-13T17:52:06.778 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "server_port", 2021-02-13T17:52:06.778 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "str", 2021-02-13T17:52:06.778 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.778 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.778 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "", 2021-02-13T17:52:06.779 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.779 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.779 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.779 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.779 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.779 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.779 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.779 INFO:teuthology.orchestra.run.gibba025.stdout: } 2021-02-13T17:52:06.779 INFO:teuthology.orchestra.run.gibba025.stdout: } 2021-02-13T17:52:06.779 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.779 INFO:teuthology.orchestra.run.gibba025.stdout: { 2021-02-13T17:52:06.779 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "rook", 2021-02-13T17:52:06.779 INFO:teuthology.orchestra.run.gibba025.stdout: "can_run": true, 2021-02-13T17:52:06.779 INFO:teuthology.orchestra.run.gibba025.stdout: "error_string": "", 2021-02-13T17:52:06.780 INFO:teuthology.orchestra.run.gibba025.stdout: "module_options": {} 2021-02-13T17:52:06.780 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.780 INFO:teuthology.orchestra.run.gibba025.stdout: { 2021-02-13T17:52:06.780 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "selftest", 2021-02-13T17:52:06.780 INFO:teuthology.orchestra.run.gibba025.stdout: "can_run": true, 2021-02-13T17:52:06.780 INFO:teuthology.orchestra.run.gibba025.stdout: "error_string": "", 2021-02-13T17:52:06.780 INFO:teuthology.orchestra.run.gibba025.stdout: "module_options": { 2021-02-13T17:52:06.780 INFO:teuthology.orchestra.run.gibba025.stdout: "roption1": { 2021-02-13T17:52:06.780 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "roption1", 2021-02-13T17:52:06.780 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "str", 2021-02-13T17:52:06.780 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.780 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.780 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "", 2021-02-13T17:52:06.781 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.781 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.781 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.781 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.781 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.781 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.781 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.781 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.781 INFO:teuthology.orchestra.run.gibba025.stdout: "roption2": { 2021-02-13T17:52:06.781 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "roption2", 2021-02-13T17:52:06.781 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "str", 2021-02-13T17:52:06.781 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.781 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.781 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "xyz", 2021-02-13T17:52:06.781 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.782 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.782 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.782 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.782 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.782 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.782 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.782 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.782 INFO:teuthology.orchestra.run.gibba025.stdout: "rwoption1": { 2021-02-13T17:52:06.782 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "rwoption1", 2021-02-13T17:52:06.782 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "str", 2021-02-13T17:52:06.782 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.782 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.782 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "", 2021-02-13T17:52:06.783 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.783 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.783 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.783 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.783 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.783 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.783 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.783 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.783 INFO:teuthology.orchestra.run.gibba025.stdout: "rwoption2": { 2021-02-13T17:52:06.783 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "rwoption2", 2021-02-13T17:52:06.783 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "int", 2021-02-13T17:52:06.783 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.783 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.783 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "", 2021-02-13T17:52:06.784 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.784 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.784 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.784 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.784 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.784 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.784 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.784 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.784 INFO:teuthology.orchestra.run.gibba025.stdout: "rwoption3": { 2021-02-13T17:52:06.784 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "rwoption3", 2021-02-13T17:52:06.784 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "float", 2021-02-13T17:52:06.784 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.784 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.784 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "", 2021-02-13T17:52:06.785 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.785 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.785 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.785 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.785 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.785 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.785 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.785 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.785 INFO:teuthology.orchestra.run.gibba025.stdout: "rwoption4": { 2021-02-13T17:52:06.785 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "rwoption4", 2021-02-13T17:52:06.785 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "str", 2021-02-13T17:52:06.785 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.785 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.785 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "", 2021-02-13T17:52:06.786 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.786 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.786 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.786 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.786 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.786 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.786 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.786 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.786 INFO:teuthology.orchestra.run.gibba025.stdout: "rwoption5": { 2021-02-13T17:52:06.786 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "rwoption5", 2021-02-13T17:52:06.786 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "bool", 2021-02-13T17:52:06.786 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.786 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.786 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "", 2021-02-13T17:52:06.787 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.787 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.787 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.787 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.787 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.787 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.787 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.787 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.787 INFO:teuthology.orchestra.run.gibba025.stdout: "rwoption6": { 2021-02-13T17:52:06.787 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "rwoption6", 2021-02-13T17:52:06.787 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "bool", 2021-02-13T17:52:06.787 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.787 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.787 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "True", 2021-02-13T17:52:06.788 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.788 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.788 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.788 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.788 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.788 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.788 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.788 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.788 INFO:teuthology.orchestra.run.gibba025.stdout: "testkey": { 2021-02-13T17:52:06.788 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "testkey", 2021-02-13T17:52:06.788 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "str", 2021-02-13T17:52:06.788 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.788 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.788 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "", 2021-02-13T17:52:06.789 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.789 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.789 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.789 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.789 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.789 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.789 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.789 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.789 INFO:teuthology.orchestra.run.gibba025.stdout: "testlkey": { 2021-02-13T17:52:06.789 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "testlkey", 2021-02-13T17:52:06.789 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "str", 2021-02-13T17:52:06.789 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.789 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.789 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "", 2021-02-13T17:52:06.790 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.790 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.790 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.790 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.790 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.790 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.790 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.790 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.790 INFO:teuthology.orchestra.run.gibba025.stdout: "testnewline": { 2021-02-13T17:52:06.790 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "testnewline", 2021-02-13T17:52:06.790 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "str", 2021-02-13T17:52:06.790 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.790 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.790 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "", 2021-02-13T17:52:06.791 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.791 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.791 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.791 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.791 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.791 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.791 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.791 INFO:teuthology.orchestra.run.gibba025.stdout: } 2021-02-13T17:52:06.791 INFO:teuthology.orchestra.run.gibba025.stdout: } 2021-02-13T17:52:06.791 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.791 INFO:teuthology.orchestra.run.gibba025.stdout: { 2021-02-13T17:52:06.791 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "ssh", 2021-02-13T17:52:06.791 INFO:teuthology.orchestra.run.gibba025.stdout: "can_run": true, 2021-02-13T17:52:06.792 INFO:teuthology.orchestra.run.gibba025.stdout: "error_string": "", 2021-02-13T17:52:06.792 INFO:teuthology.orchestra.run.gibba025.stdout: "module_options": { 2021-02-13T17:52:06.792 INFO:teuthology.orchestra.run.gibba025.stdout: "inventory_cache_timeout_min": { 2021-02-13T17:52:06.792 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "inventory_cache_timeout_min", 2021-02-13T17:52:06.792 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "str", 2021-02-13T17:52:06.792 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.792 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.792 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "", 2021-02-13T17:52:06.792 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.792 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.792 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.792 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.792 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.793 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.793 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.793 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.793 INFO:teuthology.orchestra.run.gibba025.stdout: "ssh_config_file": { 2021-02-13T17:52:06.793 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "ssh_config_file", 2021-02-13T17:52:06.793 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "str", 2021-02-13T17:52:06.793 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.793 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.793 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "", 2021-02-13T17:52:06.793 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.793 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.793 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.793 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.793 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.794 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.794 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.794 INFO:teuthology.orchestra.run.gibba025.stdout: } 2021-02-13T17:52:06.794 INFO:teuthology.orchestra.run.gibba025.stdout: } 2021-02-13T17:52:06.794 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.794 INFO:teuthology.orchestra.run.gibba025.stdout: { 2021-02-13T17:52:06.794 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "status", 2021-02-13T17:52:06.794 INFO:teuthology.orchestra.run.gibba025.stdout: "can_run": true, 2021-02-13T17:52:06.794 INFO:teuthology.orchestra.run.gibba025.stdout: "error_string": "", 2021-02-13T17:52:06.794 INFO:teuthology.orchestra.run.gibba025.stdout: "module_options": {} 2021-02-13T17:52:06.794 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.794 INFO:teuthology.orchestra.run.gibba025.stdout: { 2021-02-13T17:52:06.794 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "telegraf", 2021-02-13T17:52:06.794 INFO:teuthology.orchestra.run.gibba025.stdout: "can_run": true, 2021-02-13T17:52:06.795 INFO:teuthology.orchestra.run.gibba025.stdout: "error_string": "", 2021-02-13T17:52:06.795 INFO:teuthology.orchestra.run.gibba025.stdout: "module_options": { 2021-02-13T17:52:06.795 INFO:teuthology.orchestra.run.gibba025.stdout: "address": { 2021-02-13T17:52:06.795 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "address", 2021-02-13T17:52:06.795 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "str", 2021-02-13T17:52:06.795 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.795 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.795 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2021-02-13T17:52:06.795 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.795 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.795 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.795 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.795 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.795 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.796 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.796 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.796 INFO:teuthology.orchestra.run.gibba025.stdout: "interval": { 2021-02-13T17:52:06.796 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "interval", 2021-02-13T17:52:06.796 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "secs", 2021-02-13T17:52:06.796 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.796 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.796 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "15", 2021-02-13T17:52:06.796 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.796 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.796 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.796 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.796 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.796 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.797 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.797 INFO:teuthology.orchestra.run.gibba025.stdout: } 2021-02-13T17:52:06.797 INFO:teuthology.orchestra.run.gibba025.stdout: } 2021-02-13T17:52:06.797 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.797 INFO:teuthology.orchestra.run.gibba025.stdout: { 2021-02-13T17:52:06.797 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "telemetry", 2021-02-13T17:52:06.797 INFO:teuthology.orchestra.run.gibba025.stdout: "can_run": true, 2021-02-13T17:52:06.797 INFO:teuthology.orchestra.run.gibba025.stdout: "error_string": "", 2021-02-13T17:52:06.797 INFO:teuthology.orchestra.run.gibba025.stdout: "module_options": { 2021-02-13T17:52:06.797 INFO:teuthology.orchestra.run.gibba025.stdout: "channel_basic": { 2021-02-13T17:52:06.797 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "channel_basic", 2021-02-13T17:52:06.797 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "bool", 2021-02-13T17:52:06.797 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.797 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.798 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "True", 2021-02-13T17:52:06.798 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.798 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.798 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.798 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "Share basic cluster information (size, version)", 2021-02-13T17:52:06.798 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.798 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.798 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.798 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.798 INFO:teuthology.orchestra.run.gibba025.stdout: "channel_crash": { 2021-02-13T17:52:06.798 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "channel_crash", 2021-02-13T17:52:06.798 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "bool", 2021-02-13T17:52:06.798 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.798 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.799 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "True", 2021-02-13T17:52:06.799 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.799 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.799 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.799 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.799 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.799 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.799 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.799 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.799 INFO:teuthology.orchestra.run.gibba025.stdout: "channel_device": { 2021-02-13T17:52:06.799 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "channel_device", 2021-02-13T17:52:06.799 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "bool", 2021-02-13T17:52:06.799 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.800 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.800 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "True", 2021-02-13T17:52:06.800 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.800 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.800 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.800 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.800 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.800 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.800 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.800 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.800 INFO:teuthology.orchestra.run.gibba025.stdout: "channel_ident": { 2021-02-13T17:52:06.800 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "channel_ident", 2021-02-13T17:52:06.800 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "bool", 2021-02-13T17:52:06.800 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.801 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.801 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "False", 2021-02-13T17:52:06.801 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.801 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.801 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.801 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.801 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.801 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.801 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.801 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.801 INFO:teuthology.orchestra.run.gibba025.stdout: "contact": { 2021-02-13T17:52:06.801 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "contact", 2021-02-13T17:52:06.801 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "str", 2021-02-13T17:52:06.801 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.802 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.802 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "None", 2021-02-13T17:52:06.802 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.802 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.802 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.802 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.802 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.802 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.802 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.802 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.802 INFO:teuthology.orchestra.run.gibba025.stdout: "description": { 2021-02-13T17:52:06.802 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "description", 2021-02-13T17:52:06.802 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "str", 2021-02-13T17:52:06.802 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.803 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.803 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "None", 2021-02-13T17:52:06.803 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.803 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.803 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.803 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.803 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.803 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.803 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.803 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.803 INFO:teuthology.orchestra.run.gibba025.stdout: "device_url": { 2021-02-13T17:52:06.803 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "device_url", 2021-02-13T17:52:06.803 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "str", 2021-02-13T17:52:06.803 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.804 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.804 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "https://telemetry.ceph.com/device", 2021-02-13T17:52:06.804 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.804 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.804 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.804 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.804 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.804 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.804 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.804 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.804 INFO:teuthology.orchestra.run.gibba025.stdout: "enabled": { 2021-02-13T17:52:06.804 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "enabled", 2021-02-13T17:52:06.804 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "bool", 2021-02-13T17:52:06.804 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.805 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.805 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "False", 2021-02-13T17:52:06.805 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.805 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.805 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.805 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.805 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.805 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.805 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.805 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.805 INFO:teuthology.orchestra.run.gibba025.stdout: "interval": { 2021-02-13T17:52:06.805 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "interval", 2021-02-13T17:52:06.805 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "int", 2021-02-13T17:52:06.805 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.806 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.806 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "24", 2021-02-13T17:52:06.806 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "8", 2021-02-13T17:52:06.806 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.806 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.806 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.806 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.806 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.806 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.806 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.806 INFO:teuthology.orchestra.run.gibba025.stdout: "last_opt_revision": { 2021-02-13T17:52:06.806 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "last_opt_revision", 2021-02-13T17:52:06.806 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "int", 2021-02-13T17:52:06.806 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.807 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.807 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "1", 2021-02-13T17:52:06.807 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.807 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.807 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.807 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.807 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.807 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.807 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.807 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.807 INFO:teuthology.orchestra.run.gibba025.stdout: "leaderboard": { 2021-02-13T17:52:06.807 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "leaderboard", 2021-02-13T17:52:06.807 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "bool", 2021-02-13T17:52:06.808 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.808 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.808 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "False", 2021-02-13T17:52:06.808 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.808 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.808 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.808 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.808 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.808 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.808 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.808 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.808 INFO:teuthology.orchestra.run.gibba025.stdout: "organization": { 2021-02-13T17:52:06.808 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "organization", 2021-02-13T17:52:06.808 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "str", 2021-02-13T17:52:06.809 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.809 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.809 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "None", 2021-02-13T17:52:06.809 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.809 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.809 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.809 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.809 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.809 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.809 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.809 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.809 INFO:teuthology.orchestra.run.gibba025.stdout: "proxy": { 2021-02-13T17:52:06.809 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "proxy", 2021-02-13T17:52:06.809 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "str", 2021-02-13T17:52:06.810 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.810 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.810 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "None", 2021-02-13T17:52:06.810 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.810 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.810 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.810 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.810 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.810 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.810 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.810 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.810 INFO:teuthology.orchestra.run.gibba025.stdout: "url": { 2021-02-13T17:52:06.810 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "url", 2021-02-13T17:52:06.811 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "str", 2021-02-13T17:52:06.811 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.811 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.811 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "https://telemetry.ceph.com/report", 2021-02-13T17:52:06.811 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.811 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.811 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.811 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.811 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.811 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.811 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.811 INFO:teuthology.orchestra.run.gibba025.stdout: } 2021-02-13T17:52:06.811 INFO:teuthology.orchestra.run.gibba025.stdout: } 2021-02-13T17:52:06.811 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.812 INFO:teuthology.orchestra.run.gibba025.stdout: { 2021-02-13T17:52:06.812 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "test_orchestrator", 2021-02-13T17:52:06.812 INFO:teuthology.orchestra.run.gibba025.stdout: "can_run": true, 2021-02-13T17:52:06.812 INFO:teuthology.orchestra.run.gibba025.stdout: "error_string": "", 2021-02-13T17:52:06.812 INFO:teuthology.orchestra.run.gibba025.stdout: "module_options": {} 2021-02-13T17:52:06.812 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.812 INFO:teuthology.orchestra.run.gibba025.stdout: { 2021-02-13T17:52:06.812 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "volumes", 2021-02-13T17:52:06.812 INFO:teuthology.orchestra.run.gibba025.stdout: "can_run": true, 2021-02-13T17:52:06.812 INFO:teuthology.orchestra.run.gibba025.stdout: "error_string": "", 2021-02-13T17:52:06.812 INFO:teuthology.orchestra.run.gibba025.stdout: "module_options": { 2021-02-13T17:52:06.812 INFO:teuthology.orchestra.run.gibba025.stdout: "max_concurrent_clones": { 2021-02-13T17:52:06.812 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "max_concurrent_clones", 2021-02-13T17:52:06.812 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "int", 2021-02-13T17:52:06.813 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.813 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.813 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "4", 2021-02-13T17:52:06.813 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.813 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.813 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.813 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "Number of asynchronous cloner threads", 2021-02-13T17:52:06.813 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.813 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.813 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.813 INFO:teuthology.orchestra.run.gibba025.stdout: } 2021-02-13T17:52:06.813 INFO:teuthology.orchestra.run.gibba025.stdout: } 2021-02-13T17:52:06.813 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.813 INFO:teuthology.orchestra.run.gibba025.stdout: { 2021-02-13T17:52:06.814 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "zabbix", 2021-02-13T17:52:06.814 INFO:teuthology.orchestra.run.gibba025.stdout: "can_run": true, 2021-02-13T17:52:06.814 INFO:teuthology.orchestra.run.gibba025.stdout: "error_string": "", 2021-02-13T17:52:06.814 INFO:teuthology.orchestra.run.gibba025.stdout: "module_options": { 2021-02-13T17:52:06.814 INFO:teuthology.orchestra.run.gibba025.stdout: "identifier": { 2021-02-13T17:52:06.814 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "identifier", 2021-02-13T17:52:06.814 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "str", 2021-02-13T17:52:06.814 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.814 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.814 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "", 2021-02-13T17:52:06.814 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.814 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.814 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.814 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.815 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.815 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.815 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.815 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.815 INFO:teuthology.orchestra.run.gibba025.stdout: "interval": { 2021-02-13T17:52:06.815 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "interval", 2021-02-13T17:52:06.815 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "secs", 2021-02-13T17:52:06.815 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.815 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.815 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "60", 2021-02-13T17:52:06.815 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.815 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.815 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.815 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.816 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.816 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.816 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.816 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.816 INFO:teuthology.orchestra.run.gibba025.stdout: "zabbix_host": { 2021-02-13T17:52:06.816 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "zabbix_host", 2021-02-13T17:52:06.816 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "str", 2021-02-13T17:52:06.816 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.816 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.816 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "None", 2021-02-13T17:52:06.816 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.816 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.816 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.817 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.817 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.817 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.817 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.817 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.817 INFO:teuthology.orchestra.run.gibba025.stdout: "zabbix_port": { 2021-02-13T17:52:06.817 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "zabbix_port", 2021-02-13T17:52:06.817 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "int", 2021-02-13T17:52:06.817 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.817 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.817 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "10051", 2021-02-13T17:52:06.817 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.817 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.817 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.817 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.818 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.818 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.818 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.818 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.818 INFO:teuthology.orchestra.run.gibba025.stdout: "zabbix_sender": { 2021-02-13T17:52:06.818 INFO:teuthology.orchestra.run.gibba025.stdout: "name": "zabbix_sender", 2021-02-13T17:52:06.818 INFO:teuthology.orchestra.run.gibba025.stdout: "type": "str", 2021-02-13T17:52:06.818 INFO:teuthology.orchestra.run.gibba025.stdout: "level": "advanced", 2021-02-13T17:52:06.818 INFO:teuthology.orchestra.run.gibba025.stdout: "flags": 0, 2021-02-13T17:52:06.818 INFO:teuthology.orchestra.run.gibba025.stdout: "default_value": "/usr/bin/zabbix_sender", 2021-02-13T17:52:06.818 INFO:teuthology.orchestra.run.gibba025.stdout: "min": "", 2021-02-13T17:52:06.818 INFO:teuthology.orchestra.run.gibba025.stdout: "max": "", 2021-02-13T17:52:06.818 INFO:teuthology.orchestra.run.gibba025.stdout: "enum_allowed": [], 2021-02-13T17:52:06.819 INFO:teuthology.orchestra.run.gibba025.stdout: "desc": "", 2021-02-13T17:52:06.819 INFO:teuthology.orchestra.run.gibba025.stdout: "long_desc": "", 2021-02-13T17:52:06.819 INFO:teuthology.orchestra.run.gibba025.stdout: "tags": [], 2021-02-13T17:52:06.819 INFO:teuthology.orchestra.run.gibba025.stdout: "see_also": [] 2021-02-13T17:52:06.819 INFO:teuthology.orchestra.run.gibba025.stdout: } 2021-02-13T17:52:06.819 INFO:teuthology.orchestra.run.gibba025.stdout: } 2021-02-13T17:52:06.819 INFO:teuthology.orchestra.run.gibba025.stdout: } 2021-02-13T17:52:06.819 INFO:teuthology.orchestra.run.gibba025.stdout: ], 2021-02-13T17:52:06.819 INFO:teuthology.orchestra.run.gibba025.stdout: "services": {}, 2021-02-13T17:52:06.819 INFO:teuthology.orchestra.run.gibba025.stdout: "always_on_modules": { 2021-02-13T17:52:06.819 INFO:teuthology.orchestra.run.gibba025.stdout: "nautilus": [ 2021-02-13T17:52:06.819 INFO:teuthology.orchestra.run.gibba025.stdout: "balancer", 2021-02-13T17:52:06.819 INFO:teuthology.orchestra.run.gibba025.stdout: "crash", 2021-02-13T17:52:06.819 INFO:teuthology.orchestra.run.gibba025.stdout: "devicehealth", 2021-02-13T17:52:06.820 INFO:teuthology.orchestra.run.gibba025.stdout: "orchestrator_cli", 2021-02-13T17:52:06.820 INFO:teuthology.orchestra.run.gibba025.stdout: "progress", 2021-02-13T17:52:06.820 INFO:teuthology.orchestra.run.gibba025.stdout: "rbd_support", 2021-02-13T17:52:06.820 INFO:teuthology.orchestra.run.gibba025.stdout: "status", 2021-02-13T17:52:06.820 INFO:teuthology.orchestra.run.gibba025.stdout: "volumes" 2021-02-13T17:52:06.820 INFO:teuthology.orchestra.run.gibba025.stdout: ] 2021-02-13T17:52:06.820 INFO:teuthology.orchestra.run.gibba025.stdout: } 2021-02-13T17:52:06.820 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.820 INFO:teuthology.orchestra.run.gibba025.stdout: "servicemap": { 2021-02-13T17:52:06.820 INFO:teuthology.orchestra.run.gibba025.stdout: "epoch": 1, 2021-02-13T17:52:06.820 INFO:teuthology.orchestra.run.gibba025.stdout: "modified": "0.000000", 2021-02-13T17:52:06.820 INFO:teuthology.orchestra.run.gibba025.stdout: "services": {} 2021-02-13T17:52:06.820 INFO:teuthology.orchestra.run.gibba025.stdout: }, 2021-02-13T17:52:06.820 INFO:teuthology.orchestra.run.gibba025.stdout: "progress_events": {} 2021-02-13T17:52:06.821 INFO:teuthology.orchestra.run.gibba025.stdout:} 2021-02-13T17:52:06.822 INFO:tasks.ceph.ceph_manager.c1:{'fsid': 'bed73c08-798c-4f38-a3f3-1bfc03039602', 'health': {'checks': {}, 'status': 'HEALTH_OK'}, 'election_epoch': 3, 'quorum': [0], 'quorum_names': ['a'], 'quorum_age': 13, 'monmap': {'epoch': 1, 'min_mon_release_name': '14', 'num_mons': 1}, 'osdmap': {'osdmap': {'epoch': 11, 'num_osds': 3, 'num_up_osds': 3, 'num_in_osds': 3, 'num_remapped_pgs': 0}}, 'pgmap': {'pgs_by_state': [{'state_name': 'active+clean', 'count': 8}], 'num_pgs': 8, 'num_pools': 1, 'num_objects': 0, 'data_bytes': 0, 'bytes_used': 3221528576, 'bytes_avail': 318901018624, 'bytes_total': 322122547200}, 'fsmap': {'epoch': 1, 'by_rank': [], 'up:standby': 0}, 'mgrmap': {'epoch': 3, 'active_gid': 4098, 'active_name': 'x', 'active_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.125:6824', 'nonce': 13998}, {'type': 'v1', 'addr': '172.21.2.125:6825', 'nonce': 13998}]}, 'active_addr': '172.21.2.125:6825/13998', 'active_change': '2021-02-13 17:51:54.888096', 'available': True, 'standbys': [], 'modules': ['iostat', 'restful'], 'available_modules': [{'name': 'alerts', 'can_run': True, 'error_string': '', 'module_options': {'interval': {'name': 'interval', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '60', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'How frequently to reexamine health status', 'long_desc': '', 'tags': [], 'see_also': []}, 'smtp_destination': {'name': 'smtp_destination', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'Email address to send alerts to', 'long_desc': '', 'tags': [], 'see_also': []}, 'smtp_from_name': {'name': 'smtp_from_name', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': 'Ceph', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'Email From: name', 'long_desc': '', 'tags': [], 'see_also': []}, 'smtp_host': {'name': 'smtp_host', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'SMTP server', 'long_desc': '', 'tags': [], 'see_also': []}, 'smtp_password': {'name': 'smtp_password', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'Password to authenticate with', 'long_desc': '', 'tags': [], 'see_also': []}, 'smtp_port': {'name': 'smtp_port', 'type': 'int', 'level': 'advanced', 'flags': 1, 'default_value': '465', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'SMTP port', 'long_desc': '', 'tags': [], 'see_also': []}, 'smtp_sender': {'name': 'smtp_sender', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'SMTP envelope sender', 'long_desc': '', 'tags': [], 'see_also': []}, 'smtp_ssl': {'name': 'smtp_ssl', 'type': 'bool', 'level': 'advanced', 'flags': 1, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'Use SSL to connect to SMTP server', 'long_desc': '', 'tags': [], 'see_also': []}, 'smtp_user': {'name': 'smtp_user', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'User to authenticate as', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'ansible', 'can_run': True, 'error_string': '', 'module_options': {'password': {'name': 'password', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'server_url': {'name': 'server_url', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'username': {'name': 'username', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'verify_server': {'name': 'verify_server', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'balancer', 'can_run': True, 'error_string': '', 'module_options': {'active': {'name': 'active', 'type': 'bool', 'level': 'advanced', 'flags': 1, 'default_value': 'False', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'automatically balance PGs across cluster', 'long_desc': '', 'tags': [], 'see_also': []}, 'begin_time': {'name': 'begin_time', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': '0000', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'beginning time of day to automatically balance', 'long_desc': 'This is a time of day in the format HHMM.', 'tags': [], 'see_also': []}, 'begin_weekday': {'name': 'begin_weekday', 'type': 'uint', 'level': 'advanced', 'flags': 1, 'default_value': '0', 'min': '0', 'max': '7', 'enum_allowed': [], 'desc': 'Restrict automatic balancing to this day of the week or later', 'long_desc': '0 or 7 = Sunday, 1 = Monday, etc.', 'tags': [], 'see_also': []}, 'crush_compat_max_iterations': {'name': 'crush_compat_max_iterations', 'type': 'uint', 'level': 'advanced', 'flags': 1, 'default_value': '25', 'min': '1', 'max': '250', 'enum_allowed': [], 'desc': 'maximum number of iterations to attempt optimization', 'long_desc': '', 'tags': [], 'see_also': []}, 'crush_compat_metrics': {'name': 'crush_compat_metrics', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': 'pgs,objects,bytes', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'metrics with which to calculate OSD utilization', 'long_desc': 'Value is a list of one or more of "pgs", "objects", or "bytes", and indicates which metrics to use to balance utilization.', 'tags': [], 'see_also': []}, 'crush_compat_step': {'name': 'crush_compat_step', 'type': 'float', 'level': 'advanced', 'flags': 1, 'default_value': '0.5', 'min': '0.001', 'max': '0.999', 'enum_allowed': [], 'desc': 'aggressiveness of optimization', 'long_desc': '.99 is very aggressive, .01 is less aggressive', 'tags': [], 'see_also': []}, 'end_time': {'name': 'end_time', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': '2400', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'ending time of day to automatically balance', 'long_desc': 'This is a time of day in the format HHMM.', 'tags': [], 'see_also': []}, 'end_weekday': {'name': 'end_weekday', 'type': 'uint', 'level': 'advanced', 'flags': 1, 'default_value': '7', 'min': '0', 'max': '7', 'enum_allowed': [], 'desc': 'Restrict automatic balancing to days of the week earlier than this', 'long_desc': '0 or 7 = Sunday, 1 = Monday, etc.', 'tags': [], 'see_also': []}, 'min_score': {'name': 'min_score', 'type': 'float', 'level': 'advanced', 'flags': 1, 'default_value': '0', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'minimum score, below which no optimization is attempted', 'long_desc': '', 'tags': [], 'see_also': []}, 'mode': {'name': 'mode', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': 'none', 'min': '', 'max': '', 'enum_allowed': ['crush-compat', 'none', 'upmap'], 'desc': 'Balancer mode', 'long_desc': '', 'tags': [], 'see_also': []}, 'pool_ids': {'name': 'pool_ids', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'pools which the automatic balancing will be limited to', 'long_desc': '', 'tags': [], 'see_also': []}, 'sleep_interval': {'name': 'sleep_interval', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '60', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'how frequently to wake up and attempt optimization', 'long_desc': '', 'tags': [], 'see_also': []}, 'upmap_max_deviation': {'name': 'upmap_max_deviation', 'type': 'int', 'level': 'advanced', 'flags': 1, 'default_value': '5', 'min': '1', 'max': '', 'enum_allowed': [], 'desc': 'deviation below which no optimization is attempted', 'long_desc': 'If the number of PGs are within this count then no optimization is attempted', 'tags': [], 'see_also': []}, 'upmap_max_iterations': {'name': 'upmap_max_iterations', 'type': 'uint', 'level': 'advanced', 'flags': 1, 'default_value': '10', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'maximum upmap optimization iterations', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'crash', 'can_run': True, 'error_string': '', 'module_options': {'retain_interval': {'name': 'retain_interval', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '31536000', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'how long to retain crashes before pruning them', 'long_desc': '', 'tags': [], 'see_also': []}, 'warn_recent_interval': {'name': 'warn_recent_interval', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '1209600', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'time interval in which to warn about recent crashes', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'dashboard', 'can_run': True, 'error_string': '', 'module_options': {'ALERTMANAGER_API_HOST': {'name': 'ALERTMANAGER_API_HOST', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'AUDIT_API_ENABLED': {'name': 'AUDIT_API_ENABLED', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'False', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'AUDIT_API_LOG_PAYLOAD': {'name': 'AUDIT_API_LOG_PAYLOAD', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'ENABLE_BROWSABLE_API': {'name': 'ENABLE_BROWSABLE_API', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'FEATURE_TOGGLE_cephfs': {'name': 'FEATURE_TOGGLE_cephfs', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'FEATURE_TOGGLE_iscsi': {'name': 'FEATURE_TOGGLE_iscsi', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'FEATURE_TOGGLE_mirroring': {'name': 'FEATURE_TOGGLE_mirroring', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'FEATURE_TOGGLE_rbd': {'name': 'FEATURE_TOGGLE_rbd', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'FEATURE_TOGGLE_rgw': {'name': 'FEATURE_TOGGLE_rgw', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE': {'name': 'GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'GRAFANA_API_PASSWORD': {'name': 'GRAFANA_API_PASSWORD', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'admin', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'GRAFANA_API_SSL_VERIFY': {'name': 'GRAFANA_API_SSL_VERIFY', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'GRAFANA_API_URL': {'name': 'GRAFANA_API_URL', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'GRAFANA_API_USERNAME': {'name': 'GRAFANA_API_USERNAME', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'admin', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'GRAFANA_FRONTEND_API_URL': {'name': 'GRAFANA_FRONTEND_API_URL', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'GRAFANA_UPDATE_DASHBOARDS': {'name': 'GRAFANA_UPDATE_DASHBOARDS', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'False', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'ISCSI_API_SSL_VERIFICATION': {'name': 'ISCSI_API_SSL_VERIFICATION', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'PROMETHEUS_API_HOST': {'name': 'PROMETHEUS_API_HOST', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'REST_REQUESTS_TIMEOUT': {'name': 'REST_REQUESTS_TIMEOUT', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '45', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'RGW_API_ACCESS_KEY': {'name': 'RGW_API_ACCESS_KEY', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'RGW_API_ADMIN_RESOURCE': {'name': 'RGW_API_ADMIN_RESOURCE', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'admin', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'RGW_API_HOST': {'name': 'RGW_API_HOST', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'RGW_API_PORT': {'name': 'RGW_API_PORT', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '80', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'RGW_API_SCHEME': {'name': 'RGW_API_SCHEME', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'http', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'RGW_API_SECRET_KEY': {'name': 'RGW_API_SECRET_KEY', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'RGW_API_SSL_VERIFY': {'name': 'RGW_API_SSL_VERIFY', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'RGW_API_USER_ID': {'name': 'RGW_API_USER_ID', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'crt_file': {'name': 'crt_file', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'debug': {'name': 'debug', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'False', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'Enable/disable debug options', 'long_desc': '', 'tags': [], 'see_also': []}, 'jwt_token_ttl': {'name': 'jwt_token_ttl', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '28800', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'key_file': {'name': 'key_file', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'password': {'name': 'password', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'server_addr': {'name': 'server_addr', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '::', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'server_port': {'name': 'server_port', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '8080', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'ssl': {'name': 'ssl', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'ssl_server_port': {'name': 'ssl_server_port', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '8443', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'standby_behaviour': {'name': 'standby_behaviour', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'redirect', 'min': '', 'max': '', 'enum_allowed': ['error', 'redirect'], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'standby_error_status_code': {'name': 'standby_error_status_code', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '500', 'min': '400', 'max': '599', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'url_prefix': {'name': 'url_prefix', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'username': {'name': 'username', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'deepsea', 'can_run': True, 'error_string': '', 'module_options': {'salt_api_eauth': {'name': 'salt_api_eauth', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'sharedsecret', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'salt_api_password': {'name': 'salt_api_password', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'salt_api_url': {'name': 'salt_api_url', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'salt_api_username': {'name': 'salt_api_username', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'devicehealth', 'can_run': True, 'error_string': '', 'module_options': {'enable_monitoring': {'name': 'enable_monitoring', 'type': 'bool', 'level': 'advanced', 'flags': 1, 'default_value': 'False', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'monitor device health metrics', 'long_desc': '', 'tags': [], 'see_also': []}, 'mark_out_threshold': {'name': 'mark_out_threshold', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '2419200', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'automatically mark OSD if it may fail before this long', 'long_desc': '', 'tags': [], 'see_also': []}, 'pool_name': {'name': 'pool_name', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': 'device_health_metrics', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'name of pool in which to store device health metrics', 'long_desc': '', 'tags': [], 'see_also': []}, 'retention_period': {'name': 'retention_period', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '15552000', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'how long to retain device health metrics', 'long_desc': '', 'tags': [], 'see_also': []}, 'scrape_frequency': {'name': 'scrape_frequency', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '86400', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'how frequently to scrape device health metrics', 'long_desc': '', 'tags': [], 'see_also': []}, 'self_heal': {'name': 'self_heal', 'type': 'bool', 'level': 'advanced', 'flags': 1, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'preemptively heal cluster around devices that may fail', 'long_desc': '', 'tags': [], 'see_also': []}, 'sleep_interval': {'name': 'sleep_interval', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '600', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'how frequently to wake up and check device health', 'long_desc': '', 'tags': [], 'see_also': []}, 'warn_threshold': {'name': 'warn_threshold', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '7257600', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'raise health warning if OSD may fail before this long', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'diskprediction_cloud', 'can_run': True, 'error_string': '', 'module_options': {'diskprediction_cert_context': {'name': 'diskprediction_cert_context', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'diskprediction_default_authority': {'name': 'diskprediction_default_authority', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'localhost', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'diskprediction_password': {'name': 'diskprediction_password', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'diskprediction_port': {'name': 'diskprediction_port', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '31400', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'diskprediction_retrieve_prediction_interval': {'name': 'diskprediction_retrieve_prediction_interval', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '43200', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'diskprediction_server': {'name': 'diskprediction_server', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'diskprediction_ssl_target_name_override': {'name': 'diskprediction_ssl_target_name_override', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'localhost', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'diskprediction_upload_metrics_interval': {'name': 'diskprediction_upload_metrics_interval', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '600', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'diskprediction_upload_smart_interval': {'name': 'diskprediction_upload_smart_interval', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '43200', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'diskprediction_user': {'name': 'diskprediction_user', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'sleep_interval': {'name': 'sleep_interval', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '600', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'diskprediction_local', 'can_run': True, 'error_string': '', 'module_options': {'predict_interval': {'name': 'predict_interval', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '86400', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'sleep_interval': {'name': 'sleep_interval', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '600', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'influx', 'can_run': False, 'error_string': 'influxdb python module not found', 'module_options': {'batch_size': {'name': 'batch_size', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '5000', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'database': {'name': 'database', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'ceph', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'hostname': {'name': 'hostname', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'None', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'interval': {'name': 'interval', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '30', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'password': {'name': 'password', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'None', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'port': {'name': 'port', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '8086', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'ssl': {'name': 'ssl', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'false', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'threads': {'name': 'threads', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '5', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'username': {'name': 'username', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'None', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'verify_ssl': {'name': 'verify_ssl', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'true', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'insights', 'can_run': True, 'error_string': '', 'module_options': {}}, {'name': 'iostat', 'can_run': True, 'error_string': '', 'module_options': {}}, {'name': 'localpool', 'can_run': True, 'error_string': '', 'module_options': {'failure_domain': {'name': 'failure_domain', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': 'host', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'failure domain for any created local pool', 'long_desc': '', 'tags': [], 'see_also': []}, 'min_size': {'name': 'min_size', 'type': 'int', 'level': 'advanced', 'flags': 1, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'default min_size for any created local pool', 'long_desc': '', 'tags': [], 'see_also': []}, 'num_rep': {'name': 'num_rep', 'type': 'int', 'level': 'advanced', 'flags': 1, 'default_value': '3', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'default replica count for any created local pool', 'long_desc': '', 'tags': [], 'see_also': []}, 'pg_num': {'name': 'pg_num', 'type': 'int', 'level': 'advanced', 'flags': 1, 'default_value': '128', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'default pg_num for any created local pool', 'long_desc': '', 'tags': [], 'see_also': []}, 'prefix': {'name': 'prefix', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'name prefix for any created local pool', 'long_desc': '', 'tags': [], 'see_also': []}, 'subtree': {'name': 'subtree', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': 'rack', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'CRUSH level for which to create a local pool', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'orchestrator_cli', 'can_run': True, 'error_string': '', 'module_options': {'orchestrator': {'name': 'orchestrator', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'pg_autoscaler', 'can_run': True, 'error_string': '', 'module_options': {'sleep_interval': {'name': 'sleep_interval', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '60', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'progress', 'can_run': True, 'error_string': '', 'module_options': {'enabled': {'name': 'enabled', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'max_completed_events': {'name': 'max_completed_events', 'type': 'int', 'level': 'advanced', 'flags': 1, 'default_value': '50', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'number of past completed events to remember', 'long_desc': '', 'tags': [], 'see_also': []}, 'persist_interval': {'name': 'persist_interval', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '5', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'how frequently to persist completed events', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'prometheus', 'can_run': True, 'error_string': '', 'module_options': {'rbd_stats_pools': {'name': 'rbd_stats_pools', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'rbd_stats_pools_refresh_interval': {'name': 'rbd_stats_pools_refresh_interval', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '300', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'scrape_interval': {'name': 'scrape_interval', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'server_addr': {'name': 'server_addr', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'server_port': {'name': 'server_port', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'stale_cache_strategy': {'name': 'stale_cache_strategy', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'rbd_support', 'can_run': True, 'error_string': '', 'module_options': {}}, {'name': 'restful', 'can_run': True, 'error_string': '', 'module_options': {'key_file': {'name': 'key_file', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'server_addr': {'name': 'server_addr', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'server_port': {'name': 'server_port', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'rook', 'can_run': True, 'error_string': '', 'module_options': {}}, {'name': 'selftest', 'can_run': True, 'error_string': '', 'module_options': {'roption1': {'name': 'roption1', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'roption2': {'name': 'roption2', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'xyz', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'rwoption1': {'name': 'rwoption1', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'rwoption2': {'name': 'rwoption2', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'rwoption3': {'name': 'rwoption3', 'type': 'float', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'rwoption4': {'name': 'rwoption4', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'rwoption5': {'name': 'rwoption5', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'rwoption6': {'name': 'rwoption6', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'testkey': {'name': 'testkey', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'testlkey': {'name': 'testlkey', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'testnewline': {'name': 'testnewline', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'ssh', 'can_run': True, 'error_string': '', 'module_options': {'inventory_cache_timeout_min': {'name': 'inventory_cache_timeout_min', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'ssh_config_file': {'name': 'ssh_config_file', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'status', 'can_run': True, 'error_string': '', 'module_options': {}}, {'name': 'telegraf', 'can_run': True, 'error_string': '', 'module_options': {'address': {'name': 'address', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'unixgram:///tmp/telegraf.sock', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'interval': {'name': 'interval', 'type': 'secs', 'level': 'advanced', 'flags': 0, 'default_value': '15', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'telemetry', 'can_run': True, 'error_string': '', 'module_options': {'channel_basic': {'name': 'channel_basic', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'Share basic cluster information (size, version)', 'long_desc': '', 'tags': [], 'see_also': []}, 'channel_crash': {'name': 'channel_crash', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'channel_device': {'name': 'channel_device', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'channel_ident': {'name': 'channel_ident', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'False', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'contact': {'name': 'contact', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'None', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'description': {'name': 'description', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'None', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'device_url': {'name': 'device_url', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'https://telemetry.ceph.com/device', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'enabled': {'name': 'enabled', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'False', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'interval': {'name': 'interval', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '24', 'min': '8', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'last_opt_revision': {'name': 'last_opt_revision', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '1', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'leaderboard': {'name': 'leaderboard', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'False', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'organization': {'name': 'organization', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'None', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'proxy': {'name': 'proxy', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'None', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'url': {'name': 'url', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'https://telemetry.ceph.com/report', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'test_orchestrator', 'can_run': True, 'error_string': '', 'module_options': {}}, {'name': 'volumes', 'can_run': True, 'error_string': '', 'module_options': {'max_concurrent_clones': {'name': 'max_concurrent_clones', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '4', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'Number of asynchronous cloner threads', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'zabbix', 'can_run': True, 'error_string': '', 'module_options': {'identifier': {'name': 'identifier', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'interval': {'name': 'interval', 'type': 'secs', 'level': 'advanced', 'flags': 0, 'default_value': '60', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'zabbix_host': {'name': 'zabbix_host', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'None', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'zabbix_port': {'name': 'zabbix_port', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '10051', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'zabbix_sender': {'name': 'zabbix_sender', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '/usr/bin/zabbix_sender', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}], 'services': {}, 'always_on_modules': {'nautilus': ['balancer', 'crash', 'devicehealth', 'orchestrator_cli', 'progress', 'rbd_support', 'status', 'volumes']}}, 'servicemap': {'epoch': 1, 'modified': '0.000000', 'services': {}}, 'progress_events': {}} 2021-02-13T17:52:06.823 INFO:tasks.ceph.ceph_manager.c1:clean! 2021-02-13T17:52:06.823 INFO:tasks.ceph:Waiting until ceph cluster c1 is healthy... 2021-02-13T17:52:06.823 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster c1 health 2021-02-13T17:52:06.984 INFO:teuthology.misc.health.gibba025.stdout:HEALTH_OK 2021-02-13T17:52:06.992 DEBUG:teuthology.misc:Ceph health: HEALTH_OK 2021-02-13T17:52:06.992 INFO:teuthology.run_tasks:Running task ceph... 2021-02-13T17:52:07.013 INFO:tasks.ceph:Creating ceph cluster c2... 2021-02-13T17:52:07.013 INFO:tasks.ceph:config {'conf': {'client': {'debug rgw': 20, 'rgw crypt require ssl': False, 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo=', 'rgw curl low speed time': 300, 'rgw data log num shards': 4, 'rgw md log max shards': 4, 'rgw sync log trim interval': 0, 'rgw sync obj etag verify': True}, 'global': {'osd heartbeat grace': 40}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon osd crush smoke test': False}, 'osd': {'debug filestore': 20, 'debug journal': 20, 'debug ms': 20, 'debug osd': 25, 'osd fast shutdown': False}, 'osd.0': {'osd_max_omap_entries_per_request': 10}, 'osd.1': {'osd_max_omap_entries_per_request': 1000}, 'osd.2': {'osd_max_omap_entries_per_request': 10000}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'cpu_profile': set(), 'cluster': 'c2', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2021-02-13T17:52:07.013 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2021-02-12_17:45:41-rgw-wip-yuri3-testing-2021-02-12-0757-nautilus-distro-basic-gibba/5877924', 'branch': 'wip-yuri3-testing-2021-02-12-0757-nautilus', 'description': 'rgw/multisite/{clusters frontend/civetweb omap_limits overrides realms/three-zone-plus-pubsub tasks/test_multi valgrind}', 'email': 'ceph-qa@ceph.io', 'first_in_suite': False, 'job_id': '5877924', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'gibba', 'name': 'yuriw-2021-02-12_17:45:41-rgw-wip-yuri3-testing-2021-02-12-0757-nautilus-distro-basic-gibba', 'nuke-on-error': True, 'os_type': 'ubuntu', 'overrides': {'admin_socket': {'branch': 'wip-yuri3-testing-2021-02-12-0757-nautilus'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'rgw crypt require ssl': False, 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo=', 'rgw curl low speed time': 300, 'rgw data log num shards': 4, 'rgw md log max shards': 4, 'rgw sync log trim interval': 0, 'rgw sync obj etag verify': True}, 'global': {'osd heartbeat grace': 40}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon osd crush smoke test': False}, 'osd': {'debug filestore': 20, 'debug journal': 20, 'debug ms': 20, 'debug osd': 25, 'osd fast shutdown': False}, 'osd.0': {'osd_max_omap_entries_per_request': 10}, 'osd.1': {'osd_max_omap_entries_per_request': 1000}, 'osd.2': {'osd_max_omap_entries_per_request': 10000}}, 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': '7194982cc16a1fd51df59ee58e1c54797c4465d1', 'wait-for-scrub': False}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}}}, 'install': {'ceph': {'sha1': '7194982cc16a1fd51df59ee58e1c54797c4465d1'}}, 'rgw': {'compression type': 'random', 'frontend': 'civetweb'}, 'rgw-multisite': {'realm': {'is default': True, 'name': 'test-realm'}, 'zonegroups': [{'endpoints': ['c1.client.0'], 'is_default': True, 'is_master': True, 'name': 'test-zonegroup', 'zones': [{'endpoints': ['c1.client.0'], 'is_default': True, 'is_master': True, 'name': 'test-zone1'}, {'endpoints': ['c2.client.0'], 'is_default': True, 'name': 'test-zone2'}, {'endpoints': ['c1.client.1'], 'name': 'test-zone3'}, {'endpoints': ['c2.client.1'], 'is_pubsub': True, 'name': 'test-zone4'}]}]}, 'workunit': {'branch': 'wip-yuri3-testing-2021-02-12-0757-nautilus', 'sha1': '7194982cc16a1fd51df59ee58e1c54797c4465d1'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 100, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['c1.mon.a', 'c1.mgr.x', 'c1.osd.0', 'c1.osd.1', 'c1.osd.2', 'c1.client.0', 'c1.client.1'], ['c2.mon.a', 'c2.mgr.x', 'c2.osd.0', 'c2.osd.1', 'c2.osd.2', 'c2.client.0', 'c2.client.1']], 'sha1': '7194982cc16a1fd51df59ee58e1c54797c4465d1', 'sleep_before_teardown': 0, 'suite': 'rgw', 'suite_branch': 'wip-yuri3-testing-2021-02-12-0757-nautilus', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_7194982cc16a1fd51df59ee58e1c54797c4465d1/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '7194982cc16a1fd51df59ee58e1c54797c4465d1', 'targets': {'gibba025.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQct/yYRiVyP7xLyZhwP0bImuTNCZqteVFOIsXVClcIP1ZAC/HTIXhbXqwri+YfB05v85zmUldT9kbGVrzpkT7izrkERnEs70Y9+UACfYvKZXbdMdnZcNwpdyHqvXmt9NHcyt/DO7YWDN3WDCyNtsFLRFw1KJ8oeOMMAz0gNAJCrck2wuSsfV7iDofzXJOy+hZD7/NSkcBhCVJD1Ji0GogMlI2idePwXea5jx131oLUvcsP3wDus5XxhcCm4YBELqrrbkFX0Dn3mjazLczPpIqcj1eOmFSmJKKjPf/+wPaiUDREdxuFyM2pLNrX0vrH0GuLx5DraWWgByWEws0fSLP', 'gibba036.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCzmzfuX9HS9ufXoRhqcszlNBlk6kQ7aINmyLfea6KbHvb1lKjgcpcHIRKOdcXWY7hu63FxR7DJYEu9X4+DID8OyrdE/i4C14CL2+MXJWMqMS9jHDtfcRUxqXrx4Tj3JQLQh5ybSltA3djSEkGKfhHHhV3CP/y7NiKqK6uxVGsm3tlpX/TjE1UBYdsR+99a353abLIIwU69bi4NoCFXDi9QiPhn2fDnT6prAur9nBkrWRwKI9KgxLN1TWp7/NrLerLriIShyc03pduExkbph6b5INTocgfKoqcn09wkrLIstLEaoSKOS6DJnY+NiMgPtD/aHjgCAQHsxDNnN1eVaeKP'}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'cluster': 'c1', 'conf': {'client': {'debug rgw': 20, 'rgw crypt require ssl': False, 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo=', 'rgw curl low speed time': 300, 'rgw data log num shards': 4, 'rgw md log max shards': 4, 'rgw sync log trim interval': 0, 'rgw sync obj etag verify': True}, 'global': {'osd heartbeat grace': 40}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon osd crush smoke test': False}, 'osd': {'debug filestore': 20, 'debug journal': 20, 'debug ms': 20, 'debug osd': 25, 'osd fast shutdown': False}, 'osd.0': {'osd_max_omap_entries_per_request': 10}, 'osd.1': {'osd_max_omap_entries_per_request': 1000}, 'osd.2': {'osd_max_omap_entries_per_request': 10000}}, 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': '7194982cc16a1fd51df59ee58e1c54797c4465d1', 'wait-for-scrub': False}}, {'ceph': {'cluster': 'c2', 'conf': {'client': {'debug rgw': 20, 'rgw crypt require ssl': False, 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo=', 'rgw curl low speed time': 300, 'rgw data log num shards': 4, 'rgw md log max shards': 4, 'rgw sync log trim interval': 0, 'rgw sync obj etag verify': True}, 'global': {'osd heartbeat grace': 40}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon osd crush smoke test': False}, 'osd': {'debug filestore': 20, 'debug journal': 20, 'debug ms': 20, 'debug osd': 25, 'osd fast shutdown': False}, 'osd.0': {'osd_max_omap_entries_per_request': 10}, 'osd.1': {'osd_max_omap_entries_per_request': 1000}, 'osd.2': {'osd_max_omap_entries_per_request': 10000}}, 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': '7194982cc16a1fd51df59ee58e1c54797c4465d1', 'wait-for-scrub': False}}, {'rgw': {'c1.client.0': {'port': 8000}, 'c1.client.1': {'port': 8001}, 'c2.client.0': {'port': 8000}, 'c2.client.1': {'port': 8001}}}, {'rgw-multisite': None}, {'rgw-multisite-tests': {'config': {'reconfigure_delay': 60}}}], 'teuthology_branch': 'master', 'teuthology_sha1': '87d40f79d7da6caf6da06c190938773bf745140c', 'timestamp': '2021-02-12_17:45:41', 'tube': 'gibba', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.gibba.29737'} 2021-02-13T17:52:07.014 DEBUG:teuthology.orchestra.run.gibba025:> install -d -m0755 -- /home/ubuntu/cephtest/c2.data 2021-02-13T17:52:07.016 DEBUG:teuthology.orchestra.run.gibba036:> install -d -m0755 -- /home/ubuntu/cephtest/c2.data 2021-02-13T17:52:07.030 DEBUG:teuthology.orchestra.run.gibba025:> sudo install -d -m0777 -- /var/run/ceph 2021-02-13T17:52:07.072 DEBUG:teuthology.orchestra.run.gibba036:> sudo install -d -m0777 -- /var/run/ceph 2021-02-13T17:52:07.089 DEBUG:teuthology.orchestra.run.gibba036:> set -ex 2021-02-13T17:52:07.089 DEBUG:teuthology.orchestra.run.gibba036:> dd if=/scratch_devs of=/dev/stdout 2021-02-13T17:52:07.143 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2021-02-13T17:52:07.144 DEBUG:teuthology.orchestra.run.gibba036:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2021-02-13T17:52:07.193 INFO:teuthology.orchestra.run.gibba036.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2021-02-13T17:52:07.194 INFO:teuthology.orchestra.run.gibba036.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-02-13T17:52:07.194 INFO:teuthology.orchestra.run.gibba036.stdout:Device: 6h/6d Inode: 334 Links: 1 2021-02-13T17:52:07.194 INFO:teuthology.orchestra.run.gibba036.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-02-13T17:52:07.194 INFO:teuthology.orchestra.run.gibba036.stdout:Access: 2021-02-13 17:49:39.428250587 +0000 2021-02-13T17:52:07.194 INFO:teuthology.orchestra.run.gibba036.stdout:Modify: 2021-02-13 17:49:39.384272587 +0000 2021-02-13T17:52:07.194 INFO:teuthology.orchestra.run.gibba036.stdout:Change: 2021-02-13 17:49:39.384272587 +0000 2021-02-13T17:52:07.194 INFO:teuthology.orchestra.run.gibba036.stdout: Birth: - 2021-02-13T17:52:07.201 INFO:teuthology.orchestra.run.gibba036.stderr:1+0 records in 2021-02-13T17:52:07.201 INFO:teuthology.orchestra.run.gibba036.stderr:1+0 records out 2021-02-13T17:52:07.202 INFO:teuthology.orchestra.run.gibba036.stderr:512 bytes copied, 0.000210548 s, 2.4 MB/s 2021-02-13T17:52:07.203 DEBUG:teuthology.orchestra.run.gibba036:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2021-02-13T17:52:07.249 INFO:teuthology.orchestra.run.gibba036.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2021-02-13T17:52:07.249 INFO:teuthology.orchestra.run.gibba036.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-02-13T17:52:07.250 INFO:teuthology.orchestra.run.gibba036.stdout:Device: 6h/6d Inode: 341 Links: 1 2021-02-13T17:52:07.250 INFO:teuthology.orchestra.run.gibba036.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-02-13T17:52:07.250 INFO:teuthology.orchestra.run.gibba036.stdout:Access: 2021-02-13 17:49:39.568180586 +0000 2021-02-13T17:52:07.250 INFO:teuthology.orchestra.run.gibba036.stdout:Modify: 2021-02-13 17:49:39.520204586 +0000 2021-02-13T17:52:07.250 INFO:teuthology.orchestra.run.gibba036.stdout:Change: 2021-02-13 17:49:39.520204586 +0000 2021-02-13T17:52:07.250 INFO:teuthology.orchestra.run.gibba036.stdout: Birth: - 2021-02-13T17:52:07.253 INFO:teuthology.orchestra.run.gibba036.stderr:1+0 records in 2021-02-13T17:52:07.253 INFO:teuthology.orchestra.run.gibba036.stderr:1+0 records out 2021-02-13T17:52:07.253 INFO:teuthology.orchestra.run.gibba036.stderr:512 bytes copied, 0.000188424 s, 2.7 MB/s 2021-02-13T17:52:07.255 DEBUG:teuthology.orchestra.run.gibba036:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2021-02-13T17:52:07.305 INFO:teuthology.orchestra.run.gibba036.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2021-02-13T17:52:07.305 INFO:teuthology.orchestra.run.gibba036.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-02-13T17:52:07.305 INFO:teuthology.orchestra.run.gibba036.stdout:Device: 6h/6d Inode: 347 Links: 1 2021-02-13T17:52:07.305 INFO:teuthology.orchestra.run.gibba036.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-02-13T17:52:07.306 INFO:teuthology.orchestra.run.gibba036.stdout:Access: 2021-02-13 17:49:39.720104584 +0000 2021-02-13T17:52:07.306 INFO:teuthology.orchestra.run.gibba036.stdout:Modify: 2021-02-13 17:49:39.660134584 +0000 2021-02-13T17:52:07.306 INFO:teuthology.orchestra.run.gibba036.stdout:Change: 2021-02-13 17:49:39.660134584 +0000 2021-02-13T17:52:07.306 INFO:teuthology.orchestra.run.gibba036.stdout: Birth: - 2021-02-13T17:52:07.316 INFO:teuthology.orchestra.run.gibba036.stderr:1+0 records in 2021-02-13T17:52:07.316 INFO:teuthology.orchestra.run.gibba036.stderr:1+0 records out 2021-02-13T17:52:07.316 INFO:teuthology.orchestra.run.gibba036.stderr:512 bytes copied, 0.000355187 s, 1.4 MB/s 2021-02-13T17:52:07.321 DEBUG:teuthology.orchestra.run.gibba036:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2021-02-13T17:52:07.370 INFO:teuthology.orchestra.run.gibba036.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2021-02-13T17:52:07.371 INFO:teuthology.orchestra.run.gibba036.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-02-13T17:52:07.371 INFO:teuthology.orchestra.run.gibba036.stdout:Device: 6h/6d Inode: 353 Links: 1 2021-02-13T17:52:07.371 INFO:teuthology.orchestra.run.gibba036.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-02-13T17:52:07.371 INFO:teuthology.orchestra.run.gibba036.stdout:Access: 2021-02-13 17:49:39.864032582 +0000 2021-02-13T17:52:07.371 INFO:teuthology.orchestra.run.gibba036.stdout:Modify: 2021-02-13 17:49:39.816056583 +0000 2021-02-13T17:52:07.371 INFO:teuthology.orchestra.run.gibba036.stdout:Change: 2021-02-13 17:49:39.816056583 +0000 2021-02-13T17:52:07.371 INFO:teuthology.orchestra.run.gibba036.stdout: Birth: - 2021-02-13T17:52:07.377 INFO:teuthology.orchestra.run.gibba036.stderr:1+0 records in 2021-02-13T17:52:07.378 INFO:teuthology.orchestra.run.gibba036.stderr:1+0 records out 2021-02-13T17:52:07.378 INFO:teuthology.orchestra.run.gibba036.stderr:512 bytes copied, 0.000152061 s, 3.4 MB/s 2021-02-13T17:52:07.379 INFO:tasks.ceph:osd dev map: {'c2.osd.0': '/dev/vg_nvme/lv_1', 'c2.osd.1': '/dev/vg_nvme/lv_2', 'c2.osd.2': '/dev/vg_nvme/lv_3'} 2021-02-13T17:52:07.379 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@gibba036.front.sepia.ceph.com'): {'c2.osd.0': '/dev/vg_nvme/lv_1', 'c2.osd.1': '/dev/vg_nvme/lv_2', 'c2.osd.2': '/dev/vg_nvme/lv_3'}} 2021-02-13T17:52:07.379 INFO:tasks.ceph:Generating config... 2021-02-13T17:52:07.380 INFO:tasks.ceph:[client] debug rgw = 20 2021-02-13T17:52:07.380 INFO:tasks.ceph:[client] rgw crypt require ssl = False 2021-02-13T17:52:07.380 INFO:tasks.ceph:[client] rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= 2021-02-13T17:52:07.381 INFO:tasks.ceph:[client] rgw curl low speed time = 300 2021-02-13T17:52:07.381 INFO:tasks.ceph:[client] rgw data log num shards = 4 2021-02-13T17:52:07.381 INFO:tasks.ceph:[client] rgw md log max shards = 4 2021-02-13T17:52:07.381 INFO:tasks.ceph:[client] rgw sync log trim interval = 0 2021-02-13T17:52:07.381 INFO:tasks.ceph:[client] rgw sync obj etag verify = True 2021-02-13T17:52:07.381 INFO:tasks.ceph:[global] osd heartbeat grace = 40 2021-02-13T17:52:07.381 INFO:tasks.ceph:[mgr] debug mgr = 20 2021-02-13T17:52:07.381 INFO:tasks.ceph:[mgr] debug ms = 1 2021-02-13T17:52:07.381 INFO:tasks.ceph:[mon] debug mon = 20 2021-02-13T17:52:07.381 INFO:tasks.ceph:[mon] debug ms = 1 2021-02-13T17:52:07.382 INFO:tasks.ceph:[mon] debug paxos = 20 2021-02-13T17:52:07.382 INFO:tasks.ceph:[mon] mon osd crush smoke test = False 2021-02-13T17:52:07.382 INFO:tasks.ceph:[osd] debug filestore = 20 2021-02-13T17:52:07.382 INFO:tasks.ceph:[osd] debug journal = 20 2021-02-13T17:52:07.382 INFO:tasks.ceph:[osd] debug ms = 20 2021-02-13T17:52:07.382 INFO:tasks.ceph:[osd] debug osd = 25 2021-02-13T17:52:07.382 INFO:tasks.ceph:[osd] osd fast shutdown = False 2021-02-13T17:52:07.382 INFO:tasks.ceph:[osd.0] osd_max_omap_entries_per_request = 10 2021-02-13T17:52:07.382 INFO:tasks.ceph:[osd.1] osd_max_omap_entries_per_request = 1000 2021-02-13T17:52:07.382 INFO:tasks.ceph:[osd.2] osd_max_omap_entries_per_request = 10000 2021-02-13T17:52:07.382 INFO:tasks.ceph:Setting up c2.mon.a... 2021-02-13T17:52:07.383 DEBUG:teuthology.orchestra.run.gibba036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/c2.keyring 2021-02-13T17:52:07.462 INFO:teuthology.orchestra.run.gibba036.stdout:creating /etc/ceph/c2.keyring 2021-02-13T17:52:07.467 DEBUG:teuthology.orchestra.run.gibba036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/c2.keyring 2021-02-13T17:52:07.569 DEBUG:teuthology.orchestra.run.gibba036:> sudo chmod 0644 /etc/ceph/c2.keyring 2021-02-13T17:52:07.578 DEBUG:tasks.ceph:Ceph mon addresses: [('c2.mon.a', '172.21.2.136')] 2021-02-13T17:52:07.578 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool --create --clobber --enable-all-features --add a 172.21.2.136 --print /home/ubuntu/cephtest/c2.monmap 2021-02-13T17:52:07.643 INFO:teuthology.orchestra.run.gibba036.stdout:monmaptool: monmap file /home/ubuntu/cephtest/c2.monmap 2021-02-13T17:52:07.643 INFO:teuthology.orchestra.run.gibba036.stdout:monmaptool: generated fsid 554ed120-a4b0-4e13-b48c-53832c6f02bd 2021-02-13T17:52:07.643 INFO:teuthology.orchestra.run.gibba036.stdout:epoch 0 2021-02-13T17:52:07.643 INFO:teuthology.orchestra.run.gibba036.stdout:fsid 554ed120-a4b0-4e13-b48c-53832c6f02bd 2021-02-13T17:52:07.644 INFO:teuthology.orchestra.run.gibba036.stdout:last_changed 2021-02-13 17:52:07.642219 2021-02-13T17:52:07.644 INFO:teuthology.orchestra.run.gibba036.stdout:created 2021-02-13 17:52:07.642219 2021-02-13T17:52:07.644 INFO:teuthology.orchestra.run.gibba036.stdout:min_mon_release 0 (unknown) 2021-02-13T17:52:07.644 INFO:teuthology.orchestra.run.gibba036.stdout:0: [v2:172.21.2.136:3300/0,v1:172.21.2.136:6789/0] mon.a 2021-02-13T17:52:07.644 INFO:teuthology.orchestra.run.gibba036.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/c2.monmap (1 monitors) 2021-02-13T17:52:07.651 INFO:tasks.ceph:Writing /etc/ceph/c2.conf for FSID 554ed120-a4b0-4e13-b48c-53832c6f02bd... 2021-02-13T17:52:07.652 DEBUG:teuthology.orchestra.run.gibba025:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/c2.conf && sudo chmod 0644 /etc/ceph/c2.conf > /dev/null 2021-02-13T17:52:07.654 DEBUG:teuthology.orchestra.run.gibba036:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/c2.conf && sudo chmod 0644 /etc/ceph/c2.conf > /dev/null 2021-02-13T17:52:07.689 INFO:teuthology.orchestra.run.gibba025.stdout:[global] 2021-02-13T17:52:07.689 INFO:teuthology.orchestra.run.gibba025.stdout: chdir = "" 2021-02-13T17:52:07.689 INFO:teuthology.orchestra.run.gibba025.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-02-13T17:52:07.689 INFO:teuthology.orchestra.run.gibba025.stdout: auth supported = cephx 2021-02-13T17:52:07.689 INFO:teuthology.orchestra.run.gibba025.stdout: 2021-02-13T17:52:07.689 INFO:teuthology.orchestra.run.gibba025.stdout: filestore xattr use omap = true 2021-02-13T17:52:07.689 INFO:teuthology.orchestra.run.gibba025.stdout: 2021-02-13T17:52:07.690 INFO:teuthology.orchestra.run.gibba025.stdout: mon clock drift allowed = 1.000 2021-02-13T17:52:07.690 INFO:teuthology.orchestra.run.gibba025.stdout: 2021-02-13T17:52:07.690 INFO:teuthology.orchestra.run.gibba025.stdout: osd crush chooseleaf type = 0 2021-02-13T17:52:07.690 INFO:teuthology.orchestra.run.gibba025.stdout: auth debug = true 2021-02-13T17:52:07.690 INFO:teuthology.orchestra.run.gibba025.stdout: 2021-02-13T17:52:07.690 INFO:teuthology.orchestra.run.gibba025.stdout: ms die on old message = true 2021-02-13T17:52:07.690 INFO:teuthology.orchestra.run.gibba025.stdout: ms die on bug = true 2021-02-13T17:52:07.690 INFO:teuthology.orchestra.run.gibba025.stdout: 2021-02-13T17:52:07.690 INFO:teuthology.orchestra.run.gibba025.stdout: mon max pg per osd = 10000 # >= luminous 2021-02-13T17:52:07.690 INFO:teuthology.orchestra.run.gibba025.stdout: mon pg warn max object skew = 0 2021-02-13T17:52:07.690 INFO:teuthology.orchestra.run.gibba025.stdout: 2021-02-13T17:52:07.690 INFO:teuthology.orchestra.run.gibba025.stdout: osd pool default size = 2 2021-02-13T17:52:07.691 INFO:teuthology.orchestra.run.gibba025.stdout: 2021-02-13T17:52:07.691 INFO:teuthology.orchestra.run.gibba025.stdout: mon osd allow primary affinity = true 2021-02-13T17:52:07.691 INFO:teuthology.orchestra.run.gibba025.stdout: mon osd allow pg remap = true 2021-02-13T17:52:07.691 INFO:teuthology.orchestra.run.gibba025.stdout: mon warn on legacy crush tunables = false 2021-02-13T17:52:07.691 INFO:teuthology.orchestra.run.gibba025.stdout: mon warn on crush straw calc version zero = false 2021-02-13T17:52:07.691 INFO:teuthology.orchestra.run.gibba025.stdout: mon warn on no sortbitwise = false 2021-02-13T17:52:07.691 INFO:teuthology.orchestra.run.gibba025.stdout: mon warn on osd down out interval zero = false 2021-02-13T17:52:07.691 INFO:teuthology.orchestra.run.gibba025.stdout: mon warn on too few osds = false 2021-02-13T17:52:07.691 INFO:teuthology.orchestra.run.gibba025.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-02-13T17:52:07.691 INFO:teuthology.orchestra.run.gibba025.stdout: mon_warn_on_pool_no_redundancy = false 2021-02-13T17:52:07.692 INFO:teuthology.orchestra.run.gibba025.stdout: 2021-02-13T17:52:07.692 INFO:teuthology.orchestra.run.gibba025.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-02-13T17:52:07.692 INFO:teuthology.orchestra.run.gibba025.stdout: 2021-02-13T17:52:07.692 INFO:teuthology.orchestra.run.gibba025.stdout: osd default data pool replay window = 5 2021-02-13T17:52:07.692 INFO:teuthology.orchestra.run.gibba025.stdout: 2021-02-13T17:52:07.693 INFO:teuthology.orchestra.run.gibba025.stdout: mon allow pool delete = true 2021-02-13T17:52:07.693 INFO:teuthology.orchestra.run.gibba025.stdout: 2021-02-13T17:52:07.693 INFO:teuthology.orchestra.run.gibba025.stdout: mon cluster log file level = debug 2021-02-13T17:52:07.693 INFO:teuthology.orchestra.run.gibba025.stdout: debug asserts on shutdown = true 2021-02-13T17:52:07.693 INFO:teuthology.orchestra.run.gibba025.stdout: mon health detail to clog = false 2021-02-13T17:52:07.693 INFO:teuthology.orchestra.run.gibba025.stdout: 2021-02-13T17:52:07.693 INFO:teuthology.orchestra.run.gibba025.stdout: # we see this fail in qa on *nautilus*; bump up retries 2021-02-13T17:52:07.693 INFO:teuthology.orchestra.run.gibba025.stdout: mon_client_directed_command_retry = 4 2021-02-13T17:52:07.693 INFO:teuthology.orchestra.run.gibba025.stdout: mon host = 172.21.2.136 2021-02-13T17:52:07.693 INFO:teuthology.orchestra.run.gibba025.stdout: osd heartbeat grace = 40 2021-02-13T17:52:07.693 INFO:teuthology.orchestra.run.gibba025.stdout: fsid = 554ed120-a4b0-4e13-b48c-53832c6f02bd 2021-02-13T17:52:07.693 INFO:teuthology.orchestra.run.gibba025.stdout: 2021-02-13T17:52:07.694 INFO:teuthology.orchestra.run.gibba025.stdout:[osd] 2021-02-13T17:52:07.694 INFO:teuthology.orchestra.run.gibba025.stdout: osd journal size = 100 2021-02-13T17:52:07.694 INFO:teuthology.orchestra.run.gibba025.stdout: 2021-02-13T17:52:07.694 INFO:teuthology.orchestra.run.gibba025.stdout: osd scrub load threshold = 5.0 2021-02-13T17:52:07.694 INFO:teuthology.orchestra.run.gibba025.stdout: osd scrub max interval = 600 2021-02-13T17:52:07.694 INFO:teuthology.orchestra.run.gibba025.stdout: 2021-02-13T17:52:07.694 INFO:teuthology.orchestra.run.gibba025.stdout: osd recover clone overlap = true 2021-02-13T17:52:07.694 INFO:teuthology.orchestra.run.gibba025.stdout: osd recovery max chunk = 1048576 2021-02-13T17:52:07.695 INFO:teuthology.orchestra.run.gibba025.stdout: 2021-02-13T17:52:07.695 INFO:teuthology.orchestra.run.gibba025.stdout: osd debug shutdown = true 2021-02-13T17:52:07.695 INFO:teuthology.orchestra.run.gibba025.stdout: osd debug op order = true 2021-02-13T17:52:07.695 INFO:teuthology.orchestra.run.gibba025.stdout: osd debug verify stray on activate = true 2021-02-13T17:52:07.695 INFO:teuthology.orchestra.run.gibba025.stdout: 2021-02-13T17:52:07.695 INFO:teuthology.orchestra.run.gibba025.stdout: osd open classes on start = true 2021-02-13T17:52:07.695 INFO:teuthology.orchestra.run.gibba025.stdout: osd debug pg log writeout = true 2021-02-13T17:52:07.695 INFO:teuthology.orchestra.run.gibba025.stdout: 2021-02-13T17:52:07.695 INFO:teuthology.orchestra.run.gibba025.stdout: osd deep scrub update digest min age = 30 2021-02-13T17:52:07.695 INFO:teuthology.orchestra.run.gibba025.stdout: 2021-02-13T17:52:07.695 INFO:teuthology.orchestra.run.gibba025.stdout: osd map max advance = 10 2021-02-13T17:52:07.695 INFO:teuthology.orchestra.run.gibba025.stdout: 2021-02-13T17:52:07.695 INFO:teuthology.orchestra.run.gibba025.stdout: journal zero on create = true 2021-02-13T17:52:07.696 INFO:teuthology.orchestra.run.gibba025.stdout: 2021-02-13T17:52:07.696 INFO:teuthology.orchestra.run.gibba025.stdout: filestore ondisk finisher threads = 3 2021-02-13T17:52:07.696 INFO:teuthology.orchestra.run.gibba025.stdout: filestore apply finisher threads = 3 2021-02-13T17:52:07.696 INFO:teuthology.orchestra.run.gibba025.stdout: 2021-02-13T17:52:07.696 INFO:teuthology.orchestra.run.gibba025.stdout: bdev debug aio = true 2021-02-13T17:52:07.696 INFO:teuthology.orchestra.run.gibba025.stdout: osd debug misdirected ops = true 2021-02-13T17:52:07.696 INFO:teuthology.orchestra.run.gibba025.stdout: debug filestore = 20 2021-02-13T17:52:07.696 INFO:teuthology.orchestra.run.gibba025.stdout: debug journal = 20 2021-02-13T17:52:07.696 INFO:teuthology.orchestra.run.gibba025.stdout: debug ms = 20 2021-02-13T17:52:07.696 INFO:teuthology.orchestra.run.gibba025.stdout: debug osd = 25 2021-02-13T17:52:07.696 INFO:teuthology.orchestra.run.gibba025.stdout: osd fast shutdown = False 2021-02-13T17:52:07.696 INFO:teuthology.orchestra.run.gibba025.stdout: 2021-02-13T17:52:07.696 INFO:teuthology.orchestra.run.gibba025.stdout:[mgr] 2021-02-13T17:52:07.697 INFO:teuthology.orchestra.run.gibba025.stdout: debug ms = 1 2021-02-13T17:52:07.697 INFO:teuthology.orchestra.run.gibba025.stdout: debug mgr = 20 2021-02-13T17:52:07.697 INFO:teuthology.orchestra.run.gibba025.stdout: debug mon = 20 2021-02-13T17:52:07.697 INFO:teuthology.orchestra.run.gibba025.stdout: debug auth = 20 2021-02-13T17:52:07.697 INFO:teuthology.orchestra.run.gibba025.stdout: mon reweight min pgs per osd = 4 2021-02-13T17:52:07.697 INFO:teuthology.orchestra.run.gibba025.stdout: mon reweight min bytes per osd = 10 2021-02-13T17:52:07.697 INFO:teuthology.orchestra.run.gibba025.stdout: 2021-02-13T17:52:07.697 INFO:teuthology.orchestra.run.gibba025.stdout:[mon] 2021-02-13T17:52:07.697 INFO:teuthology.orchestra.run.gibba025.stdout: debug ms = 1 2021-02-13T17:52:07.698 INFO:teuthology.orchestra.run.gibba025.stdout: debug mon = 20 2021-02-13T17:52:07.698 INFO:teuthology.orchestra.run.gibba025.stdout: debug paxos = 20 2021-02-13T17:52:07.698 INFO:teuthology.orchestra.run.gibba025.stdout: debug auth = 20 2021-02-13T17:52:07.698 INFO:teuthology.orchestra.run.gibba025.stdout: mon data avail warn = 5 2021-02-13T17:52:07.698 INFO:teuthology.orchestra.run.gibba025.stdout: mon mgr mkfs grace = 240 2021-02-13T17:52:07.698 INFO:teuthology.orchestra.run.gibba025.stdout: mon reweight min pgs per osd = 4 2021-02-13T17:52:07.698 INFO:teuthology.orchestra.run.gibba025.stdout: mon osd reporter subtree level = osd 2021-02-13T17:52:07.698 INFO:teuthology.orchestra.run.gibba025.stdout: mon osd prime pg temp = true 2021-02-13T17:52:07.698 INFO:teuthology.orchestra.run.gibba025.stdout: mon reweight min bytes per osd = 10 2021-02-13T17:52:07.699 INFO:teuthology.orchestra.run.gibba025.stdout: mon osd crush smoke test = False 2021-02-13T17:52:07.699 INFO:teuthology.orchestra.run.gibba025.stdout: 2021-02-13T17:52:07.699 INFO:teuthology.orchestra.run.gibba025.stdout:[client] 2021-02-13T17:52:07.699 INFO:teuthology.orchestra.run.gibba025.stdout: rgw cache enabled = true 2021-02-13T17:52:07.699 INFO:teuthology.orchestra.run.gibba025.stdout: rgw enable ops log = true 2021-02-13T17:52:07.699 INFO:teuthology.orchestra.run.gibba025.stdout: rgw enable usage log = true 2021-02-13T17:52:07.699 INFO:teuthology.orchestra.run.gibba025.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-02-13T17:52:07.699 INFO:teuthology.orchestra.run.gibba025.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-02-13T17:52:07.699 INFO:teuthology.orchestra.run.gibba025.stdout: debug rgw = 20 2021-02-13T17:52:07.699 INFO:teuthology.orchestra.run.gibba025.stdout: rgw crypt require ssl = False 2021-02-13T17:52:07.699 INFO:teuthology.orchestra.run.gibba025.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= 2021-02-13T17:52:07.699 INFO:teuthology.orchestra.run.gibba025.stdout: rgw curl low speed time = 300 2021-02-13T17:52:07.699 INFO:teuthology.orchestra.run.gibba025.stdout: rgw data log num shards = 4 2021-02-13T17:52:07.700 INFO:teuthology.orchestra.run.gibba025.stdout: rgw md log max shards = 4 2021-02-13T17:52:07.700 INFO:teuthology.orchestra.run.gibba025.stdout: rgw sync log trim interval = 0 2021-02-13T17:52:07.700 INFO:teuthology.orchestra.run.gibba025.stdout: rgw sync obj etag verify = True 2021-02-13T17:52:07.700 INFO:teuthology.orchestra.run.gibba025.stdout:[mon.a] 2021-02-13T17:52:07.700 INFO:teuthology.orchestra.run.gibba025.stdout:[osd.0] 2021-02-13T17:52:07.700 INFO:teuthology.orchestra.run.gibba025.stdout: osd_max_omap_entries_per_request = 10 2021-02-13T17:52:07.700 INFO:teuthology.orchestra.run.gibba025.stdout:[osd.1] 2021-02-13T17:52:07.700 INFO:teuthology.orchestra.run.gibba025.stdout: osd_max_omap_entries_per_request = 1000 2021-02-13T17:52:07.700 INFO:teuthology.orchestra.run.gibba025.stdout:[osd.2] 2021-02-13T17:52:07.701 INFO:teuthology.orchestra.run.gibba025.stdout: osd_max_omap_entries_per_request = 10000 2021-02-13T17:52:07.701 INFO:teuthology.orchestra.run.gibba036.stdout:[global] 2021-02-13T17:52:07.702 INFO:teuthology.orchestra.run.gibba036.stdout: chdir = "" 2021-02-13T17:52:07.702 INFO:teuthology.orchestra.run.gibba036.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-02-13T17:52:07.702 INFO:teuthology.orchestra.run.gibba036.stdout: auth supported = cephx 2021-02-13T17:52:07.702 INFO:teuthology.orchestra.run.gibba036.stdout: 2021-02-13T17:52:07.702 INFO:teuthology.orchestra.run.gibba036.stdout: filestore xattr use omap = true 2021-02-13T17:52:07.702 INFO:teuthology.orchestra.run.gibba036.stdout: 2021-02-13T17:52:07.702 INFO:teuthology.orchestra.run.gibba036.stdout: mon clock drift allowed = 1.000 2021-02-13T17:52:07.702 INFO:teuthology.orchestra.run.gibba036.stdout: 2021-02-13T17:52:07.702 INFO:teuthology.orchestra.run.gibba036.stdout: osd crush chooseleaf type = 0 2021-02-13T17:52:07.702 INFO:teuthology.orchestra.run.gibba036.stdout: auth debug = true 2021-02-13T17:52:07.702 INFO:teuthology.orchestra.run.gibba036.stdout: 2021-02-13T17:52:07.702 INFO:teuthology.orchestra.run.gibba036.stdout: ms die on old message = true 2021-02-13T17:52:07.703 INFO:teuthology.orchestra.run.gibba036.stdout: ms die on bug = true 2021-02-13T17:52:07.703 INFO:teuthology.orchestra.run.gibba036.stdout: 2021-02-13T17:52:07.703 INFO:teuthology.orchestra.run.gibba036.stdout: mon max pg per osd = 10000 # >= luminous 2021-02-13T17:52:07.703 INFO:teuthology.orchestra.run.gibba036.stdout: mon pg warn max object skew = 0 2021-02-13T17:52:07.703 INFO:teuthology.orchestra.run.gibba036.stdout: 2021-02-13T17:52:07.703 INFO:teuthology.orchestra.run.gibba036.stdout: osd pool default size = 2 2021-02-13T17:52:07.703 INFO:teuthology.orchestra.run.gibba036.stdout: 2021-02-13T17:52:07.703 INFO:teuthology.orchestra.run.gibba036.stdout: mon osd allow primary affinity = true 2021-02-13T17:52:07.703 INFO:teuthology.orchestra.run.gibba036.stdout: mon osd allow pg remap = true 2021-02-13T17:52:07.703 INFO:teuthology.orchestra.run.gibba036.stdout: mon warn on legacy crush tunables = false 2021-02-13T17:52:07.703 INFO:teuthology.orchestra.run.gibba036.stdout: mon warn on crush straw calc version zero = false 2021-02-13T17:52:07.703 INFO:teuthology.orchestra.run.gibba036.stdout: mon warn on no sortbitwise = false 2021-02-13T17:52:07.703 INFO:teuthology.orchestra.run.gibba036.stdout: mon warn on osd down out interval zero = false 2021-02-13T17:52:07.703 INFO:teuthology.orchestra.run.gibba036.stdout: mon warn on too few osds = false 2021-02-13T17:52:07.704 INFO:teuthology.orchestra.run.gibba036.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-02-13T17:52:07.704 INFO:teuthology.orchestra.run.gibba036.stdout: mon_warn_on_pool_no_redundancy = false 2021-02-13T17:52:07.704 INFO:teuthology.orchestra.run.gibba036.stdout: 2021-02-13T17:52:07.704 INFO:teuthology.orchestra.run.gibba036.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2021-02-13T17:52:07.704 INFO:teuthology.orchestra.run.gibba036.stdout: 2021-02-13T17:52:07.704 INFO:teuthology.orchestra.run.gibba036.stdout: osd default data pool replay window = 5 2021-02-13T17:52:07.704 INFO:teuthology.orchestra.run.gibba036.stdout: 2021-02-13T17:52:07.704 INFO:teuthology.orchestra.run.gibba036.stdout: mon allow pool delete = true 2021-02-13T17:52:07.704 INFO:teuthology.orchestra.run.gibba036.stdout: 2021-02-13T17:52:07.704 INFO:teuthology.orchestra.run.gibba036.stdout: mon cluster log file level = debug 2021-02-13T17:52:07.704 INFO:teuthology.orchestra.run.gibba036.stdout: debug asserts on shutdown = true 2021-02-13T17:52:07.704 INFO:teuthology.orchestra.run.gibba036.stdout: mon health detail to clog = false 2021-02-13T17:52:07.704 INFO:teuthology.orchestra.run.gibba036.stdout: 2021-02-13T17:52:07.705 INFO:teuthology.orchestra.run.gibba036.stdout: # we see this fail in qa on *nautilus*; bump up retries 2021-02-13T17:52:07.705 INFO:teuthology.orchestra.run.gibba036.stdout: mon_client_directed_command_retry = 4 2021-02-13T17:52:07.705 INFO:teuthology.orchestra.run.gibba036.stdout: mon host = 172.21.2.136 2021-02-13T17:52:07.705 INFO:teuthology.orchestra.run.gibba036.stdout: osd heartbeat grace = 40 2021-02-13T17:52:07.705 INFO:teuthology.orchestra.run.gibba036.stdout: fsid = 554ed120-a4b0-4e13-b48c-53832c6f02bd 2021-02-13T17:52:07.705 INFO:teuthology.orchestra.run.gibba036.stdout: 2021-02-13T17:52:07.705 INFO:teuthology.orchestra.run.gibba036.stdout:[osd] 2021-02-13T17:52:07.705 INFO:teuthology.orchestra.run.gibba036.stdout: osd journal size = 100 2021-02-13T17:52:07.705 INFO:teuthology.orchestra.run.gibba036.stdout: 2021-02-13T17:52:07.706 INFO:teuthology.orchestra.run.gibba036.stdout: osd scrub load threshold = 5.0 2021-02-13T17:52:07.706 INFO:teuthology.orchestra.run.gibba036.stdout: osd scrub max interval = 600 2021-02-13T17:52:07.706 INFO:teuthology.orchestra.run.gibba036.stdout: 2021-02-13T17:52:07.706 INFO:teuthology.orchestra.run.gibba036.stdout: osd recover clone overlap = true 2021-02-13T17:52:07.706 INFO:teuthology.orchestra.run.gibba036.stdout: osd recovery max chunk = 1048576 2021-02-13T17:52:07.706 INFO:teuthology.orchestra.run.gibba036.stdout: 2021-02-13T17:52:07.706 INFO:teuthology.orchestra.run.gibba036.stdout: osd debug shutdown = true 2021-02-13T17:52:07.707 INFO:teuthology.orchestra.run.gibba036.stdout: osd debug op order = true 2021-02-13T17:52:07.707 INFO:teuthology.orchestra.run.gibba036.stdout: osd debug verify stray on activate = true 2021-02-13T17:52:07.707 INFO:teuthology.orchestra.run.gibba036.stdout: 2021-02-13T17:52:07.707 INFO:teuthology.orchestra.run.gibba036.stdout: osd open classes on start = true 2021-02-13T17:52:07.707 INFO:teuthology.orchestra.run.gibba036.stdout: osd debug pg log writeout = true 2021-02-13T17:52:07.707 INFO:teuthology.orchestra.run.gibba036.stdout: 2021-02-13T17:52:07.707 INFO:teuthology.orchestra.run.gibba036.stdout: osd deep scrub update digest min age = 30 2021-02-13T17:52:07.707 INFO:teuthology.orchestra.run.gibba036.stdout: 2021-02-13T17:52:07.707 INFO:teuthology.orchestra.run.gibba036.stdout: osd map max advance = 10 2021-02-13T17:52:07.707 INFO:teuthology.orchestra.run.gibba036.stdout: 2021-02-13T17:52:07.707 INFO:teuthology.orchestra.run.gibba036.stdout: journal zero on create = true 2021-02-13T17:52:07.707 INFO:teuthology.orchestra.run.gibba036.stdout: 2021-02-13T17:52:07.707 INFO:teuthology.orchestra.run.gibba036.stdout: filestore ondisk finisher threads = 3 2021-02-13T17:52:07.708 INFO:teuthology.orchestra.run.gibba036.stdout: filestore apply finisher threads = 3 2021-02-13T17:52:07.708 INFO:teuthology.orchestra.run.gibba036.stdout: 2021-02-13T17:52:07.708 INFO:teuthology.orchestra.run.gibba036.stdout: bdev debug aio = true 2021-02-13T17:52:07.709 INFO:teuthology.orchestra.run.gibba036.stdout: osd debug misdirected ops = true 2021-02-13T17:52:07.709 INFO:teuthology.orchestra.run.gibba036.stdout: debug filestore = 20 2021-02-13T17:52:07.709 INFO:teuthology.orchestra.run.gibba036.stdout: debug journal = 20 2021-02-13T17:52:07.709 INFO:teuthology.orchestra.run.gibba036.stdout: debug ms = 20 2021-02-13T17:52:07.709 INFO:teuthology.orchestra.run.gibba036.stdout: debug osd = 25 2021-02-13T17:52:07.709 INFO:teuthology.orchestra.run.gibba036.stdout: osd fast shutdown = False 2021-02-13T17:52:07.709 INFO:teuthology.orchestra.run.gibba036.stdout: 2021-02-13T17:52:07.709 INFO:teuthology.orchestra.run.gibba036.stdout:[mgr] 2021-02-13T17:52:07.710 INFO:teuthology.orchestra.run.gibba036.stdout: debug ms = 1 2021-02-13T17:52:07.710 INFO:teuthology.orchestra.run.gibba036.stdout: debug mgr = 20 2021-02-13T17:52:07.710 INFO:teuthology.orchestra.run.gibba036.stdout: debug mon = 20 2021-02-13T17:52:07.710 INFO:teuthology.orchestra.run.gibba036.stdout: debug auth = 20 2021-02-13T17:52:07.710 INFO:teuthology.orchestra.run.gibba036.stdout: mon reweight min pgs per osd = 4 2021-02-13T17:52:07.710 INFO:teuthology.orchestra.run.gibba036.stdout: mon reweight min bytes per osd = 10 2021-02-13T17:52:07.710 INFO:teuthology.orchestra.run.gibba036.stdout: 2021-02-13T17:52:07.710 INFO:teuthology.orchestra.run.gibba036.stdout:[mon] 2021-02-13T17:52:07.710 INFO:teuthology.orchestra.run.gibba036.stdout: debug ms = 1 2021-02-13T17:52:07.710 INFO:teuthology.orchestra.run.gibba036.stdout: debug mon = 20 2021-02-13T17:52:07.710 INFO:teuthology.orchestra.run.gibba036.stdout: debug paxos = 20 2021-02-13T17:52:07.710 INFO:teuthology.orchestra.run.gibba036.stdout: debug auth = 20 2021-02-13T17:52:07.710 INFO:teuthology.orchestra.run.gibba036.stdout: mon data avail warn = 5 2021-02-13T17:52:07.711 INFO:teuthology.orchestra.run.gibba036.stdout: mon mgr mkfs grace = 240 2021-02-13T17:52:07.711 INFO:teuthology.orchestra.run.gibba036.stdout: mon reweight min pgs per osd = 4 2021-02-13T17:52:07.711 INFO:teuthology.orchestra.run.gibba036.stdout: mon osd reporter subtree level = osd 2021-02-13T17:52:07.711 INFO:teuthology.orchestra.run.gibba036.stdout: mon osd prime pg temp = true 2021-02-13T17:52:07.711 INFO:teuthology.orchestra.run.gibba036.stdout: mon reweight min bytes per osd = 10 2021-02-13T17:52:07.711 INFO:teuthology.orchestra.run.gibba036.stdout: mon osd crush smoke test = False 2021-02-13T17:52:07.711 INFO:teuthology.orchestra.run.gibba036.stdout: 2021-02-13T17:52:07.711 INFO:teuthology.orchestra.run.gibba036.stdout:[client] 2021-02-13T17:52:07.711 INFO:teuthology.orchestra.run.gibba036.stdout: rgw cache enabled = true 2021-02-13T17:52:07.711 INFO:teuthology.orchestra.run.gibba036.stdout: rgw enable ops log = true 2021-02-13T17:52:07.711 INFO:teuthology.orchestra.run.gibba036.stdout: rgw enable usage log = true 2021-02-13T17:52:07.712 INFO:teuthology.orchestra.run.gibba036.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-02-13T17:52:07.712 INFO:teuthology.orchestra.run.gibba036.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-02-13T17:52:07.712 INFO:teuthology.orchestra.run.gibba036.stdout: debug rgw = 20 2021-02-13T17:52:07.712 INFO:teuthology.orchestra.run.gibba036.stdout: rgw crypt require ssl = False 2021-02-13T17:52:07.712 INFO:teuthology.orchestra.run.gibba036.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= 2021-02-13T17:52:07.712 INFO:teuthology.orchestra.run.gibba036.stdout: rgw curl low speed time = 300 2021-02-13T17:52:07.712 INFO:teuthology.orchestra.run.gibba036.stdout: rgw data log num shards = 4 2021-02-13T17:52:07.712 INFO:teuthology.orchestra.run.gibba036.stdout: rgw md log max shards = 4 2021-02-13T17:52:07.712 INFO:teuthology.orchestra.run.gibba036.stdout: rgw sync log trim interval = 0 2021-02-13T17:52:07.712 INFO:teuthology.orchestra.run.gibba036.stdout: rgw sync obj etag verify = True 2021-02-13T17:52:07.712 INFO:teuthology.orchestra.run.gibba036.stdout:[mon.a] 2021-02-13T17:52:07.712 INFO:teuthology.orchestra.run.gibba036.stdout:[osd.0] 2021-02-13T17:52:07.712 INFO:teuthology.orchestra.run.gibba036.stdout: osd_max_omap_entries_per_request = 10 2021-02-13T17:52:07.713 INFO:teuthology.orchestra.run.gibba036.stdout:[osd.1] 2021-02-13T17:52:07.713 INFO:teuthology.orchestra.run.gibba036.stdout: osd_max_omap_entries_per_request = 1000 2021-02-13T17:52:07.713 INFO:teuthology.orchestra.run.gibba036.stdout:[osd.2] 2021-02-13T17:52:07.713 INFO:teuthology.orchestra.run.gibba036.stdout: osd_max_omap_entries_per_request = 10000 2021-02-13T17:52:07.714 INFO:tasks.ceph:Creating admin key on c2.mon.a... 2021-02-13T17:52:07.714 DEBUG:teuthology.orchestra.run.gibba036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/c2.keyring 2021-02-13T17:52:07.783 INFO:tasks.ceph:Copying monmap to all nodes... 2021-02-13T17:52:07.832 DEBUG:teuthology.orchestra.remote:gibba036:/etc/ceph/c2.keyring is 206B 2021-02-13T17:52:07.847 DEBUG:teuthology.orchestra.remote:gibba036:/home/ubuntu/cephtest/c2.monmap is 177B 2021-02-13T17:52:07.858 INFO:tasks.ceph:Sending monmap to node ubuntu@gibba025.front.sepia.ceph.com 2021-02-13T17:52:07.858 DEBUG:teuthology.orchestra.run.gibba025:> set -ex 2021-02-13T17:52:07.858 DEBUG:teuthology.orchestra.run.gibba025:> sudo dd of=/etc/ceph/c2.keyring 2021-02-13T17:52:07.858 DEBUG:teuthology.orchestra.run.gibba025:> sudo chmod 0644 /etc/ceph/c2.keyring 2021-02-13T17:52:07.874 DEBUG:teuthology.orchestra.run.gibba025:> set -ex 2021-02-13T17:52:07.874 DEBUG:teuthology.orchestra.run.gibba025:> dd of=/home/ubuntu/cephtest/c2.monmap 2021-02-13T17:52:07.925 INFO:tasks.ceph:Sending monmap to node ubuntu@gibba036.front.sepia.ceph.com 2021-02-13T17:52:07.925 DEBUG:teuthology.orchestra.run.gibba036:> set -ex 2021-02-13T17:52:07.925 DEBUG:teuthology.orchestra.run.gibba036:> sudo dd of=/etc/ceph/c2.keyring 2021-02-13T17:52:07.925 DEBUG:teuthology.orchestra.run.gibba036:> sudo chmod 0644 /etc/ceph/c2.keyring 2021-02-13T17:52:07.957 DEBUG:teuthology.orchestra.run.gibba036:> set -ex 2021-02-13T17:52:07.957 DEBUG:teuthology.orchestra.run.gibba036:> dd of=/home/ubuntu/cephtest/c2.monmap 2021-02-13T17:52:08.006 INFO:tasks.ceph:Setting up mon nodes... 2021-02-13T17:52:08.006 INFO:tasks.ceph:Setting up mgr nodes... 2021-02-13T17:52:08.006 DEBUG:teuthology.orchestra.run.gibba036:> sudo mkdir -p /var/lib/ceph/mgr/c2-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/c2-x/keyring 2021-02-13T17:52:08.074 INFO:teuthology.orchestra.run.gibba036.stdout:creating /var/lib/ceph/mgr/c2-x/keyring 2021-02-13T17:52:08.075 INFO:tasks.ceph:Setting up mds nodes... 2021-02-13T17:52:08.075 INFO:tasks.ceph_client:Setting up client nodes... 2021-02-13T17:52:08.075 DEBUG:teuthology.orchestra.run.gibba036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/c2.client.0.keyring && sudo chmod 0644 /etc/ceph/c2.client.0.keyring 2021-02-13T17:52:08.137 INFO:teuthology.orchestra.run.gibba036.stdout:creating /etc/ceph/c2.client.0.keyring 2021-02-13T17:52:08.140 DEBUG:teuthology.orchestra.run.gibba036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/c2.client.1.keyring && sudo chmod 0644 /etc/ceph/c2.client.1.keyring 2021-02-13T17:52:08.207 INFO:teuthology.orchestra.run.gibba036.stdout:creating /etc/ceph/c2.client.1.keyring 2021-02-13T17:52:08.215 INFO:tasks.ceph:Running mkfs on osd nodes... 2021-02-13T17:52:08.215 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@gibba025.front.sepia.ceph.com'): {'c1.osd.0': '/dev/vg_nvme/lv_1', 'c1.osd.1': '/dev/vg_nvme/lv_2', 'c1.osd.2': '/dev/vg_nvme/lv_3'}, Remote(name='ubuntu@gibba036.front.sepia.ceph.com'): {'c2.osd.0': '/dev/vg_nvme/lv_1', 'c2.osd.1': '/dev/vg_nvme/lv_2', 'c2.osd.2': '/dev/vg_nvme/lv_3'}} 2021-02-13T17:52:08.216 DEBUG:teuthology.orchestra.run.gibba036:> sudo mkdir -p /var/lib/ceph/osd/c2-0 2021-02-13T17:52:08.268 INFO:tasks.ceph:roles_to_devs: {'c2.osd.0': '/dev/vg_nvme/lv_1', 'c2.osd.1': '/dev/vg_nvme/lv_2', 'c2.osd.2': '/dev/vg_nvme/lv_3'} 2021-02-13T17:52:08.268 INFO:tasks.ceph:role: c2.osd.0 2021-02-13T17:52:08.268 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@gibba036.front.sepia.ceph.com 2021-02-13T17:52:08.268 DEBUG:teuthology.orchestra.run.gibba036:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2021-02-13T17:52:08.348 INFO:teuthology.orchestra.run.gibba036.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5505024 blks 2021-02-13T17:52:08.349 INFO:teuthology.orchestra.run.gibba036.stdout: = sectsz=512 attr=2, projid32bit=1 2021-02-13T17:52:08.349 INFO:teuthology.orchestra.run.gibba036.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2021-02-13T17:52:08.349 INFO:teuthology.orchestra.run.gibba036.stdout:data = bsize=4096 blocks=22020096, imaxpct=25 2021-02-13T17:52:08.349 INFO:teuthology.orchestra.run.gibba036.stdout: = sunit=0 swidth=0 blks 2021-02-13T17:52:08.349 INFO:teuthology.orchestra.run.gibba036.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2021-02-13T17:52:08.349 INFO:teuthology.orchestra.run.gibba036.stdout:log =internal log bsize=4096 blocks=10752, version=2 2021-02-13T17:52:08.349 INFO:teuthology.orchestra.run.gibba036.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-02-13T17:52:08.349 INFO:teuthology.orchestra.run.gibba036.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-02-13T17:52:08.350 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@gibba036.front.sepia.ceph.com -o noatime 2021-02-13T17:52:08.351 DEBUG:teuthology.orchestra.run.gibba036:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/c2-0 2021-02-13T17:52:08.408 DEBUG:teuthology.orchestra.run.gibba036:> sudo /sbin/restorecon /var/lib/ceph/osd/c2-0 2021-02-13T17:52:08.458 INFO:teuthology.orchestra.run.gibba036.stderr:sudo: /sbin/restorecon: command not found 2021-02-13T17:52:08.458 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-13T17:52:08.459 DEBUG:teuthology.orchestra.run.gibba036:> sudo mkdir -p /var/lib/ceph/osd/c2-1 2021-02-13T17:52:08.518 INFO:tasks.ceph:roles_to_devs: {'c2.osd.0': '/dev/vg_nvme/lv_1', 'c2.osd.1': '/dev/vg_nvme/lv_2', 'c2.osd.2': '/dev/vg_nvme/lv_3'} 2021-02-13T17:52:08.519 INFO:tasks.ceph:role: c2.osd.1 2021-02-13T17:52:08.519 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@gibba036.front.sepia.ceph.com 2021-02-13T17:52:08.519 DEBUG:teuthology.orchestra.run.gibba036:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2021-02-13T17:52:08.613 INFO:teuthology.orchestra.run.gibba036.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5505024 blks 2021-02-13T17:52:08.614 INFO:teuthology.orchestra.run.gibba036.stdout: = sectsz=512 attr=2, projid32bit=1 2021-02-13T17:52:08.614 INFO:teuthology.orchestra.run.gibba036.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2021-02-13T17:52:08.614 INFO:teuthology.orchestra.run.gibba036.stdout:data = bsize=4096 blocks=22020096, imaxpct=25 2021-02-13T17:52:08.614 INFO:teuthology.orchestra.run.gibba036.stdout: = sunit=0 swidth=0 blks 2021-02-13T17:52:08.614 INFO:teuthology.orchestra.run.gibba036.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2021-02-13T17:52:08.614 INFO:teuthology.orchestra.run.gibba036.stdout:log =internal log bsize=4096 blocks=10752, version=2 2021-02-13T17:52:08.614 INFO:teuthology.orchestra.run.gibba036.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-02-13T17:52:08.614 INFO:teuthology.orchestra.run.gibba036.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-02-13T17:52:08.616 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@gibba036.front.sepia.ceph.com -o noatime 2021-02-13T17:52:08.616 DEBUG:teuthology.orchestra.run.gibba036:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/c2-1 2021-02-13T17:52:08.631 DEBUG:teuthology.orchestra.run.gibba036:> sudo /sbin/restorecon /var/lib/ceph/osd/c2-1 2021-02-13T17:52:08.688 INFO:teuthology.orchestra.run.gibba036.stderr:sudo: /sbin/restorecon: command not found 2021-02-13T17:52:08.689 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-13T17:52:08.689 DEBUG:teuthology.orchestra.run.gibba036:> sudo mkdir -p /var/lib/ceph/osd/c2-2 2021-02-13T17:52:08.749 INFO:tasks.ceph:roles_to_devs: {'c2.osd.0': '/dev/vg_nvme/lv_1', 'c2.osd.1': '/dev/vg_nvme/lv_2', 'c2.osd.2': '/dev/vg_nvme/lv_3'} 2021-02-13T17:52:08.750 INFO:tasks.ceph:role: c2.osd.2 2021-02-13T17:52:08.750 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@gibba036.front.sepia.ceph.com 2021-02-13T17:52:08.750 DEBUG:teuthology.orchestra.run.gibba036:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2021-02-13T17:52:08.829 INFO:teuthology.orchestra.run.gibba036.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5505024 blks 2021-02-13T17:52:08.829 INFO:teuthology.orchestra.run.gibba036.stdout: = sectsz=512 attr=2, projid32bit=1 2021-02-13T17:52:08.829 INFO:teuthology.orchestra.run.gibba036.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2021-02-13T17:52:08.829 INFO:teuthology.orchestra.run.gibba036.stdout:data = bsize=4096 blocks=22020096, imaxpct=25 2021-02-13T17:52:08.829 INFO:teuthology.orchestra.run.gibba036.stdout: = sunit=0 swidth=0 blks 2021-02-13T17:52:08.829 INFO:teuthology.orchestra.run.gibba036.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2021-02-13T17:52:08.829 INFO:teuthology.orchestra.run.gibba036.stdout:log =internal log bsize=4096 blocks=10752, version=2 2021-02-13T17:52:08.829 INFO:teuthology.orchestra.run.gibba036.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-02-13T17:52:08.829 INFO:teuthology.orchestra.run.gibba036.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-02-13T17:52:08.830 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@gibba036.front.sepia.ceph.com -o noatime 2021-02-13T17:52:08.831 DEBUG:teuthology.orchestra.run.gibba036:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/c2-2 2021-02-13T17:52:08.907 DEBUG:teuthology.orchestra.run.gibba036:> sudo /sbin/restorecon /var/lib/ceph/osd/c2-2 2021-02-13T17:52:08.959 INFO:teuthology.orchestra.run.gibba036.stderr:sudo: /sbin/restorecon: command not found 2021-02-13T17:52:08.960 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-13T17:52:08.960 DEBUG:teuthology.orchestra.run.gibba036:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster c2 --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/c2.monmap 2021-02-13T17:52:09.069 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:09.063 7f3e686b5c00 -1 auth: error reading file: /var/lib/ceph/osd/c2-0/keyring: can't open /var/lib/ceph/osd/c2-0/keyring: (2) No such file or directory 2021-02-13T17:52:09.069 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:09.063 7f3e686b5c00 -1 created new key in keyring /var/lib/ceph/osd/c2-0/keyring 2021-02-13T17:52:09.069 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:09.063 7f3e686b5c00 -1 bluestore(/var/lib/ceph/osd/c2-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-0/block: (2) No such file or directory 2021-02-13T17:52:09.069 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:09.063 7f3e686b5c00 -1 bluestore(/var/lib/ceph/osd/c2-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-0/block: (2) No such file or directory 2021-02-13T17:52:09.069 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:09.063 7f3e686b5c00 -1 bluestore(/var/lib/ceph/osd/c2-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-0/block: (2) No such file or directory 2021-02-13T17:52:09.070 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:09.067 7f3e686b5c00 -1 bluestore(/var/lib/ceph/osd/c2-0) _read_fsid unparsable uuid 2021-02-13T17:52:11.252 DEBUG:teuthology.orchestra.run.gibba036:> sudo chown -R ceph:ceph /var/lib/ceph/osd/c2-0 2021-02-13T17:52:11.263 DEBUG:teuthology.orchestra.run.gibba036:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster c2 --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/c2.monmap 2021-02-13T17:52:11.325 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:11.319 7f4ebf1a8c00 -1 auth: error reading file: /var/lib/ceph/osd/c2-1/keyring: can't open /var/lib/ceph/osd/c2-1/keyring: (2) No such file or directory 2021-02-13T17:52:11.325 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:11.319 7f4ebf1a8c00 -1 created new key in keyring /var/lib/ceph/osd/c2-1/keyring 2021-02-13T17:52:11.325 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:11.319 7f4ebf1a8c00 -1 bluestore(/var/lib/ceph/osd/c2-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-1/block: (2) No such file or directory 2021-02-13T17:52:11.326 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:11.319 7f4ebf1a8c00 -1 bluestore(/var/lib/ceph/osd/c2-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-1/block: (2) No such file or directory 2021-02-13T17:52:11.326 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:11.319 7f4ebf1a8c00 -1 bluestore(/var/lib/ceph/osd/c2-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-1/block: (2) No such file or directory 2021-02-13T17:52:11.326 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:11.323 7f4ebf1a8c00 -1 bluestore(/var/lib/ceph/osd/c2-1) _read_fsid unparsable uuid 2021-02-13T17:52:13.500 DEBUG:teuthology.orchestra.run.gibba036:> sudo chown -R ceph:ceph /var/lib/ceph/osd/c2-1 2021-02-13T17:52:13.548 DEBUG:teuthology.orchestra.run.gibba036:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster c2 --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/c2.monmap 2021-02-13T17:52:13.609 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:13.603 7fa35e3e8c00 -1 auth: error reading file: /var/lib/ceph/osd/c2-2/keyring: can't open /var/lib/ceph/osd/c2-2/keyring: (2) No such file or directory 2021-02-13T17:52:13.609 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:13.603 7fa35e3e8c00 -1 created new key in keyring /var/lib/ceph/osd/c2-2/keyring 2021-02-13T17:52:13.609 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:13.603 7fa35e3e8c00 -1 bluestore(/var/lib/ceph/osd/c2-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-2/block: (2) No such file or directory 2021-02-13T17:52:13.609 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:13.603 7fa35e3e8c00 -1 bluestore(/var/lib/ceph/osd/c2-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-2/block: (2) No such file or directory 2021-02-13T17:52:13.609 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:13.603 7fa35e3e8c00 -1 bluestore(/var/lib/ceph/osd/c2-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-2/block: (2) No such file or directory 2021-02-13T17:52:13.609 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:13.603 7fa35e3e8c00 -1 bluestore(/var/lib/ceph/osd/c2-2) _read_fsid unparsable uuid 2021-02-13T17:52:15.787 DEBUG:teuthology.orchestra.run.gibba036:> sudo chown -R ceph:ceph /var/lib/ceph/osd/c2-2 2021-02-13T17:52:15.840 INFO:tasks.ceph:Reading keys from all nodes... 2021-02-13T17:52:15.840 DEBUG:teuthology.orchestra.run.gibba036:> mktemp 2021-02-13T17:52:15.886 INFO:teuthology.orchestra.run.gibba036.stdout:/tmp/tmp.8PBCEwZt65 2021-02-13T17:52:15.886 DEBUG:teuthology.orchestra.run.gibba036:> sudo cp /var/lib/ceph/mgr/c2-x/keyring /tmp/tmp.8PBCEwZt65 2021-02-13T17:52:15.940 DEBUG:teuthology.orchestra.run.gibba036:> sudo chmod 0666 /tmp/tmp.8PBCEwZt65 2021-02-13T17:52:16.040 DEBUG:teuthology.orchestra.remote:gibba036:/tmp/tmp.8PBCEwZt65 is 56B 2021-02-13T17:52:16.054 DEBUG:teuthology.orchestra.run.gibba036:> rm -fr /tmp/tmp.8PBCEwZt65 2021-02-13T17:52:16.062 DEBUG:teuthology.orchestra.run.gibba036:> mktemp 2021-02-13T17:52:16.113 INFO:teuthology.orchestra.run.gibba036.stdout:/tmp/tmp.ulVy0rv7iO 2021-02-13T17:52:16.114 DEBUG:teuthology.orchestra.run.gibba036:> sudo cp /var/lib/ceph/osd/c2-0/keyring /tmp/tmp.ulVy0rv7iO 2021-02-13T17:52:16.165 DEBUG:teuthology.orchestra.run.gibba036:> sudo chmod 0666 /tmp/tmp.ulVy0rv7iO 2021-02-13T17:52:16.276 DEBUG:teuthology.orchestra.remote:gibba036:/tmp/tmp.ulVy0rv7iO is 56B 2021-02-13T17:52:16.328 DEBUG:teuthology.orchestra.run.gibba036:> rm -fr /tmp/tmp.ulVy0rv7iO 2021-02-13T17:52:16.332 DEBUG:teuthology.orchestra.run.gibba036:> mktemp 2021-02-13T17:52:16.381 INFO:teuthology.orchestra.run.gibba036.stdout:/tmp/tmp.o0EIhepXTR 2021-02-13T17:52:16.381 DEBUG:teuthology.orchestra.run.gibba036:> sudo cp /var/lib/ceph/osd/c2-1/keyring /tmp/tmp.o0EIhepXTR 2021-02-13T17:52:16.442 DEBUG:teuthology.orchestra.run.gibba036:> sudo chmod 0666 /tmp/tmp.o0EIhepXTR 2021-02-13T17:52:16.544 DEBUG:teuthology.orchestra.remote:gibba036:/tmp/tmp.o0EIhepXTR is 56B 2021-02-13T17:52:16.597 DEBUG:teuthology.orchestra.run.gibba036:> rm -fr /tmp/tmp.o0EIhepXTR 2021-02-13T17:52:16.605 DEBUG:teuthology.orchestra.run.gibba036:> mktemp 2021-02-13T17:52:16.653 INFO:teuthology.orchestra.run.gibba036.stdout:/tmp/tmp.jmkfdGWlD0 2021-02-13T17:52:16.654 DEBUG:teuthology.orchestra.run.gibba036:> sudo cp /var/lib/ceph/osd/c2-2/keyring /tmp/tmp.jmkfdGWlD0 2021-02-13T17:52:16.714 DEBUG:teuthology.orchestra.run.gibba036:> sudo chmod 0666 /tmp/tmp.jmkfdGWlD0 2021-02-13T17:52:16.829 DEBUG:teuthology.orchestra.remote:gibba036:/tmp/tmp.jmkfdGWlD0 is 56B 2021-02-13T17:52:16.842 DEBUG:teuthology.orchestra.run.gibba036:> rm -fr /tmp/tmp.jmkfdGWlD0 2021-02-13T17:52:16.897 DEBUG:teuthology.orchestra.remote:gibba036:/etc/ceph/c2.client.0.keyring is 59B 2021-02-13T17:52:16.958 DEBUG:teuthology.orchestra.remote:gibba036:/etc/ceph/c2.client.1.keyring is 59B 2021-02-13T17:52:16.973 INFO:tasks.ceph:Adding keys to all mons... 2021-02-13T17:52:16.974 DEBUG:teuthology.orchestra.run.gibba036:> sudo tee -a /etc/ceph/c2.keyring 2021-02-13T17:52:16.991 INFO:teuthology.orchestra.run.gibba036.stdout:[mgr.x] 2021-02-13T17:52:16.992 INFO:teuthology.orchestra.run.gibba036.stdout: key = AQDIEShgYqxYBBAAQsqOZHJiSERdfyk3Hk3ZHQ== 2021-02-13T17:52:16.992 INFO:teuthology.orchestra.run.gibba036.stdout:[osd.0] 2021-02-13T17:52:16.992 INFO:teuthology.orchestra.run.gibba036.stdout: key = AQDJEShgVGIFBBAAAahzO0Rn0yuzDjTycRR3bQ== 2021-02-13T17:52:16.992 INFO:teuthology.orchestra.run.gibba036.stdout:[osd.1] 2021-02-13T17:52:16.992 INFO:teuthology.orchestra.run.gibba036.stdout: key = AQDLEShgGSVTExAA/YdUxTMlY+jbd2KeEvCVNg== 2021-02-13T17:52:16.993 INFO:teuthology.orchestra.run.gibba036.stdout:[osd.2] 2021-02-13T17:52:16.993 INFO:teuthology.orchestra.run.gibba036.stdout: key = AQDNEShgFrk3JBAA5NYQBWtZs/dpikd8uoOgfw== 2021-02-13T17:52:16.993 INFO:teuthology.orchestra.run.gibba036.stdout:[client.0] 2021-02-13T17:52:16.993 INFO:teuthology.orchestra.run.gibba036.stdout: key = AQDIEShgZFQYCBAAeIq0X3SQisoFF9E6c8n3DQ== 2021-02-13T17:52:16.993 INFO:teuthology.orchestra.run.gibba036.stdout:[client.1] 2021-02-13T17:52:16.994 INFO:teuthology.orchestra.run.gibba036.stdout: key = AQDIEShgK1RHDBAAFSEtMDDPdS/QSC6GMCdfCQ== 2021-02-13T17:52:16.995 DEBUG:teuthology.orchestra.run.gibba036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c2.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2021-02-13T17:52:17.061 DEBUG:teuthology.orchestra.run.gibba036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c2.keyring --name=osd.0 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-02-13T17:52:17.130 DEBUG:teuthology.orchestra.run.gibba036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c2.keyring --name=osd.1 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-02-13T17:52:17.199 DEBUG:teuthology.orchestra.run.gibba036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c2.keyring --name=osd.2 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-02-13T17:52:17.284 DEBUG:teuthology.orchestra.run.gibba036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c2.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-02-13T17:52:17.365 DEBUG:teuthology.orchestra.run.gibba036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c2.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-02-13T17:52:17.434 INFO:tasks.ceph:Running mkfs on mon nodes... 2021-02-13T17:52:17.434 DEBUG:teuthology.orchestra.run.gibba036:> sudo mkdir -p /var/lib/ceph/mon/c2-a 2021-02-13T17:52:17.488 DEBUG:teuthology.orchestra.run.gibba036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster c2 --mkfs -i a --monmap /home/ubuntu/cephtest/c2.monmap --keyring /etc/ceph/c2.keyring 2021-02-13T17:52:17.573 DEBUG:teuthology.orchestra.run.gibba036:> sudo chown -R ceph:ceph /var/lib/ceph/mon/c2-a 2021-02-13T17:52:17.622 DEBUG:teuthology.orchestra.run.gibba036:> rm -- /home/ubuntu/cephtest/c2.monmap 2021-02-13T17:52:17.674 INFO:tasks.ceph:Starting mon daemons in cluster c2... 2021-02-13T17:52:17.674 INFO:tasks.ceph.c2.mon.a:Restarting daemon 2021-02-13T17:52:17.674 DEBUG:teuthology.orchestra.run.gibba036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster c2 -i a 2021-02-13T17:52:17.720 INFO:tasks.ceph.c2.mon.a:Started 2021-02-13T17:52:17.721 INFO:tasks.ceph:Starting mgr daemons in cluster c2... 2021-02-13T17:52:17.721 INFO:tasks.ceph.c2.mgr.x:Restarting daemon 2021-02-13T17:52:17.721 DEBUG:teuthology.orchestra.run.gibba036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster c2 -i x 2021-02-13T17:52:17.723 INFO:tasks.ceph.c2.mgr.x:Started 2021-02-13T17:52:17.724 INFO:tasks.ceph:Setting crush tunables to default 2021-02-13T17:52:17.724 DEBUG:teuthology.orchestra.run.gibba036:> sudo ceph --cluster c2 osd crush tunables default 2021-02-13T17:52:17.869 INFO:teuthology.orchestra.run.gibba036.stderr:adjusted tunables profile to default 2021-02-13T17:52:17.878 INFO:tasks.ceph:Starting osd daemons in cluster c2... 2021-02-13T17:52:17.878 DEBUG:teuthology.orchestra.run.gibba036:> mktemp 2021-02-13T17:52:17.881 INFO:teuthology.orchestra.run.gibba036.stdout:/tmp/tmp.oYYD8ctkYJ 2021-02-13T17:52:17.881 DEBUG:teuthology.orchestra.run.gibba036:> sudo cp /var/lib/ceph/osd/c2-0/fsid /tmp/tmp.oYYD8ctkYJ 2021-02-13T17:52:17.927 DEBUG:teuthology.orchestra.run.gibba036:> sudo chmod 0666 /tmp/tmp.oYYD8ctkYJ 2021-02-13T17:52:18.023 DEBUG:teuthology.orchestra.remote:gibba036:/tmp/tmp.oYYD8ctkYJ is 37B 2021-02-13T17:52:18.078 DEBUG:teuthology.orchestra.run.gibba036:> rm -fr /tmp/tmp.oYYD8ctkYJ 2021-02-13T17:52:18.086 DEBUG:teuthology.orchestra.run.gibba036:> mktemp 2021-02-13T17:52:18.133 INFO:teuthology.orchestra.run.gibba036.stdout:/tmp/tmp.DUtnhdC7p6 2021-02-13T17:52:18.133 DEBUG:teuthology.orchestra.run.gibba036:> sudo cp /var/lib/ceph/osd/c2-1/fsid /tmp/tmp.DUtnhdC7p6 2021-02-13T17:52:18.184 DEBUG:teuthology.orchestra.run.gibba036:> sudo chmod 0666 /tmp/tmp.DUtnhdC7p6 2021-02-13T17:52:18.278 DEBUG:teuthology.orchestra.remote:gibba036:/tmp/tmp.DUtnhdC7p6 is 37B 2021-02-13T17:52:18.327 DEBUG:teuthology.orchestra.run.gibba036:> rm -fr /tmp/tmp.DUtnhdC7p6 2021-02-13T17:52:18.330 DEBUG:teuthology.orchestra.run.gibba036:> mktemp 2021-02-13T17:52:18.372 INFO:teuthology.orchestra.run.gibba036.stdout:/tmp/tmp.YPyenvI92S 2021-02-13T17:52:18.373 DEBUG:teuthology.orchestra.run.gibba036:> sudo cp /var/lib/ceph/osd/c2-2/fsid /tmp/tmp.YPyenvI92S 2021-02-13T17:52:18.419 DEBUG:teuthology.orchestra.run.gibba036:> sudo chmod 0666 /tmp/tmp.YPyenvI92S 2021-02-13T17:52:18.514 DEBUG:teuthology.orchestra.remote:gibba036:/tmp/tmp.YPyenvI92S is 37B 2021-02-13T17:52:18.562 DEBUG:teuthology.orchestra.run.gibba036:> rm -fr /tmp/tmp.YPyenvI92S 2021-02-13T17:52:18.565 DEBUG:teuthology.orchestra.run.gibba036:> sudo ceph --cluster c2 osd new 88d3b0c3-c325-4362-8390-1b1f41e1cdfb 0 2021-02-13T17:52:18.729 INFO:teuthology.orchestra.run.gibba036.stdout:0 2021-02-13T17:52:18.738 DEBUG:teuthology.orchestra.run.gibba036:> sudo ceph --cluster c2 osd new 6b4337f3-1315-4cc8-9bda-d80cdb51f923 1 2021-02-13T17:52:18.863 INFO:teuthology.orchestra.run.gibba036.stdout:1 2021-02-13T17:52:18.872 DEBUG:teuthology.orchestra.run.gibba036:> sudo ceph --cluster c2 osd new 87510b9f-ea18-4193-9b73-d4972bfc5777 2 2021-02-13T17:52:18.997 INFO:teuthology.orchestra.run.gibba036.stdout:2 2021-02-13T17:52:19.005 INFO:tasks.ceph.c2.osd.0:Restarting daemon 2021-02-13T17:52:19.006 DEBUG:teuthology.orchestra.run.gibba036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster c2 -i 0 2021-02-13T17:52:19.008 INFO:tasks.ceph.c2.osd.0:Started 2021-02-13T17:52:19.008 INFO:tasks.ceph.c2.osd.1:Restarting daemon 2021-02-13T17:52:19.008 DEBUG:teuthology.orchestra.run.gibba036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster c2 -i 1 2021-02-13T17:52:19.010 INFO:tasks.ceph.c2.osd.1:Started 2021-02-13T17:52:19.010 INFO:tasks.ceph.c2.osd.2:Restarting daemon 2021-02-13T17:52:19.010 DEBUG:teuthology.orchestra.run.gibba036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster c2 -i 2 2021-02-13T17:52:19.012 INFO:tasks.ceph.c2.osd.2:Started 2021-02-13T17:52:19.012 INFO:tasks.ceph:Waiting for OSDs to come up 2021-02-13T17:52:19.315 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster c2 osd dump --format=json 2021-02-13T17:52:19.437 INFO:teuthology.misc.health.gibba036.stdout: 2021-02-13T17:52:19.437 INFO:teuthology.misc.health.gibba036.stdout:{"epoch":5,"fsid":"554ed120-a4b0-4e13-b48c-53832c6f02bd","created":"2021-02-13 17:52:17.785547","modified":"2021-02-13 17:52:18.993085","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[],"osds":[{"osd":0,"uuid":"88d3b0c3-c325-4362-8390-1b1f41e1cdfb","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":":/0","cluster_addr":":/0","heartbeat_back_addr":":/0","heartbeat_front_addr":":/0","state":["exists","new"]},{"osd":1,"uuid":"6b4337f3-1315-4cc8-9bda-d80cdb51f923","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":":/0","cluster_addr":":/0","heartbeat_back_addr":":/0","heartbeat_front_addr":":/0","state":["exists","new"]},{"osd":2,"uuid":"87510b9f-ea18-4193-9b73-d4972bfc5777","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":":/0","cluster_addr":":/0","heartbeat_back_addr":":/0","heartbeat_front_addr":":/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-13T17:52:19.444 DEBUG:teuthology.misc:0 of 3 OSDs are up 2021-02-13T17:52:19.583 INFO:tasks.ceph.c2.osd.0.gibba036.stderr:2021-02-13 17:52:19.579 7f444314ec00 -1 Falling back to public interface 2021-02-13T17:52:19.595 INFO:tasks.ceph.c2.osd.1.gibba036.stderr:2021-02-13 17:52:19.591 7f91c0183c00 -1 Falling back to public interface 2021-02-13T17:52:19.602 INFO:tasks.ceph.c2.osd.2.gibba036.stderr:2021-02-13 17:52:19.599 7f9041042c00 -1 Falling back to public interface 2021-02-13T17:52:20.183 INFO:tasks.ceph.c2.osd.0.gibba036.stderr:2021-02-13 17:52:20.179 7f444314ec00 -1 osd.0 0 log_to_monitors {default=true} 2021-02-13T17:52:20.242 INFO:tasks.ceph.c2.osd.1.gibba036.stderr:2021-02-13 17:52:20.235 7f91c0183c00 -1 osd.1 0 log_to_monitors {default=true} 2021-02-13T17:52:20.261 INFO:tasks.ceph.c2.osd.2.gibba036.stderr:2021-02-13 17:52:20.255 7f9041042c00 -1 osd.2 0 log_to_monitors {default=true} 2021-02-13T17:52:21.814 INFO:tasks.ceph.c2.osd.0.gibba036.stderr:2021-02-13 17:52:21.807 7f442a1ee700 -1 osd.0 0 waiting for initial osdmap 2021-02-13T17:52:21.814 INFO:tasks.ceph.c2.osd.2.gibba036.stderr:2021-02-13 17:52:21.807 7f90280e2700 -1 osd.2 0 waiting for initial osdmap 2021-02-13T17:52:21.814 INFO:tasks.ceph.c2.osd.1.gibba036.stderr:2021-02-13 17:52:21.807 7f91a7223700 -1 osd.1 0 waiting for initial osdmap 2021-02-13T17:52:21.817 INFO:tasks.ceph.c2.osd.0.gibba036.stderr:2021-02-13 17:52:21.811 7f4436a07700 -1 osd.0 7 set_numa_affinity unable to identify public interface 'enp1s0f0' numa node: (0) Success 2021-02-13T17:52:21.817 INFO:tasks.ceph.c2.osd.1.gibba036.stderr:2021-02-13 17:52:21.811 7f91b3a3c700 -1 osd.1 7 set_numa_affinity unable to identify public interface 'enp1s0f0' numa node: (0) Success 2021-02-13T17:52:21.817 INFO:tasks.ceph.c2.osd.2.gibba036.stderr:2021-02-13 17:52:21.811 7f90348fb700 -1 osd.2 7 set_numa_affinity unable to identify public interface 'enp1s0f0' numa node: (0) Success 2021-02-13T17:52:25.749 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster c2 osd dump --format=json 2021-02-13T17:52:25.908 INFO:teuthology.misc.health.gibba036.stdout: 2021-02-13T17:52:25.908 INFO:teuthology.misc.health.gibba036.stdout:{"epoch":8,"fsid":"554ed120-a4b0-4e13-b48c-53832c6f02bd","created":"2021-02-13 17:52:17.785547","modified":"2021-02-13 17:52:22.801340","last_up_change":"2021-02-13 17:52:22.801340","last_in_change":"2021-02-13 17:52:22.801340","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[],"osds":[{"osd":0,"uuid":"88d3b0c3-c325-4362-8390-1b1f41e1cdfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.136:6800","nonce":14263},{"type":"v1","addr":"172.21.2.136:6801","nonce":14263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.136:6802","nonce":14263},{"type":"v1","addr":"172.21.2.136:6803","nonce":14263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.136:6806","nonce":14263},{"type":"v1","addr":"172.21.2.136:6807","nonce":14263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.136:6804","nonce":14263},{"type":"v1","addr":"172.21.2.136:6805","nonce":14263}]},"public_addr":"172.21.2.136:6801/14263","cluster_addr":"172.21.2.136:6803/14263","heartbeat_back_addr":"172.21.2.136:6807/14263","heartbeat_front_addr":"172.21.2.136:6805/14263","state":["exists","up"]},{"osd":1,"uuid":"6b4337f3-1315-4cc8-9bda-d80cdb51f923","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.136:6808","nonce":14264},{"type":"v1","addr":"172.21.2.136:6809","nonce":14264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.136:6810","nonce":14264},{"type":"v1","addr":"172.21.2.136:6811","nonce":14264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.136:6814","nonce":14264},{"type":"v1","addr":"172.21.2.136:6815","nonce":14264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.136:6812","nonce":14264},{"type":"v1","addr":"172.21.2.136:6813","nonce":14264}]},"public_addr":"172.21.2.136:6809/14264","cluster_addr":"172.21.2.136:6811/14264","heartbeat_back_addr":"172.21.2.136:6815/14264","heartbeat_front_addr":"172.21.2.136:6813/14264","state":["exists","up"]},{"osd":2,"uuid":"87510b9f-ea18-4193-9b73-d4972bfc5777","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.136:6816","nonce":14265},{"type":"v1","addr":"172.21.2.136:6817","nonce":14265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.136:6818","nonce":14265},{"type":"v1","addr":"172.21.2.136:6819","nonce":14265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.136:6822","nonce":14265},{"type":"v1","addr":"172.21.2.136:6823","nonce":14265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.136:6820","nonce":14265},{"type":"v1","addr":"172.21.2.136:6821","nonce":14265}]},"public_addr":"172.21.2.136:6817/14265","cluster_addr":"172.21.2.136:6819/14265","heartbeat_back_addr":"172.21.2.136:6823/14265","heartbeat_front_addr":"172.21.2.136:6821/14265","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-13T17:52:25.916 DEBUG:teuthology.misc:3 of 3 OSDs are up 2021-02-13T17:52:25.916 INFO:tasks.ceph:Creating RBD pool 2021-02-13T17:52:25.916 DEBUG:teuthology.orchestra.run.gibba036:> sudo ceph --cluster c2 osd pool create rbd 8 2021-02-13T17:52:26.838 INFO:teuthology.orchestra.run.gibba036.stderr:pool 'rbd' created 2021-02-13T17:52:26.868 DEBUG:teuthology.orchestra.run.gibba036:> sudo ceph --cluster c2 osd pool application enable rbd rbd --yes-i-really-mean-it 2021-02-13T17:52:27.848 INFO:teuthology.orchestra.run.gibba036.stderr:enabled application 'rbd' on pool 'rbd' 2021-02-13T17:52:27.859 INFO:tasks.ceph:Starting mds daemons in cluster c2... 2021-02-13T17:52:27.860 DEBUG:teuthology.orchestra.run.gibba036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster c2 osd dump --format=json 2021-02-13T17:52:28.017 INFO:teuthology.orchestra.run.gibba036.stdout: 2021-02-13T17:52:28.017 INFO:teuthology.orchestra.run.gibba036.stdout:{"epoch":10,"fsid":"554ed120-a4b0-4e13-b48c-53832c6f02bd","created":"2021-02-13 17:52:17.785547","modified":"2021-02-13 17:52:27.806408","last_up_change":"2021-02-13 17:52:22.801340","last_in_change":"2021-02-13 17:52:22.801340","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-02-13 17:52:26.067802","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"10","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"88d3b0c3-c325-4362-8390-1b1f41e1cdfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.136:6800","nonce":14263},{"type":"v1","addr":"172.21.2.136:6801","nonce":14263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.136:6802","nonce":14263},{"type":"v1","addr":"172.21.2.136:6803","nonce":14263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.136:6806","nonce":14263},{"type":"v1","addr":"172.21.2.136:6807","nonce":14263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.136:6804","nonce":14263},{"type":"v1","addr":"172.21.2.136:6805","nonce":14263}]},"public_addr":"172.21.2.136:6801/14263","cluster_addr":"172.21.2.136:6803/14263","heartbeat_back_addr":"172.21.2.136:6807/14263","heartbeat_front_addr":"172.21.2.136:6805/14263","state":["exists","up"]},{"osd":1,"uuid":"6b4337f3-1315-4cc8-9bda-d80cdb51f923","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.136:6808","nonce":14264},{"type":"v1","addr":"172.21.2.136:6809","nonce":14264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.136:6810","nonce":14264},{"type":"v1","addr":"172.21.2.136:6811","nonce":14264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.136:6814","nonce":14264},{"type":"v1","addr":"172.21.2.136:6815","nonce":14264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.136:6812","nonce":14264},{"type":"v1","addr":"172.21.2.136:6813","nonce":14264}]},"public_addr":"172.21.2.136:6809/14264","cluster_addr":"172.21.2.136:6811/14264","heartbeat_back_addr":"172.21.2.136:6815/14264","heartbeat_front_addr":"172.21.2.136:6813/14264","state":["exists","up"]},{"osd":2,"uuid":"87510b9f-ea18-4193-9b73-d4972bfc5777","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.136:6816","nonce":14265},{"type":"v1","addr":"172.21.2.136:6817","nonce":14265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.136:6818","nonce":14265},{"type":"v1","addr":"172.21.2.136:6819","nonce":14265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.136:6822","nonce":14265},{"type":"v1","addr":"172.21.2.136:6823","nonce":14265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.136:6820","nonce":14265},{"type":"v1","addr":"172.21.2.136:6821","nonce":14265}]},"public_addr":"172.21.2.136:6817/14265","cluster_addr":"172.21.2.136:6819/14265","heartbeat_back_addr":"172.21.2.136:6823/14265","heartbeat_front_addr":"172.21.2.136:6821/14265","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-13T17:52:28.025 INFO:tasks.ceph.ceph_manager.c2:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2021-02-13 17:52:26.067802', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'warn', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '10', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-02-13T17:52:28.025 DEBUG:teuthology.orchestra.run.gibba036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster c2 osd pool get rbd pg_num 2021-02-13T17:52:28.176 INFO:teuthology.orchestra.run.gibba036.stdout:pg_num: 8 2021-02-13T17:52:28.184 INFO:tasks.ceph:Waiting until c2 daemons up and pgs clean... 2021-02-13T17:52:28.184 INFO:tasks.ceph.ceph_manager.c2:waiting for mgr available 2021-02-13T17:52:28.184 DEBUG:teuthology.orchestra.run.gibba036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster c2 mgr dump --format=json 2021-02-13T17:52:28.364 INFO:teuthology.orchestra.run.gibba036.stdout: 2021-02-13T17:52:28.372 INFO:teuthology.orchestra.run.gibba036.stdout:{"epoch":3,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.136:6824","nonce":14041},{"type":"v1","addr":"172.21.2.136:6825","nonce":14041}]},"active_addr":"172.21.2.136:6825/14041","active_change":"2021-02-13 17:52:19.742256","available":true,"standbys":[],"modules":["iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"ansible","can_run":true,"error_string":"","module_options":{"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_url":{"name":"server_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_server":{"name":"verify_server","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_iterations":{"name":"upmap_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimization iterations","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"deepsea","can_run":true,"error_string":"","module_options":{"salt_api_eauth":{"name":"salt_api_eauth","type":"str","level":"advanced","flags":0,"default_value":"sharedsecret","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_password":{"name":"salt_api_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_url":{"name":"salt_api_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_username":{"name":"salt_api_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_cloud","can_run":true,"error_string":"","module_options":{"diskprediction_cert_context":{"name":"diskprediction_cert_context","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_default_authority":{"name":"diskprediction_default_authority","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_password":{"name":"diskprediction_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_port":{"name":"diskprediction_port","type":"str","level":"advanced","flags":0,"default_value":"31400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_retrieve_prediction_interval":{"name":"diskprediction_retrieve_prediction_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_server":{"name":"diskprediction_server","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_ssl_target_name_override":{"name":"diskprediction_ssl_target_name_override","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_metrics_interval":{"name":"diskprediction_upload_metrics_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_smart_interval":{"name":"diskprediction_upload_smart_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_user":{"name":"diskprediction_user","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{}},{"name":"iostat","can_run":true,"error_string":"","module_options":{}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator_cli","can_run":true,"error_string":"","module_options":{"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"ssh","can_run":true,"error_string":"","module_options":{"inventory_cache_timeout_min":{"name":"inventory_cache_timeout_min","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"]}} 2021-02-13T17:52:28.373 INFO:tasks.ceph.ceph_manager.c2:mgr available! 2021-02-13T17:52:28.676 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster c2 osd dump --format=json 2021-02-13T17:52:28.833 INFO:teuthology.misc.health.gibba036.stdout: 2021-02-13T17:52:28.834 INFO:teuthology.misc.health.gibba036.stdout:{"epoch":11,"fsid":"554ed120-a4b0-4e13-b48c-53832c6f02bd","created":"2021-02-13 17:52:17.785547","modified":"2021-02-13 17:52:28.811175","last_up_change":"2021-02-13 17:52:22.801340","last_in_change":"2021-02-13 17:52:22.801340","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-02-13 17:52:26.067802","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"88d3b0c3-c325-4362-8390-1b1f41e1cdfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.136:6800","nonce":14263},{"type":"v1","addr":"172.21.2.136:6801","nonce":14263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.136:6802","nonce":14263},{"type":"v1","addr":"172.21.2.136:6803","nonce":14263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.136:6806","nonce":14263},{"type":"v1","addr":"172.21.2.136:6807","nonce":14263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.136:6804","nonce":14263},{"type":"v1","addr":"172.21.2.136:6805","nonce":14263}]},"public_addr":"172.21.2.136:6801/14263","cluster_addr":"172.21.2.136:6803/14263","heartbeat_back_addr":"172.21.2.136:6807/14263","heartbeat_front_addr":"172.21.2.136:6805/14263","state":["exists","up"]},{"osd":1,"uuid":"6b4337f3-1315-4cc8-9bda-d80cdb51f923","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.136:6808","nonce":14264},{"type":"v1","addr":"172.21.2.136:6809","nonce":14264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.136:6810","nonce":14264},{"type":"v1","addr":"172.21.2.136:6811","nonce":14264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.136:6814","nonce":14264},{"type":"v1","addr":"172.21.2.136:6815","nonce":14264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.136:6812","nonce":14264},{"type":"v1","addr":"172.21.2.136:6813","nonce":14264}]},"public_addr":"172.21.2.136:6809/14264","cluster_addr":"172.21.2.136:6811/14264","heartbeat_back_addr":"172.21.2.136:6815/14264","heartbeat_front_addr":"172.21.2.136:6813/14264","state":["exists","up"]},{"osd":2,"uuid":"87510b9f-ea18-4193-9b73-d4972bfc5777","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.136:6816","nonce":14265},{"type":"v1","addr":"172.21.2.136:6817","nonce":14265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.136:6818","nonce":14265},{"type":"v1","addr":"172.21.2.136:6819","nonce":14265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.136:6822","nonce":14265},{"type":"v1","addr":"172.21.2.136:6823","nonce":14265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.136:6820","nonce":14265},{"type":"v1","addr":"172.21.2.136:6821","nonce":14265}]},"public_addr":"172.21.2.136:6817/14265","cluster_addr":"172.21.2.136:6819/14265","heartbeat_back_addr":"172.21.2.136:6823/14265","heartbeat_front_addr":"172.21.2.136:6821/14265","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-13T17:52:28.848 DEBUG:teuthology.misc:3 of 3 OSDs are up 2021-02-13T17:52:28.848 DEBUG:teuthology.orchestra.run.gibba036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster c2 osd dump --format=json 2021-02-13T17:52:29.001 INFO:teuthology.orchestra.run.gibba036.stdout: 2021-02-13T17:52:29.001 INFO:teuthology.orchestra.run.gibba036.stdout:{"epoch":11,"fsid":"554ed120-a4b0-4e13-b48c-53832c6f02bd","created":"2021-02-13 17:52:17.785547","modified":"2021-02-13 17:52:28.811175","last_up_change":"2021-02-13 17:52:22.801340","last_in_change":"2021-02-13 17:52:22.801340","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-02-13 17:52:26.067802","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"88d3b0c3-c325-4362-8390-1b1f41e1cdfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.136:6800","nonce":14263},{"type":"v1","addr":"172.21.2.136:6801","nonce":14263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.136:6802","nonce":14263},{"type":"v1","addr":"172.21.2.136:6803","nonce":14263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.136:6806","nonce":14263},{"type":"v1","addr":"172.21.2.136:6807","nonce":14263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.136:6804","nonce":14263},{"type":"v1","addr":"172.21.2.136:6805","nonce":14263}]},"public_addr":"172.21.2.136:6801/14263","cluster_addr":"172.21.2.136:6803/14263","heartbeat_back_addr":"172.21.2.136:6807/14263","heartbeat_front_addr":"172.21.2.136:6805/14263","state":["exists","up"]},{"osd":1,"uuid":"6b4337f3-1315-4cc8-9bda-d80cdb51f923","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.136:6808","nonce":14264},{"type":"v1","addr":"172.21.2.136:6809","nonce":14264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.136:6810","nonce":14264},{"type":"v1","addr":"172.21.2.136:6811","nonce":14264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.136:6814","nonce":14264},{"type":"v1","addr":"172.21.2.136:6815","nonce":14264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.136:6812","nonce":14264},{"type":"v1","addr":"172.21.2.136:6813","nonce":14264}]},"public_addr":"172.21.2.136:6809/14264","cluster_addr":"172.21.2.136:6811/14264","heartbeat_back_addr":"172.21.2.136:6815/14264","heartbeat_front_addr":"172.21.2.136:6813/14264","state":["exists","up"]},{"osd":2,"uuid":"87510b9f-ea18-4193-9b73-d4972bfc5777","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.136:6816","nonce":14265},{"type":"v1","addr":"172.21.2.136:6817","nonce":14265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.136:6818","nonce":14265},{"type":"v1","addr":"172.21.2.136:6819","nonce":14265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.136:6822","nonce":14265},{"type":"v1","addr":"172.21.2.136:6823","nonce":14265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.136:6820","nonce":14265},{"type":"v1","addr":"172.21.2.136:6821","nonce":14265}]},"public_addr":"172.21.2.136:6817/14265","cluster_addr":"172.21.2.136:6819/14265","heartbeat_back_addr":"172.21.2.136:6823/14265","heartbeat_front_addr":"172.21.2.136:6821/14265","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-13T17:52:29.010 DEBUG:teuthology.orchestra.run.gibba036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster c2 tell osd.0 flush_pg_stats 2021-02-13T17:52:29.068 INFO:teuthology.orchestra.run.gibba036.stdout:34359738372 2021-02-13T17:52:29.075 DEBUG:teuthology.orchestra.run.gibba036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster c2 tell osd.1 flush_pg_stats 2021-02-13T17:52:29.131 INFO:teuthology.orchestra.run.gibba036.stdout:34359738372 2021-02-13T17:52:29.136 DEBUG:teuthology.orchestra.run.gibba036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster c2 tell osd.2 flush_pg_stats 2021-02-13T17:52:29.194 INFO:teuthology.orchestra.run.gibba036.stdout:34359738371 2021-02-13T17:52:29.199 DEBUG:teuthology.orchestra.run.gibba036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster c2 osd last-stat-seq osd.0 2021-02-13T17:52:29.360 INFO:teuthology.orchestra.run.gibba036.stdout:34359738370 2021-02-13T17:52:29.369 INFO:tasks.ceph.ceph_manager.c2:need seq 34359738372 got 34359738370 for osd.0 2021-02-13T17:52:30.370 DEBUG:teuthology.orchestra.run.gibba036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster c2 osd last-stat-seq osd.0 2021-02-13T17:52:30.538 INFO:teuthology.orchestra.run.gibba036.stdout:34359738372 2021-02-13T17:52:30.546 INFO:tasks.ceph.ceph_manager.c2:need seq 34359738372 got 34359738372 for osd.0 2021-02-13T17:52:30.546 DEBUG:teuthology.orchestra.run.gibba036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster c2 osd last-stat-seq osd.1 2021-02-13T17:52:30.715 INFO:teuthology.orchestra.run.gibba036.stdout:34359738372 2021-02-13T17:52:30.724 INFO:tasks.ceph.ceph_manager.c2:need seq 34359738372 got 34359738372 for osd.1 2021-02-13T17:52:30.724 DEBUG:teuthology.orchestra.run.gibba036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster c2 osd last-stat-seq osd.2 2021-02-13T17:52:30.886 INFO:teuthology.orchestra.run.gibba036.stdout:34359738371 2021-02-13T17:52:30.894 INFO:tasks.ceph.ceph_manager.c2:need seq 34359738371 got 34359738371 for osd.2 2021-02-13T17:52:30.894 INFO:tasks.ceph.ceph_manager.c2:waiting for clean 2021-02-13T17:52:30.894 DEBUG:teuthology.orchestra.run.gibba036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster c2 pg dump --format=json 2021-02-13T17:52:31.051 INFO:teuthology.orchestra.run.gibba036.stderr:dumped all 2021-02-13T17:52:31.051 INFO:teuthology.orchestra.run.gibba036.stdout: 2021-02-13T17:52:31.059 INFO:teuthology.orchestra.run.gibba036.stdout:{"pg_ready":true,"pg_map":{"version":13,"stamp":"2021-02-13 17:52:29.748016","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":10,"num_osds":3,"num_per_pool_osds":3,"kb":314572800,"kb_used":3146024,"kb_used_data":272,"kb_used_omap":0,"kb_used_meta":3145728,"kb_avail":311426776,"statfs":{"total":322122547200,"available":318901018624,"internally_reserved":3221225472,"allocated":278528,"data_stored":65370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":3221225472},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"9","reported_epoch":"10","state":"active+clean","last_fresh":"2021-02-13 17:52:27.825304","last_change":"2021-02-13 17:52:27.824875","last_active":"2021-02-13 17:52:27.825304","last_peered":"2021-02-13 17:52:27.825304","last_clean":"2021-02-13 17:52:27.825304","last_became_active":"2021-02-13 17:52:27.824599","last_became_peered":"2021-02-13 17:52:27.824599","last_unstale":"2021-02-13 17:52:27.825304","last_undegraded":"2021-02-13 17:52:27.825304","last_fullsized":"2021-02-13 17:52:27.825304","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-13 17:52:26.799992","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-13 17:52:26.799992","last_clean_scrub_stamp":"2021-02-13 17:52:26.799992","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"9","reported_epoch":"10","state":"active+clean","last_fresh":"2021-02-13 17:52:27.825702","last_change":"2021-02-13 17:52:27.825241","last_active":"2021-02-13 17:52:27.825702","last_peered":"2021-02-13 17:52:27.825702","last_clean":"2021-02-13 17:52:27.825702","last_became_active":"2021-02-13 17:52:27.824999","last_became_peered":"2021-02-13 17:52:27.824999","last_unstale":"2021-02-13 17:52:27.825702","last_undegraded":"2021-02-13 17:52:27.825702","last_fullsized":"2021-02-13 17:52:27.825702","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-13 17:52:26.799992","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-13 17:52:26.799992","last_clean_scrub_stamp":"2021-02-13 17:52:26.799992","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"9","reported_epoch":"10","state":"active+clean","last_fresh":"2021-02-13 17:52:27.825722","last_change":"2021-02-13 17:52:27.825332","last_active":"2021-02-13 17:52:27.825722","last_peered":"2021-02-13 17:52:27.825722","last_clean":"2021-02-13 17:52:27.825722","last_became_active":"2021-02-13 17:52:27.825066","last_became_peered":"2021-02-13 17:52:27.825066","last_unstale":"2021-02-13 17:52:27.825722","last_undegraded":"2021-02-13 17:52:27.825722","last_fullsized":"2021-02-13 17:52:27.825722","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-13 17:52:26.799992","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-13 17:52:26.799992","last_clean_scrub_stamp":"2021-02-13 17:52:26.799992","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"9","reported_epoch":"10","state":"active+clean","last_fresh":"2021-02-13 17:52:27.825865","last_change":"2021-02-13 17:52:27.825386","last_active":"2021-02-13 17:52:27.825865","last_peered":"2021-02-13 17:52:27.825865","last_clean":"2021-02-13 17:52:27.825865","last_became_active":"2021-02-13 17:52:27.825128","last_became_peered":"2021-02-13 17:52:27.825128","last_unstale":"2021-02-13 17:52:27.825865","last_undegraded":"2021-02-13 17:52:27.825865","last_fullsized":"2021-02-13 17:52:27.825865","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-13 17:52:26.799992","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-13 17:52:26.799992","last_clean_scrub_stamp":"2021-02-13 17:52:26.799992","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"10","state":"active+clean","last_fresh":"2021-02-13 17:52:27.824489","last_change":"2021-02-13 17:52:27.824489","last_active":"2021-02-13 17:52:27.824489","last_peered":"2021-02-13 17:52:27.824489","last_clean":"2021-02-13 17:52:27.824489","last_became_active":"2021-02-13 17:52:27.824312","last_became_peered":"2021-02-13 17:52:27.824312","last_unstale":"2021-02-13 17:52:27.824489","last_undegraded":"2021-02-13 17:52:27.824489","last_fullsized":"2021-02-13 17:52:27.824489","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-13 17:52:26.799992","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-13 17:52:26.799992","last_clean_scrub_stamp":"2021-02-13 17:52:26.799992","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"9","reported_epoch":"10","state":"active+clean","last_fresh":"2021-02-13 17:52:27.825311","last_change":"2021-02-13 17:52:27.824792","last_active":"2021-02-13 17:52:27.825311","last_peered":"2021-02-13 17:52:27.825311","last_clean":"2021-02-13 17:52:27.825311","last_became_active":"2021-02-13 17:52:27.824502","last_became_peered":"2021-02-13 17:52:27.824502","last_unstale":"2021-02-13 17:52:27.825311","last_undegraded":"2021-02-13 17:52:27.825311","last_fullsized":"2021-02-13 17:52:27.825311","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-13 17:52:26.799992","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-13 17:52:26.799992","last_clean_scrub_stamp":"2021-02-13 17:52:26.799992","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"9","reported_epoch":"10","state":"active+clean","last_fresh":"2021-02-13 17:52:27.825373","last_change":"2021-02-13 17:52:27.824915","last_active":"2021-02-13 17:52:27.825373","last_peered":"2021-02-13 17:52:27.825373","last_clean":"2021-02-13 17:52:27.825373","last_became_active":"2021-02-13 17:52:27.824628","last_became_peered":"2021-02-13 17:52:27.824628","last_unstale":"2021-02-13 17:52:27.825373","last_undegraded":"2021-02-13 17:52:27.825373","last_fullsized":"2021-02-13 17:52:27.825373","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-13 17:52:26.799992","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-13 17:52:26.799992","last_clean_scrub_stamp":"2021-02-13 17:52:26.799992","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"9","reported_epoch":"10","state":"active+clean","last_fresh":"2021-02-13 17:52:27.825947","last_change":"2021-02-13 17:52:27.825552","last_active":"2021-02-13 17:52:27.825947","last_peered":"2021-02-13 17:52:27.825947","last_clean":"2021-02-13 17:52:27.825947","last_became_active":"2021-02-13 17:52:27.825207","last_became_peered":"2021-02-13 17:52:27.825207","last_unstale":"2021-02-13 17:52:27.825947","last_undegraded":"2021-02-13 17:52:27.825947","last_fullsized":"2021-02-13 17:52:27.825947","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-13 17:52:26.799992","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-13 17:52:26.799992","last_clean_scrub_stamp":"2021-02-13 17:52:26.799992","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738371,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"kb":104857600,"kb_used":1048680,"kb_used_data":96,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":103808920,"statfs":{"total":107374182400,"available":106300334080,"internally_reserved":1073741824,"allocated":98304,"data_stored":23840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]}]},{"osd":0,"up_from":8,"seq":34359738372,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"kb":104857600,"kb_used":1048672,"kb_used_data":88,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":103808928,"statfs":{"total":107374182400,"available":106300342272,"internally_reserved":1073741824,"allocated":90112,"data_stored":20765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]}]},{"osd":1,"up_from":8,"seq":34359738372,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"kb":104857600,"kb_used":1048672,"kb_used_data":88,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":103808928,"statfs":{"total":107374182400,"available":106300342272,"internally_reserved":1073741824,"allocated":90112,"data_stored":20765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6910000000000001}]}]}]}} 2021-02-13T17:52:31.060 DEBUG:teuthology.orchestra.run.gibba036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster c2 pg dump --format=json 2021-02-13T17:52:31.215 INFO:teuthology.orchestra.run.gibba036.stdout: 2021-02-13T17:52:31.216 INFO:teuthology.orchestra.run.gibba036.stderr:dumped all 2021-02-13T17:52:31.223 INFO:teuthology.orchestra.run.gibba036.stdout:{"pg_ready":true,"pg_map":{"version":13,"stamp":"2021-02-13 17:52:29.748016","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":10,"num_osds":3,"num_per_pool_osds":3,"kb":314572800,"kb_used":3146024,"kb_used_data":272,"kb_used_omap":0,"kb_used_meta":3145728,"kb_avail":311426776,"statfs":{"total":322122547200,"available":318901018624,"internally_reserved":3221225472,"allocated":278528,"data_stored":65370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":3221225472},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"9","reported_epoch":"10","state":"active+clean","last_fresh":"2021-02-13 17:52:27.825304","last_change":"2021-02-13 17:52:27.824875","last_active":"2021-02-13 17:52:27.825304","last_peered":"2021-02-13 17:52:27.825304","last_clean":"2021-02-13 17:52:27.825304","last_became_active":"2021-02-13 17:52:27.824599","last_became_peered":"2021-02-13 17:52:27.824599","last_unstale":"2021-02-13 17:52:27.825304","last_undegraded":"2021-02-13 17:52:27.825304","last_fullsized":"2021-02-13 17:52:27.825304","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-13 17:52:26.799992","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-13 17:52:26.799992","last_clean_scrub_stamp":"2021-02-13 17:52:26.799992","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"9","reported_epoch":"10","state":"active+clean","last_fresh":"2021-02-13 17:52:27.825702","last_change":"2021-02-13 17:52:27.825241","last_active":"2021-02-13 17:52:27.825702","last_peered":"2021-02-13 17:52:27.825702","last_clean":"2021-02-13 17:52:27.825702","last_became_active":"2021-02-13 17:52:27.824999","last_became_peered":"2021-02-13 17:52:27.824999","last_unstale":"2021-02-13 17:52:27.825702","last_undegraded":"2021-02-13 17:52:27.825702","last_fullsized":"2021-02-13 17:52:27.825702","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-13 17:52:26.799992","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-13 17:52:26.799992","last_clean_scrub_stamp":"2021-02-13 17:52:26.799992","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"9","reported_epoch":"10","state":"active+clean","last_fresh":"2021-02-13 17:52:27.825722","last_change":"2021-02-13 17:52:27.825332","last_active":"2021-02-13 17:52:27.825722","last_peered":"2021-02-13 17:52:27.825722","last_clean":"2021-02-13 17:52:27.825722","last_became_active":"2021-02-13 17:52:27.825066","last_became_peered":"2021-02-13 17:52:27.825066","last_unstale":"2021-02-13 17:52:27.825722","last_undegraded":"2021-02-13 17:52:27.825722","last_fullsized":"2021-02-13 17:52:27.825722","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-13 17:52:26.799992","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-13 17:52:26.799992","last_clean_scrub_stamp":"2021-02-13 17:52:26.799992","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"9","reported_epoch":"10","state":"active+clean","last_fresh":"2021-02-13 17:52:27.825865","last_change":"2021-02-13 17:52:27.825386","last_active":"2021-02-13 17:52:27.825865","last_peered":"2021-02-13 17:52:27.825865","last_clean":"2021-02-13 17:52:27.825865","last_became_active":"2021-02-13 17:52:27.825128","last_became_peered":"2021-02-13 17:52:27.825128","last_unstale":"2021-02-13 17:52:27.825865","last_undegraded":"2021-02-13 17:52:27.825865","last_fullsized":"2021-02-13 17:52:27.825865","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-13 17:52:26.799992","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-13 17:52:26.799992","last_clean_scrub_stamp":"2021-02-13 17:52:26.799992","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"10","state":"active+clean","last_fresh":"2021-02-13 17:52:27.824489","last_change":"2021-02-13 17:52:27.824489","last_active":"2021-02-13 17:52:27.824489","last_peered":"2021-02-13 17:52:27.824489","last_clean":"2021-02-13 17:52:27.824489","last_became_active":"2021-02-13 17:52:27.824312","last_became_peered":"2021-02-13 17:52:27.824312","last_unstale":"2021-02-13 17:52:27.824489","last_undegraded":"2021-02-13 17:52:27.824489","last_fullsized":"2021-02-13 17:52:27.824489","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-13 17:52:26.799992","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-13 17:52:26.799992","last_clean_scrub_stamp":"2021-02-13 17:52:26.799992","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"9","reported_epoch":"10","state":"active+clean","last_fresh":"2021-02-13 17:52:27.825311","last_change":"2021-02-13 17:52:27.824792","last_active":"2021-02-13 17:52:27.825311","last_peered":"2021-02-13 17:52:27.825311","last_clean":"2021-02-13 17:52:27.825311","last_became_active":"2021-02-13 17:52:27.824502","last_became_peered":"2021-02-13 17:52:27.824502","last_unstale":"2021-02-13 17:52:27.825311","last_undegraded":"2021-02-13 17:52:27.825311","last_fullsized":"2021-02-13 17:52:27.825311","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-13 17:52:26.799992","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-13 17:52:26.799992","last_clean_scrub_stamp":"2021-02-13 17:52:26.799992","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"9","reported_epoch":"10","state":"active+clean","last_fresh":"2021-02-13 17:52:27.825373","last_change":"2021-02-13 17:52:27.824915","last_active":"2021-02-13 17:52:27.825373","last_peered":"2021-02-13 17:52:27.825373","last_clean":"2021-02-13 17:52:27.825373","last_became_active":"2021-02-13 17:52:27.824628","last_became_peered":"2021-02-13 17:52:27.824628","last_unstale":"2021-02-13 17:52:27.825373","last_undegraded":"2021-02-13 17:52:27.825373","last_fullsized":"2021-02-13 17:52:27.825373","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-13 17:52:26.799992","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-13 17:52:26.799992","last_clean_scrub_stamp":"2021-02-13 17:52:26.799992","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"9","reported_epoch":"10","state":"active+clean","last_fresh":"2021-02-13 17:52:27.825947","last_change":"2021-02-13 17:52:27.825552","last_active":"2021-02-13 17:52:27.825947","last_peered":"2021-02-13 17:52:27.825947","last_clean":"2021-02-13 17:52:27.825947","last_became_active":"2021-02-13 17:52:27.825207","last_became_peered":"2021-02-13 17:52:27.825207","last_unstale":"2021-02-13 17:52:27.825947","last_undegraded":"2021-02-13 17:52:27.825947","last_fullsized":"2021-02-13 17:52:27.825947","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-13 17:52:26.799992","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-13 17:52:26.799992","last_clean_scrub_stamp":"2021-02-13 17:52:26.799992","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738371,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"kb":104857600,"kb_used":1048680,"kb_used_data":96,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":103808920,"statfs":{"total":107374182400,"available":106300334080,"internally_reserved":1073741824,"allocated":98304,"data_stored":23840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]}]},{"osd":0,"up_from":8,"seq":34359738372,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"kb":104857600,"kb_used":1048672,"kb_used_data":88,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":103808928,"statfs":{"total":107374182400,"available":106300342272,"internally_reserved":1073741824,"allocated":90112,"data_stored":20765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]}]},{"osd":1,"up_from":8,"seq":34359738372,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"kb":104857600,"kb_used":1048672,"kb_used_data":88,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":103808928,"statfs":{"total":107374182400,"available":106300342272,"internally_reserved":1073741824,"allocated":90112,"data_stored":20765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6910000000000001}]}]}]}} 2021-02-13T17:52:31.224 DEBUG:teuthology.orchestra.run.gibba036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster c2 status --format=json-pretty 2021-02-13T17:52:31.383 INFO:teuthology.orchestra.run.gibba036.stdout: 2021-02-13T17:52:31.383 INFO:teuthology.orchestra.run.gibba036.stdout:{ 2021-02-13T17:52:31.383 INFO:teuthology.orchestra.run.gibba036.stdout: "fsid": "554ed120-a4b0-4e13-b48c-53832c6f02bd", 2021-02-13T17:52:31.384 INFO:teuthology.orchestra.run.gibba036.stdout: "health": { 2021-02-13T17:52:31.384 INFO:teuthology.orchestra.run.gibba036.stdout: "checks": {}, 2021-02-13T17:52:31.384 INFO:teuthology.orchestra.run.gibba036.stdout: "status": "HEALTH_OK" 2021-02-13T17:52:31.384 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.384 INFO:teuthology.orchestra.run.gibba036.stdout: "election_epoch": 3, 2021-02-13T17:52:31.384 INFO:teuthology.orchestra.run.gibba036.stdout: "quorum": [ 2021-02-13T17:52:31.384 INFO:teuthology.orchestra.run.gibba036.stdout: 0 2021-02-13T17:52:31.384 INFO:teuthology.orchestra.run.gibba036.stdout: ], 2021-02-13T17:52:31.384 INFO:teuthology.orchestra.run.gibba036.stdout: "quorum_names": [ 2021-02-13T17:52:31.384 INFO:teuthology.orchestra.run.gibba036.stdout: "a" 2021-02-13T17:52:31.384 INFO:teuthology.orchestra.run.gibba036.stdout: ], 2021-02-13T17:52:31.384 INFO:teuthology.orchestra.run.gibba036.stdout: "quorum_age": 13, 2021-02-13T17:52:31.384 INFO:teuthology.orchestra.run.gibba036.stdout: "monmap": { 2021-02-13T17:52:31.384 INFO:teuthology.orchestra.run.gibba036.stdout: "epoch": 1, 2021-02-13T17:52:31.385 INFO:teuthology.orchestra.run.gibba036.stdout: "min_mon_release_name": "14", 2021-02-13T17:52:31.385 INFO:teuthology.orchestra.run.gibba036.stdout: "num_mons": 1 2021-02-13T17:52:31.385 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.385 INFO:teuthology.orchestra.run.gibba036.stdout: "osdmap": { 2021-02-13T17:52:31.385 INFO:teuthology.orchestra.run.gibba036.stdout: "osdmap": { 2021-02-13T17:52:31.385 INFO:teuthology.orchestra.run.gibba036.stdout: "epoch": 11, 2021-02-13T17:52:31.385 INFO:teuthology.orchestra.run.gibba036.stdout: "num_osds": 3, 2021-02-13T17:52:31.385 INFO:teuthology.orchestra.run.gibba036.stdout: "num_up_osds": 3, 2021-02-13T17:52:31.385 INFO:teuthology.orchestra.run.gibba036.stdout: "num_in_osds": 3, 2021-02-13T17:52:31.385 INFO:teuthology.orchestra.run.gibba036.stdout: "num_remapped_pgs": 0 2021-02-13T17:52:31.385 INFO:teuthology.orchestra.run.gibba036.stdout: } 2021-02-13T17:52:31.385 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.385 INFO:teuthology.orchestra.run.gibba036.stdout: "pgmap": { 2021-02-13T17:52:31.386 INFO:teuthology.orchestra.run.gibba036.stdout: "pgs_by_state": [ 2021-02-13T17:52:31.386 INFO:teuthology.orchestra.run.gibba036.stdout: { 2021-02-13T17:52:31.386 INFO:teuthology.orchestra.run.gibba036.stdout: "state_name": "active+clean", 2021-02-13T17:52:31.386 INFO:teuthology.orchestra.run.gibba036.stdout: "count": 8 2021-02-13T17:52:31.386 INFO:teuthology.orchestra.run.gibba036.stdout: } 2021-02-13T17:52:31.386 INFO:teuthology.orchestra.run.gibba036.stdout: ], 2021-02-13T17:52:31.386 INFO:teuthology.orchestra.run.gibba036.stdout: "num_pgs": 8, 2021-02-13T17:52:31.386 INFO:teuthology.orchestra.run.gibba036.stdout: "num_pools": 1, 2021-02-13T17:52:31.386 INFO:teuthology.orchestra.run.gibba036.stdout: "num_objects": 0, 2021-02-13T17:52:31.386 INFO:teuthology.orchestra.run.gibba036.stdout: "data_bytes": 0, 2021-02-13T17:52:31.386 INFO:teuthology.orchestra.run.gibba036.stdout: "bytes_used": 3221528576, 2021-02-13T17:52:31.386 INFO:teuthology.orchestra.run.gibba036.stdout: "bytes_avail": 318901018624, 2021-02-13T17:52:31.386 INFO:teuthology.orchestra.run.gibba036.stdout: "bytes_total": 322122547200 2021-02-13T17:52:31.386 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.387 INFO:teuthology.orchestra.run.gibba036.stdout: "fsmap": { 2021-02-13T17:52:31.387 INFO:teuthology.orchestra.run.gibba036.stdout: "epoch": 1, 2021-02-13T17:52:31.387 INFO:teuthology.orchestra.run.gibba036.stdout: "by_rank": [], 2021-02-13T17:52:31.387 INFO:teuthology.orchestra.run.gibba036.stdout: "up:standby": 0 2021-02-13T17:52:31.387 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.387 INFO:teuthology.orchestra.run.gibba036.stdout: "mgrmap": { 2021-02-13T17:52:31.387 INFO:teuthology.orchestra.run.gibba036.stdout: "epoch": 3, 2021-02-13T17:52:31.387 INFO:teuthology.orchestra.run.gibba036.stdout: "active_gid": 4100, 2021-02-13T17:52:31.387 INFO:teuthology.orchestra.run.gibba036.stdout: "active_name": "x", 2021-02-13T17:52:31.387 INFO:teuthology.orchestra.run.gibba036.stdout: "active_addrs": { 2021-02-13T17:52:31.387 INFO:teuthology.orchestra.run.gibba036.stdout: "addrvec": [ 2021-02-13T17:52:31.387 INFO:teuthology.orchestra.run.gibba036.stdout: { 2021-02-13T17:52:31.387 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "v2", 2021-02-13T17:52:31.387 INFO:teuthology.orchestra.run.gibba036.stdout: "addr": "172.21.2.136:6824", 2021-02-13T17:52:31.388 INFO:teuthology.orchestra.run.gibba036.stdout: "nonce": 14041 2021-02-13T17:52:31.388 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.388 INFO:teuthology.orchestra.run.gibba036.stdout: { 2021-02-13T17:52:31.388 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "v1", 2021-02-13T17:52:31.388 INFO:teuthology.orchestra.run.gibba036.stdout: "addr": "172.21.2.136:6825", 2021-02-13T17:52:31.388 INFO:teuthology.orchestra.run.gibba036.stdout: "nonce": 14041 2021-02-13T17:52:31.388 INFO:teuthology.orchestra.run.gibba036.stdout: } 2021-02-13T17:52:31.388 INFO:teuthology.orchestra.run.gibba036.stdout: ] 2021-02-13T17:52:31.388 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.388 INFO:teuthology.orchestra.run.gibba036.stdout: "active_addr": "172.21.2.136:6825/14041", 2021-02-13T17:52:31.388 INFO:teuthology.orchestra.run.gibba036.stdout: "active_change": "2021-02-13 17:52:19.742256", 2021-02-13T17:52:31.388 INFO:teuthology.orchestra.run.gibba036.stdout: "available": true, 2021-02-13T17:52:31.388 INFO:teuthology.orchestra.run.gibba036.stdout: "standbys": [], 2021-02-13T17:52:31.388 INFO:teuthology.orchestra.run.gibba036.stdout: "modules": [ 2021-02-13T17:52:31.389 INFO:teuthology.orchestra.run.gibba036.stdout: "iostat", 2021-02-13T17:52:31.389 INFO:teuthology.orchestra.run.gibba036.stdout: "restful" 2021-02-13T17:52:31.389 INFO:teuthology.orchestra.run.gibba036.stdout: ], 2021-02-13T17:52:31.389 INFO:teuthology.orchestra.run.gibba036.stdout: "available_modules": [ 2021-02-13T17:52:31.389 INFO:teuthology.orchestra.run.gibba036.stdout: { 2021-02-13T17:52:31.389 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "alerts", 2021-02-13T17:52:31.389 INFO:teuthology.orchestra.run.gibba036.stdout: "can_run": true, 2021-02-13T17:52:31.389 INFO:teuthology.orchestra.run.gibba036.stdout: "error_string": "", 2021-02-13T17:52:31.389 INFO:teuthology.orchestra.run.gibba036.stdout: "module_options": { 2021-02-13T17:52:31.389 INFO:teuthology.orchestra.run.gibba036.stdout: "interval": { 2021-02-13T17:52:31.389 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "interval", 2021-02-13T17:52:31.389 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "secs", 2021-02-13T17:52:31.389 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.389 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 1, 2021-02-13T17:52:31.390 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "60", 2021-02-13T17:52:31.390 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.390 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.390 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.390 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "How frequently to reexamine health status", 2021-02-13T17:52:31.390 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.390 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.390 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.390 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.390 INFO:teuthology.orchestra.run.gibba036.stdout: "smtp_destination": { 2021-02-13T17:52:31.390 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "smtp_destination", 2021-02-13T17:52:31.390 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "str", 2021-02-13T17:52:31.390 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.391 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 1, 2021-02-13T17:52:31.391 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "", 2021-02-13T17:52:31.391 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.391 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.391 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.391 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "Email address to send alerts to", 2021-02-13T17:52:31.391 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.391 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.391 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.391 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.391 INFO:teuthology.orchestra.run.gibba036.stdout: "smtp_from_name": { 2021-02-13T17:52:31.391 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "smtp_from_name", 2021-02-13T17:52:31.392 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "str", 2021-02-13T17:52:31.392 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.392 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 1, 2021-02-13T17:52:31.392 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "Ceph", 2021-02-13T17:52:31.392 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.392 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.392 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.392 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "Email From: name", 2021-02-13T17:52:31.392 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.392 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.392 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.392 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.392 INFO:teuthology.orchestra.run.gibba036.stdout: "smtp_host": { 2021-02-13T17:52:31.392 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "smtp_host", 2021-02-13T17:52:31.393 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "str", 2021-02-13T17:52:31.393 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.393 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 1, 2021-02-13T17:52:31.393 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "", 2021-02-13T17:52:31.393 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.393 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.393 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.393 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "SMTP server", 2021-02-13T17:52:31.393 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.393 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.393 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.393 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.393 INFO:teuthology.orchestra.run.gibba036.stdout: "smtp_password": { 2021-02-13T17:52:31.393 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "smtp_password", 2021-02-13T17:52:31.394 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "str", 2021-02-13T17:52:31.394 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.394 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 1, 2021-02-13T17:52:31.394 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "", 2021-02-13T17:52:31.394 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.394 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.394 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.394 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "Password to authenticate with", 2021-02-13T17:52:31.394 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.394 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.394 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.394 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.395 INFO:teuthology.orchestra.run.gibba036.stdout: "smtp_port": { 2021-02-13T17:52:31.395 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "smtp_port", 2021-02-13T17:52:31.395 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "int", 2021-02-13T17:52:31.395 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.395 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 1, 2021-02-13T17:52:31.395 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "465", 2021-02-13T17:52:31.395 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.395 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.395 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.395 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "SMTP port", 2021-02-13T17:52:31.395 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.395 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.395 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.396 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.396 INFO:teuthology.orchestra.run.gibba036.stdout: "smtp_sender": { 2021-02-13T17:52:31.396 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "smtp_sender", 2021-02-13T17:52:31.396 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "str", 2021-02-13T17:52:31.396 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.396 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 1, 2021-02-13T17:52:31.396 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "", 2021-02-13T17:52:31.396 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.396 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.396 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.396 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "SMTP envelope sender", 2021-02-13T17:52:31.396 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.396 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.397 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.397 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.397 INFO:teuthology.orchestra.run.gibba036.stdout: "smtp_ssl": { 2021-02-13T17:52:31.397 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "smtp_ssl", 2021-02-13T17:52:31.397 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "bool", 2021-02-13T17:52:31.397 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.397 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 1, 2021-02-13T17:52:31.397 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "True", 2021-02-13T17:52:31.397 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.397 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.397 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.397 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "Use SSL to connect to SMTP server", 2021-02-13T17:52:31.398 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.398 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.398 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.398 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.398 INFO:teuthology.orchestra.run.gibba036.stdout: "smtp_user": { 2021-02-13T17:52:31.398 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "smtp_user", 2021-02-13T17:52:31.398 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "str", 2021-02-13T17:52:31.398 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.398 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 1, 2021-02-13T17:52:31.398 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "", 2021-02-13T17:52:31.398 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.398 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.399 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.399 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "User to authenticate as", 2021-02-13T17:52:31.399 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.399 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.399 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.399 INFO:teuthology.orchestra.run.gibba036.stdout: } 2021-02-13T17:52:31.399 INFO:teuthology.orchestra.run.gibba036.stdout: } 2021-02-13T17:52:31.399 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.399 INFO:teuthology.orchestra.run.gibba036.stdout: { 2021-02-13T17:52:31.399 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "ansible", 2021-02-13T17:52:31.399 INFO:teuthology.orchestra.run.gibba036.stdout: "can_run": true, 2021-02-13T17:52:31.399 INFO:teuthology.orchestra.run.gibba036.stdout: "error_string": "", 2021-02-13T17:52:31.400 INFO:teuthology.orchestra.run.gibba036.stdout: "module_options": { 2021-02-13T17:52:31.400 INFO:teuthology.orchestra.run.gibba036.stdout: "password": { 2021-02-13T17:52:31.400 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "password", 2021-02-13T17:52:31.400 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "str", 2021-02-13T17:52:31.400 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.400 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.400 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "", 2021-02-13T17:52:31.400 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.400 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.400 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.400 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.400 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.401 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.401 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.401 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.401 INFO:teuthology.orchestra.run.gibba036.stdout: "server_url": { 2021-02-13T17:52:31.401 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "server_url", 2021-02-13T17:52:31.401 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "str", 2021-02-13T17:52:31.401 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.401 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.401 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "", 2021-02-13T17:52:31.401 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.401 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.401 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.402 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.402 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.402 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.402 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.402 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.402 INFO:teuthology.orchestra.run.gibba036.stdout: "username": { 2021-02-13T17:52:31.402 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "username", 2021-02-13T17:52:31.402 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "str", 2021-02-13T17:52:31.402 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.402 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.402 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "", 2021-02-13T17:52:31.402 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.403 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.403 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.403 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.403 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.403 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.403 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.403 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.403 INFO:teuthology.orchestra.run.gibba036.stdout: "verify_server": { 2021-02-13T17:52:31.403 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "verify_server", 2021-02-13T17:52:31.403 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "str", 2021-02-13T17:52:31.403 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.403 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.404 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "", 2021-02-13T17:52:31.404 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.404 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.404 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.404 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.404 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.404 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.404 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.404 INFO:teuthology.orchestra.run.gibba036.stdout: } 2021-02-13T17:52:31.404 INFO:teuthology.orchestra.run.gibba036.stdout: } 2021-02-13T17:52:31.404 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.404 INFO:teuthology.orchestra.run.gibba036.stdout: { 2021-02-13T17:52:31.404 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "balancer", 2021-02-13T17:52:31.405 INFO:teuthology.orchestra.run.gibba036.stdout: "can_run": true, 2021-02-13T17:52:31.405 INFO:teuthology.orchestra.run.gibba036.stdout: "error_string": "", 2021-02-13T17:52:31.405 INFO:teuthology.orchestra.run.gibba036.stdout: "module_options": { 2021-02-13T17:52:31.405 INFO:teuthology.orchestra.run.gibba036.stdout: "active": { 2021-02-13T17:52:31.405 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "active", 2021-02-13T17:52:31.405 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "bool", 2021-02-13T17:52:31.405 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.405 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 1, 2021-02-13T17:52:31.405 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "False", 2021-02-13T17:52:31.405 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.405 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.405 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.405 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "automatically balance PGs across cluster", 2021-02-13T17:52:31.406 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.406 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.406 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.406 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.406 INFO:teuthology.orchestra.run.gibba036.stdout: "begin_time": { 2021-02-13T17:52:31.406 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "begin_time", 2021-02-13T17:52:31.406 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "str", 2021-02-13T17:52:31.406 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.406 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 1, 2021-02-13T17:52:31.406 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "0000", 2021-02-13T17:52:31.406 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.406 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.406 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.407 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "beginning time of day to automatically balance", 2021-02-13T17:52:31.407 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "This is a time of day in the format HHMM.", 2021-02-13T17:52:31.407 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.407 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.407 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.407 INFO:teuthology.orchestra.run.gibba036.stdout: "begin_weekday": { 2021-02-13T17:52:31.407 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "begin_weekday", 2021-02-13T17:52:31.407 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "uint", 2021-02-13T17:52:31.407 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.407 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 1, 2021-02-13T17:52:31.407 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "0", 2021-02-13T17:52:31.407 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "0", 2021-02-13T17:52:31.408 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "7", 2021-02-13T17:52:31.408 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.408 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2021-02-13T17:52:31.408 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "0 or 7 = Sunday, 1 = Monday, etc.", 2021-02-13T17:52:31.408 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.408 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.408 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.408 INFO:teuthology.orchestra.run.gibba036.stdout: "crush_compat_max_iterations": { 2021-02-13T17:52:31.408 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "crush_compat_max_iterations", 2021-02-13T17:52:31.408 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "uint", 2021-02-13T17:52:31.408 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.408 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 1, 2021-02-13T17:52:31.408 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "25", 2021-02-13T17:52:31.409 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "1", 2021-02-13T17:52:31.409 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "250", 2021-02-13T17:52:31.409 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.409 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "maximum number of iterations to attempt optimization", 2021-02-13T17:52:31.409 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.409 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.409 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.409 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.409 INFO:teuthology.orchestra.run.gibba036.stdout: "crush_compat_metrics": { 2021-02-13T17:52:31.409 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "crush_compat_metrics", 2021-02-13T17:52:31.409 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "str", 2021-02-13T17:52:31.409 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.409 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 1, 2021-02-13T17:52:31.410 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "pgs,objects,bytes", 2021-02-13T17:52:31.410 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.410 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.410 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.410 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "metrics with which to calculate OSD utilization", 2021-02-13T17:52:31.410 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2021-02-13T17:52:31.410 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.410 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.410 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.410 INFO:teuthology.orchestra.run.gibba036.stdout: "crush_compat_step": { 2021-02-13T17:52:31.410 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "crush_compat_step", 2021-02-13T17:52:31.410 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "float", 2021-02-13T17:52:31.410 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.410 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 1, 2021-02-13T17:52:31.411 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "0.5", 2021-02-13T17:52:31.411 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "0.001", 2021-02-13T17:52:31.411 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "0.999", 2021-02-13T17:52:31.411 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.411 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "aggressiveness of optimization", 2021-02-13T17:52:31.411 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2021-02-13T17:52:31.411 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.411 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.411 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.411 INFO:teuthology.orchestra.run.gibba036.stdout: "end_time": { 2021-02-13T17:52:31.411 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "end_time", 2021-02-13T17:52:31.411 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "str", 2021-02-13T17:52:31.411 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.411 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 1, 2021-02-13T17:52:31.412 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "2400", 2021-02-13T17:52:31.412 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.412 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.412 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.412 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "ending time of day to automatically balance", 2021-02-13T17:52:31.412 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "This is a time of day in the format HHMM.", 2021-02-13T17:52:31.412 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.412 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.412 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.412 INFO:teuthology.orchestra.run.gibba036.stdout: "end_weekday": { 2021-02-13T17:52:31.412 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "end_weekday", 2021-02-13T17:52:31.412 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "uint", 2021-02-13T17:52:31.412 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.412 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 1, 2021-02-13T17:52:31.413 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "7", 2021-02-13T17:52:31.413 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "0", 2021-02-13T17:52:31.413 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "7", 2021-02-13T17:52:31.413 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.413 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2021-02-13T17:52:31.413 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "0 or 7 = Sunday, 1 = Monday, etc.", 2021-02-13T17:52:31.413 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.413 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.413 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.413 INFO:teuthology.orchestra.run.gibba036.stdout: "min_score": { 2021-02-13T17:52:31.413 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "min_score", 2021-02-13T17:52:31.413 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "float", 2021-02-13T17:52:31.413 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.413 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 1, 2021-02-13T17:52:31.414 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "0", 2021-02-13T17:52:31.414 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.414 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.414 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.414 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "minimum score, below which no optimization is attempted", 2021-02-13T17:52:31.414 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.414 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.414 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.414 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.414 INFO:teuthology.orchestra.run.gibba036.stdout: "mode": { 2021-02-13T17:52:31.414 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "mode", 2021-02-13T17:52:31.414 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "str", 2021-02-13T17:52:31.414 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.414 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 1, 2021-02-13T17:52:31.415 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "none", 2021-02-13T17:52:31.415 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.415 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.415 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [ 2021-02-13T17:52:31.415 INFO:teuthology.orchestra.run.gibba036.stdout: "crush-compat", 2021-02-13T17:52:31.415 INFO:teuthology.orchestra.run.gibba036.stdout: "none", 2021-02-13T17:52:31.415 INFO:teuthology.orchestra.run.gibba036.stdout: "upmap" 2021-02-13T17:52:31.415 INFO:teuthology.orchestra.run.gibba036.stdout: ], 2021-02-13T17:52:31.415 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "Balancer mode", 2021-02-13T17:52:31.415 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.415 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.415 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.415 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.415 INFO:teuthology.orchestra.run.gibba036.stdout: "pool_ids": { 2021-02-13T17:52:31.416 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "pool_ids", 2021-02-13T17:52:31.416 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "str", 2021-02-13T17:52:31.416 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.416 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 1, 2021-02-13T17:52:31.416 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "", 2021-02-13T17:52:31.416 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.416 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.416 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.416 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "pools which the automatic balancing will be limited to", 2021-02-13T17:52:31.416 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.416 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.416 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.416 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.416 INFO:teuthology.orchestra.run.gibba036.stdout: "sleep_interval": { 2021-02-13T17:52:31.417 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "sleep_interval", 2021-02-13T17:52:31.417 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "secs", 2021-02-13T17:52:31.417 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.417 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 1, 2021-02-13T17:52:31.417 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "60", 2021-02-13T17:52:31.417 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.417 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.417 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.417 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "how frequently to wake up and attempt optimization", 2021-02-13T17:52:31.417 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.417 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.417 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.417 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.418 INFO:teuthology.orchestra.run.gibba036.stdout: "upmap_max_deviation": { 2021-02-13T17:52:31.418 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "upmap_max_deviation", 2021-02-13T17:52:31.418 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "int", 2021-02-13T17:52:31.418 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.418 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 1, 2021-02-13T17:52:31.418 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "5", 2021-02-13T17:52:31.418 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "1", 2021-02-13T17:52:31.418 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.418 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.418 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "deviation below which no optimization is attempted", 2021-02-13T17:52:31.418 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2021-02-13T17:52:31.418 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.418 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.419 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.419 INFO:teuthology.orchestra.run.gibba036.stdout: "upmap_max_iterations": { 2021-02-13T17:52:31.419 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "upmap_max_iterations", 2021-02-13T17:52:31.419 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "uint", 2021-02-13T17:52:31.419 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.419 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 1, 2021-02-13T17:52:31.419 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "10", 2021-02-13T17:52:31.419 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.419 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.419 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.419 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "maximum upmap optimization iterations", 2021-02-13T17:52:31.419 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.419 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.419 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.420 INFO:teuthology.orchestra.run.gibba036.stdout: } 2021-02-13T17:52:31.420 INFO:teuthology.orchestra.run.gibba036.stdout: } 2021-02-13T17:52:31.420 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.420 INFO:teuthology.orchestra.run.gibba036.stdout: { 2021-02-13T17:52:31.420 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "crash", 2021-02-13T17:52:31.420 INFO:teuthology.orchestra.run.gibba036.stdout: "can_run": true, 2021-02-13T17:52:31.420 INFO:teuthology.orchestra.run.gibba036.stdout: "error_string": "", 2021-02-13T17:52:31.420 INFO:teuthology.orchestra.run.gibba036.stdout: "module_options": { 2021-02-13T17:52:31.420 INFO:teuthology.orchestra.run.gibba036.stdout: "retain_interval": { 2021-02-13T17:52:31.420 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "retain_interval", 2021-02-13T17:52:31.420 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "secs", 2021-02-13T17:52:31.420 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.420 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 1, 2021-02-13T17:52:31.420 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "31536000", 2021-02-13T17:52:31.421 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.421 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.421 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.421 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "how long to retain crashes before pruning them", 2021-02-13T17:52:31.421 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.421 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.421 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.421 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.421 INFO:teuthology.orchestra.run.gibba036.stdout: "warn_recent_interval": { 2021-02-13T17:52:31.421 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "warn_recent_interval", 2021-02-13T17:52:31.421 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "secs", 2021-02-13T17:52:31.421 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.421 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 1, 2021-02-13T17:52:31.422 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "1209600", 2021-02-13T17:52:31.422 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.422 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.422 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.422 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "time interval in which to warn about recent crashes", 2021-02-13T17:52:31.422 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.422 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.422 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.422 INFO:teuthology.orchestra.run.gibba036.stdout: } 2021-02-13T17:52:31.422 INFO:teuthology.orchestra.run.gibba036.stdout: } 2021-02-13T17:52:31.422 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.422 INFO:teuthology.orchestra.run.gibba036.stdout: { 2021-02-13T17:52:31.422 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "dashboard", 2021-02-13T17:52:31.422 INFO:teuthology.orchestra.run.gibba036.stdout: "can_run": true, 2021-02-13T17:52:31.423 INFO:teuthology.orchestra.run.gibba036.stdout: "error_string": "", 2021-02-13T17:52:31.423 INFO:teuthology.orchestra.run.gibba036.stdout: "module_options": { 2021-02-13T17:52:31.423 INFO:teuthology.orchestra.run.gibba036.stdout: "ALERTMANAGER_API_HOST": { 2021-02-13T17:52:31.423 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "ALERTMANAGER_API_HOST", 2021-02-13T17:52:31.423 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "str", 2021-02-13T17:52:31.423 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.423 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.423 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "", 2021-02-13T17:52:31.423 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.423 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.423 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.423 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.423 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.423 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.424 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.424 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.424 INFO:teuthology.orchestra.run.gibba036.stdout: "AUDIT_API_ENABLED": { 2021-02-13T17:52:31.424 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "AUDIT_API_ENABLED", 2021-02-13T17:52:31.424 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "bool", 2021-02-13T17:52:31.424 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.424 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.424 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "False", 2021-02-13T17:52:31.424 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.424 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.424 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.424 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.424 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.425 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.425 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.425 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.425 INFO:teuthology.orchestra.run.gibba036.stdout: "AUDIT_API_LOG_PAYLOAD": { 2021-02-13T17:52:31.425 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2021-02-13T17:52:31.425 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "bool", 2021-02-13T17:52:31.425 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.425 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.425 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "True", 2021-02-13T17:52:31.425 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.425 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.425 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.425 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.425 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.426 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.426 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.426 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.426 INFO:teuthology.orchestra.run.gibba036.stdout: "ENABLE_BROWSABLE_API": { 2021-02-13T17:52:31.426 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "ENABLE_BROWSABLE_API", 2021-02-13T17:52:31.426 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "bool", 2021-02-13T17:52:31.426 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.426 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.426 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "True", 2021-02-13T17:52:31.426 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.426 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.426 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.426 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.427 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.427 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.427 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.427 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.427 INFO:teuthology.orchestra.run.gibba036.stdout: "FEATURE_TOGGLE_cephfs": { 2021-02-13T17:52:31.427 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "FEATURE_TOGGLE_cephfs", 2021-02-13T17:52:31.427 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "bool", 2021-02-13T17:52:31.427 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.427 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.427 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "True", 2021-02-13T17:52:31.427 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.427 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.427 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.427 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.428 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.428 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.428 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.428 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.428 INFO:teuthology.orchestra.run.gibba036.stdout: "FEATURE_TOGGLE_iscsi": { 2021-02-13T17:52:31.428 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "FEATURE_TOGGLE_iscsi", 2021-02-13T17:52:31.428 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "bool", 2021-02-13T17:52:31.428 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.428 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.428 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "True", 2021-02-13T17:52:31.428 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.428 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.428 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.429 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.429 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.429 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.429 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.429 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.429 INFO:teuthology.orchestra.run.gibba036.stdout: "FEATURE_TOGGLE_mirroring": { 2021-02-13T17:52:31.429 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "FEATURE_TOGGLE_mirroring", 2021-02-13T17:52:31.429 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "bool", 2021-02-13T17:52:31.429 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.429 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.429 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "True", 2021-02-13T17:52:31.429 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.429 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.429 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.430 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.430 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.430 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.430 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.430 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.430 INFO:teuthology.orchestra.run.gibba036.stdout: "FEATURE_TOGGLE_rbd": { 2021-02-13T17:52:31.430 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "FEATURE_TOGGLE_rbd", 2021-02-13T17:52:31.430 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "bool", 2021-02-13T17:52:31.430 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.430 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.430 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "True", 2021-02-13T17:52:31.430 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.430 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.431 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.431 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.431 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.431 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.431 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.431 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.431 INFO:teuthology.orchestra.run.gibba036.stdout: "FEATURE_TOGGLE_rgw": { 2021-02-13T17:52:31.431 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "FEATURE_TOGGLE_rgw", 2021-02-13T17:52:31.431 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "bool", 2021-02-13T17:52:31.431 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.431 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.431 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "True", 2021-02-13T17:52:31.432 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.432 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.432 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.432 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.432 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.432 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.432 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.432 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.432 INFO:teuthology.orchestra.run.gibba036.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2021-02-13T17:52:31.432 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2021-02-13T17:52:31.432 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "str", 2021-02-13T17:52:31.432 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.432 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.433 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "", 2021-02-13T17:52:31.433 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.433 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.433 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.433 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.433 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.433 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.433 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.433 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.433 INFO:teuthology.orchestra.run.gibba036.stdout: "GRAFANA_API_PASSWORD": { 2021-02-13T17:52:31.433 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "GRAFANA_API_PASSWORD", 2021-02-13T17:52:31.433 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "str", 2021-02-13T17:52:31.433 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.434 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.434 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "admin", 2021-02-13T17:52:31.434 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.434 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.434 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.434 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.434 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.434 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.434 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.434 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.434 INFO:teuthology.orchestra.run.gibba036.stdout: "GRAFANA_API_SSL_VERIFY": { 2021-02-13T17:52:31.434 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2021-02-13T17:52:31.434 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "bool", 2021-02-13T17:52:31.435 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.435 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.435 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "True", 2021-02-13T17:52:31.435 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.435 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.435 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.435 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.435 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.435 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.435 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.435 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.435 INFO:teuthology.orchestra.run.gibba036.stdout: "GRAFANA_API_URL": { 2021-02-13T17:52:31.435 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "GRAFANA_API_URL", 2021-02-13T17:52:31.436 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "str", 2021-02-13T17:52:31.436 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.436 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.436 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "", 2021-02-13T17:52:31.436 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.436 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.436 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.436 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.436 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.436 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.436 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.436 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.437 INFO:teuthology.orchestra.run.gibba036.stdout: "GRAFANA_API_USERNAME": { 2021-02-13T17:52:31.437 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "GRAFANA_API_USERNAME", 2021-02-13T17:52:31.437 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "str", 2021-02-13T17:52:31.437 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.437 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.437 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "admin", 2021-02-13T17:52:31.437 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.437 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.437 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.437 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.437 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.437 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.438 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.438 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.438 INFO:teuthology.orchestra.run.gibba036.stdout: "GRAFANA_FRONTEND_API_URL": { 2021-02-13T17:52:31.438 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2021-02-13T17:52:31.438 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "str", 2021-02-13T17:52:31.438 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.438 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.438 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "", 2021-02-13T17:52:31.438 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.438 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.438 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.438 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.438 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.438 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.439 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.439 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.439 INFO:teuthology.orchestra.run.gibba036.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2021-02-13T17:52:31.439 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2021-02-13T17:52:31.439 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "bool", 2021-02-13T17:52:31.439 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.439 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.439 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "False", 2021-02-13T17:52:31.439 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.439 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.439 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.439 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.439 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.439 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.440 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.440 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.440 INFO:teuthology.orchestra.run.gibba036.stdout: "ISCSI_API_SSL_VERIFICATION": { 2021-02-13T17:52:31.440 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2021-02-13T17:52:31.440 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "bool", 2021-02-13T17:52:31.440 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.440 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.440 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "True", 2021-02-13T17:52:31.440 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.440 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.440 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.440 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.440 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.440 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.441 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.441 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.441 INFO:teuthology.orchestra.run.gibba036.stdout: "PROMETHEUS_API_HOST": { 2021-02-13T17:52:31.441 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "PROMETHEUS_API_HOST", 2021-02-13T17:52:31.441 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "str", 2021-02-13T17:52:31.441 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.441 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.441 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "", 2021-02-13T17:52:31.441 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.441 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.441 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.441 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.441 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.441 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.442 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.442 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.442 INFO:teuthology.orchestra.run.gibba036.stdout: "REST_REQUESTS_TIMEOUT": { 2021-02-13T17:52:31.442 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "REST_REQUESTS_TIMEOUT", 2021-02-13T17:52:31.442 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "int", 2021-02-13T17:52:31.442 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.442 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.442 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "45", 2021-02-13T17:52:31.442 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.442 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.442 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.442 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.442 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.443 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.443 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.443 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.443 INFO:teuthology.orchestra.run.gibba036.stdout: "RGW_API_ACCESS_KEY": { 2021-02-13T17:52:31.443 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "RGW_API_ACCESS_KEY", 2021-02-13T17:52:31.443 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "str", 2021-02-13T17:52:31.443 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.443 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.443 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "", 2021-02-13T17:52:31.443 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.443 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.443 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.444 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.444 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.444 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.444 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.444 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.444 INFO:teuthology.orchestra.run.gibba036.stdout: "RGW_API_ADMIN_RESOURCE": { 2021-02-13T17:52:31.444 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2021-02-13T17:52:31.444 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "str", 2021-02-13T17:52:31.444 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.444 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.444 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "admin", 2021-02-13T17:52:31.444 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.444 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.444 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.445 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.445 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.445 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.445 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.445 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.445 INFO:teuthology.orchestra.run.gibba036.stdout: "RGW_API_HOST": { 2021-02-13T17:52:31.445 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "RGW_API_HOST", 2021-02-13T17:52:31.445 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "str", 2021-02-13T17:52:31.445 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.445 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.445 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "", 2021-02-13T17:52:31.445 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.445 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.445 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.446 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.446 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.446 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.446 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.446 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.446 INFO:teuthology.orchestra.run.gibba036.stdout: "RGW_API_PORT": { 2021-02-13T17:52:31.446 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "RGW_API_PORT", 2021-02-13T17:52:31.446 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "int", 2021-02-13T17:52:31.446 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.446 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.446 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "80", 2021-02-13T17:52:31.446 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.447 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.447 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.447 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.447 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.447 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.447 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.447 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.447 INFO:teuthology.orchestra.run.gibba036.stdout: "RGW_API_SCHEME": { 2021-02-13T17:52:31.447 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "RGW_API_SCHEME", 2021-02-13T17:52:31.447 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "str", 2021-02-13T17:52:31.447 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.447 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.447 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "http", 2021-02-13T17:52:31.448 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.448 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.448 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.448 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.448 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.448 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.448 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.448 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.448 INFO:teuthology.orchestra.run.gibba036.stdout: "RGW_API_SECRET_KEY": { 2021-02-13T17:52:31.448 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "RGW_API_SECRET_KEY", 2021-02-13T17:52:31.448 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "str", 2021-02-13T17:52:31.448 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.448 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.448 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "", 2021-02-13T17:52:31.449 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.449 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.449 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.449 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.449 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.449 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.449 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.449 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.449 INFO:teuthology.orchestra.run.gibba036.stdout: "RGW_API_SSL_VERIFY": { 2021-02-13T17:52:31.449 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "RGW_API_SSL_VERIFY", 2021-02-13T17:52:31.449 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "bool", 2021-02-13T17:52:31.449 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.449 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.449 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "True", 2021-02-13T17:52:31.450 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.450 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.450 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.450 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.450 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.450 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.450 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.450 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.450 INFO:teuthology.orchestra.run.gibba036.stdout: "RGW_API_USER_ID": { 2021-02-13T17:52:31.450 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "RGW_API_USER_ID", 2021-02-13T17:52:31.450 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "str", 2021-02-13T17:52:31.450 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.450 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.451 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "", 2021-02-13T17:52:31.451 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.451 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.451 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.451 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.451 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.451 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.451 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.451 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.451 INFO:teuthology.orchestra.run.gibba036.stdout: "crt_file": { 2021-02-13T17:52:31.451 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "crt_file", 2021-02-13T17:52:31.451 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "str", 2021-02-13T17:52:31.451 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.452 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.452 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "", 2021-02-13T17:52:31.452 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.452 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.452 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.452 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.452 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.452 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.452 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.452 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.452 INFO:teuthology.orchestra.run.gibba036.stdout: "debug": { 2021-02-13T17:52:31.452 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "debug", 2021-02-13T17:52:31.452 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "bool", 2021-02-13T17:52:31.453 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.453 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.453 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "False", 2021-02-13T17:52:31.453 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.453 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.453 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.453 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "Enable/disable debug options", 2021-02-13T17:52:31.453 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.453 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.453 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.453 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.453 INFO:teuthology.orchestra.run.gibba036.stdout: "jwt_token_ttl": { 2021-02-13T17:52:31.453 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "jwt_token_ttl", 2021-02-13T17:52:31.453 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "int", 2021-02-13T17:52:31.454 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.454 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.454 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "28800", 2021-02-13T17:52:31.454 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.454 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.454 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.454 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.454 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.454 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.454 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.454 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.454 INFO:teuthology.orchestra.run.gibba036.stdout: "key_file": { 2021-02-13T17:52:31.454 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "key_file", 2021-02-13T17:52:31.455 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "str", 2021-02-13T17:52:31.455 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.455 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.455 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "", 2021-02-13T17:52:31.455 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.455 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.455 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.455 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.455 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.455 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.455 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.455 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.455 INFO:teuthology.orchestra.run.gibba036.stdout: "password": { 2021-02-13T17:52:31.456 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "password", 2021-02-13T17:52:31.456 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "str", 2021-02-13T17:52:31.456 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.456 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.456 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "", 2021-02-13T17:52:31.456 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.456 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.456 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.456 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.456 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.456 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.456 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.456 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.456 INFO:teuthology.orchestra.run.gibba036.stdout: "server_addr": { 2021-02-13T17:52:31.456 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "server_addr", 2021-02-13T17:52:31.457 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "str", 2021-02-13T17:52:31.457 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.457 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.457 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "::", 2021-02-13T17:52:31.457 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.457 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.457 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.457 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.457 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.457 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.457 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.457 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.457 INFO:teuthology.orchestra.run.gibba036.stdout: "server_port": { 2021-02-13T17:52:31.457 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "server_port", 2021-02-13T17:52:31.458 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "int", 2021-02-13T17:52:31.458 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.458 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.458 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "8080", 2021-02-13T17:52:31.458 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.458 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.458 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.458 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.458 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.458 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.458 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.458 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.458 INFO:teuthology.orchestra.run.gibba036.stdout: "ssl": { 2021-02-13T17:52:31.459 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "ssl", 2021-02-13T17:52:31.459 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "bool", 2021-02-13T17:52:31.459 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.459 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.459 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "True", 2021-02-13T17:52:31.459 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.459 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.459 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.459 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.459 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.459 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.459 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.459 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.459 INFO:teuthology.orchestra.run.gibba036.stdout: "ssl_server_port": { 2021-02-13T17:52:31.459 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "ssl_server_port", 2021-02-13T17:52:31.460 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "int", 2021-02-13T17:52:31.460 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.460 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.460 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "8443", 2021-02-13T17:52:31.460 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.460 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.460 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.460 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.460 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.460 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.460 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.460 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.460 INFO:teuthology.orchestra.run.gibba036.stdout: "standby_behaviour": { 2021-02-13T17:52:31.460 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "standby_behaviour", 2021-02-13T17:52:31.461 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "str", 2021-02-13T17:52:31.461 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.461 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.461 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "redirect", 2021-02-13T17:52:31.461 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.461 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.461 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [ 2021-02-13T17:52:31.461 INFO:teuthology.orchestra.run.gibba036.stdout: "error", 2021-02-13T17:52:31.461 INFO:teuthology.orchestra.run.gibba036.stdout: "redirect" 2021-02-13T17:52:31.461 INFO:teuthology.orchestra.run.gibba036.stdout: ], 2021-02-13T17:52:31.461 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.461 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.461 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.461 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.462 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.462 INFO:teuthology.orchestra.run.gibba036.stdout: "standby_error_status_code": { 2021-02-13T17:52:31.462 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "standby_error_status_code", 2021-02-13T17:52:31.462 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "int", 2021-02-13T17:52:31.462 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.462 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.462 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "500", 2021-02-13T17:52:31.462 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "400", 2021-02-13T17:52:31.462 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "599", 2021-02-13T17:52:31.462 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.462 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.463 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.463 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.463 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.463 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.463 INFO:teuthology.orchestra.run.gibba036.stdout: "url_prefix": { 2021-02-13T17:52:31.463 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "url_prefix", 2021-02-13T17:52:31.463 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "str", 2021-02-13T17:52:31.463 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.463 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.463 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "", 2021-02-13T17:52:31.463 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.463 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.463 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.463 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.464 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.464 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.464 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.464 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.464 INFO:teuthology.orchestra.run.gibba036.stdout: "username": { 2021-02-13T17:52:31.464 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "username", 2021-02-13T17:52:31.464 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "str", 2021-02-13T17:52:31.464 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.464 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.464 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "", 2021-02-13T17:52:31.464 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.464 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.464 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.465 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.465 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.465 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.465 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.465 INFO:teuthology.orchestra.run.gibba036.stdout: } 2021-02-13T17:52:31.465 INFO:teuthology.orchestra.run.gibba036.stdout: } 2021-02-13T17:52:31.465 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.465 INFO:teuthology.orchestra.run.gibba036.stdout: { 2021-02-13T17:52:31.465 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "deepsea", 2021-02-13T17:52:31.465 INFO:teuthology.orchestra.run.gibba036.stdout: "can_run": true, 2021-02-13T17:52:31.465 INFO:teuthology.orchestra.run.gibba036.stdout: "error_string": "", 2021-02-13T17:52:31.465 INFO:teuthology.orchestra.run.gibba036.stdout: "module_options": { 2021-02-13T17:52:31.465 INFO:teuthology.orchestra.run.gibba036.stdout: "salt_api_eauth": { 2021-02-13T17:52:31.465 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "salt_api_eauth", 2021-02-13T17:52:31.466 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "str", 2021-02-13T17:52:31.466 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.466 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.466 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "sharedsecret", 2021-02-13T17:52:31.466 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.466 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.466 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.466 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.466 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.466 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.466 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.466 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.466 INFO:teuthology.orchestra.run.gibba036.stdout: "salt_api_password": { 2021-02-13T17:52:31.467 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "salt_api_password", 2021-02-13T17:52:31.467 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "str", 2021-02-13T17:52:31.467 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.467 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.467 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "", 2021-02-13T17:52:31.467 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.467 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.467 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.467 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.467 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.467 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.467 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.467 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.467 INFO:teuthology.orchestra.run.gibba036.stdout: "salt_api_url": { 2021-02-13T17:52:31.468 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "salt_api_url", 2021-02-13T17:52:31.468 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "str", 2021-02-13T17:52:31.468 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.468 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.468 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "", 2021-02-13T17:52:31.468 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.468 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.468 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.468 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.468 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.468 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.468 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.468 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.469 INFO:teuthology.orchestra.run.gibba036.stdout: "salt_api_username": { 2021-02-13T17:52:31.469 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "salt_api_username", 2021-02-13T17:52:31.469 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "str", 2021-02-13T17:52:31.469 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.469 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.469 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "", 2021-02-13T17:52:31.469 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.469 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.469 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.469 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.469 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.469 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.469 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.469 INFO:teuthology.orchestra.run.gibba036.stdout: } 2021-02-13T17:52:31.470 INFO:teuthology.orchestra.run.gibba036.stdout: } 2021-02-13T17:52:31.470 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.470 INFO:teuthology.orchestra.run.gibba036.stdout: { 2021-02-13T17:52:31.470 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "devicehealth", 2021-02-13T17:52:31.470 INFO:teuthology.orchestra.run.gibba036.stdout: "can_run": true, 2021-02-13T17:52:31.470 INFO:teuthology.orchestra.run.gibba036.stdout: "error_string": "", 2021-02-13T17:52:31.470 INFO:teuthology.orchestra.run.gibba036.stdout: "module_options": { 2021-02-13T17:52:31.470 INFO:teuthology.orchestra.run.gibba036.stdout: "enable_monitoring": { 2021-02-13T17:52:31.470 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "enable_monitoring", 2021-02-13T17:52:31.470 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "bool", 2021-02-13T17:52:31.470 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.470 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 1, 2021-02-13T17:52:31.470 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "False", 2021-02-13T17:52:31.471 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.471 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.471 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.471 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "monitor device health metrics", 2021-02-13T17:52:31.471 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.471 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.471 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.471 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.471 INFO:teuthology.orchestra.run.gibba036.stdout: "mark_out_threshold": { 2021-02-13T17:52:31.471 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "mark_out_threshold", 2021-02-13T17:52:31.471 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "secs", 2021-02-13T17:52:31.471 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.471 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 1, 2021-02-13T17:52:31.472 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "2419200", 2021-02-13T17:52:31.472 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.472 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.472 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.472 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "automatically mark OSD if it may fail before this long", 2021-02-13T17:52:31.472 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.472 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.472 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.472 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.472 INFO:teuthology.orchestra.run.gibba036.stdout: "pool_name": { 2021-02-13T17:52:31.472 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "pool_name", 2021-02-13T17:52:31.472 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "str", 2021-02-13T17:52:31.472 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.473 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 1, 2021-02-13T17:52:31.473 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "device_health_metrics", 2021-02-13T17:52:31.473 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.473 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.473 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.473 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "name of pool in which to store device health metrics", 2021-02-13T17:52:31.473 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.473 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.473 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.473 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.473 INFO:teuthology.orchestra.run.gibba036.stdout: "retention_period": { 2021-02-13T17:52:31.473 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "retention_period", 2021-02-13T17:52:31.473 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "secs", 2021-02-13T17:52:31.473 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.474 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 1, 2021-02-13T17:52:31.474 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "15552000", 2021-02-13T17:52:31.474 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.474 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.474 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.474 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "how long to retain device health metrics", 2021-02-13T17:52:31.474 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.474 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.474 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.474 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.474 INFO:teuthology.orchestra.run.gibba036.stdout: "scrape_frequency": { 2021-02-13T17:52:31.474 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "scrape_frequency", 2021-02-13T17:52:31.474 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "secs", 2021-02-13T17:52:31.475 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.475 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 1, 2021-02-13T17:52:31.475 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "86400", 2021-02-13T17:52:31.475 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.475 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.475 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.475 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "how frequently to scrape device health metrics", 2021-02-13T17:52:31.475 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.475 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.475 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.475 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.475 INFO:teuthology.orchestra.run.gibba036.stdout: "self_heal": { 2021-02-13T17:52:31.475 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "self_heal", 2021-02-13T17:52:31.475 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "bool", 2021-02-13T17:52:31.476 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.476 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 1, 2021-02-13T17:52:31.476 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "True", 2021-02-13T17:52:31.476 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.476 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.476 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.476 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "preemptively heal cluster around devices that may fail", 2021-02-13T17:52:31.476 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.476 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.476 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.476 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.476 INFO:teuthology.orchestra.run.gibba036.stdout: "sleep_interval": { 2021-02-13T17:52:31.476 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "sleep_interval", 2021-02-13T17:52:31.476 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "secs", 2021-02-13T17:52:31.476 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.477 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 1, 2021-02-13T17:52:31.477 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "600", 2021-02-13T17:52:31.477 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.477 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.477 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.477 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "how frequently to wake up and check device health", 2021-02-13T17:52:31.477 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.477 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.477 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.477 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.477 INFO:teuthology.orchestra.run.gibba036.stdout: "warn_threshold": { 2021-02-13T17:52:31.477 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "warn_threshold", 2021-02-13T17:52:31.477 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "secs", 2021-02-13T17:52:31.477 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.478 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 1, 2021-02-13T17:52:31.478 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "7257600", 2021-02-13T17:52:31.478 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.478 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.478 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.478 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "raise health warning if OSD may fail before this long", 2021-02-13T17:52:31.478 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.478 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.478 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.478 INFO:teuthology.orchestra.run.gibba036.stdout: } 2021-02-13T17:52:31.478 INFO:teuthology.orchestra.run.gibba036.stdout: } 2021-02-13T17:52:31.478 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.478 INFO:teuthology.orchestra.run.gibba036.stdout: { 2021-02-13T17:52:31.479 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "diskprediction_cloud", 2021-02-13T17:52:31.479 INFO:teuthology.orchestra.run.gibba036.stdout: "can_run": true, 2021-02-13T17:52:31.479 INFO:teuthology.orchestra.run.gibba036.stdout: "error_string": "", 2021-02-13T17:52:31.479 INFO:teuthology.orchestra.run.gibba036.stdout: "module_options": { 2021-02-13T17:52:31.479 INFO:teuthology.orchestra.run.gibba036.stdout: "diskprediction_cert_context": { 2021-02-13T17:52:31.479 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "diskprediction_cert_context", 2021-02-13T17:52:31.479 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "str", 2021-02-13T17:52:31.479 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.479 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.479 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "", 2021-02-13T17:52:31.479 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.479 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.479 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.480 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.480 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.480 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.480 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.480 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.480 INFO:teuthology.orchestra.run.gibba036.stdout: "diskprediction_default_authority": { 2021-02-13T17:52:31.480 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "diskprediction_default_authority", 2021-02-13T17:52:31.480 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "str", 2021-02-13T17:52:31.480 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.480 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.480 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "localhost", 2021-02-13T17:52:31.480 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.480 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.480 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.481 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.481 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.481 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.481 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.481 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.481 INFO:teuthology.orchestra.run.gibba036.stdout: "diskprediction_password": { 2021-02-13T17:52:31.481 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "diskprediction_password", 2021-02-13T17:52:31.481 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "str", 2021-02-13T17:52:31.481 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.481 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.481 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "", 2021-02-13T17:52:31.481 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.481 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.481 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.482 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.482 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.482 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.482 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.482 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.482 INFO:teuthology.orchestra.run.gibba036.stdout: "diskprediction_port": { 2021-02-13T17:52:31.482 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "diskprediction_port", 2021-02-13T17:52:31.482 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "str", 2021-02-13T17:52:31.482 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.482 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.482 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "31400", 2021-02-13T17:52:31.482 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.482 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.483 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.483 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.483 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.483 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.483 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.483 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.483 INFO:teuthology.orchestra.run.gibba036.stdout: "diskprediction_retrieve_prediction_interval": { 2021-02-13T17:52:31.483 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "diskprediction_retrieve_prediction_interval", 2021-02-13T17:52:31.483 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "str", 2021-02-13T17:52:31.483 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.483 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.483 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "43200", 2021-02-13T17:52:31.483 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.483 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.483 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.484 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.484 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.484 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.484 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.484 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.484 INFO:teuthology.orchestra.run.gibba036.stdout: "diskprediction_server": { 2021-02-13T17:52:31.484 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "diskprediction_server", 2021-02-13T17:52:31.484 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "str", 2021-02-13T17:52:31.484 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.484 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.484 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "", 2021-02-13T17:52:31.484 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.484 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.485 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.485 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.485 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.485 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.485 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.485 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.485 INFO:teuthology.orchestra.run.gibba036.stdout: "diskprediction_ssl_target_name_override": { 2021-02-13T17:52:31.485 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "diskprediction_ssl_target_name_override", 2021-02-13T17:52:31.485 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "str", 2021-02-13T17:52:31.485 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.485 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.485 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "localhost", 2021-02-13T17:52:31.486 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.486 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.486 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.486 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.486 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.486 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.486 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.486 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.486 INFO:teuthology.orchestra.run.gibba036.stdout: "diskprediction_upload_metrics_interval": { 2021-02-13T17:52:31.486 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "diskprediction_upload_metrics_interval", 2021-02-13T17:52:31.486 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "str", 2021-02-13T17:52:31.486 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.486 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.487 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "600", 2021-02-13T17:52:31.487 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.487 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.487 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.487 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.487 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.487 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.487 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.487 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.487 INFO:teuthology.orchestra.run.gibba036.stdout: "diskprediction_upload_smart_interval": { 2021-02-13T17:52:31.487 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "diskprediction_upload_smart_interval", 2021-02-13T17:52:31.487 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "str", 2021-02-13T17:52:31.487 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.487 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.487 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "43200", 2021-02-13T17:52:31.488 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.488 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.488 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.488 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.488 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.488 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.488 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.488 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.488 INFO:teuthology.orchestra.run.gibba036.stdout: "diskprediction_user": { 2021-02-13T17:52:31.488 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "diskprediction_user", 2021-02-13T17:52:31.488 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "str", 2021-02-13T17:52:31.488 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.488 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.488 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "", 2021-02-13T17:52:31.489 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.489 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.489 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.489 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.489 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.489 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.489 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.489 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.489 INFO:teuthology.orchestra.run.gibba036.stdout: "sleep_interval": { 2021-02-13T17:52:31.489 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "sleep_interval", 2021-02-13T17:52:31.489 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "str", 2021-02-13T17:52:31.489 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.489 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.489 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "600", 2021-02-13T17:52:31.489 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.490 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.490 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.490 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.490 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.490 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.490 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.490 INFO:teuthology.orchestra.run.gibba036.stdout: } 2021-02-13T17:52:31.490 INFO:teuthology.orchestra.run.gibba036.stdout: } 2021-02-13T17:52:31.490 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.490 INFO:teuthology.orchestra.run.gibba036.stdout: { 2021-02-13T17:52:31.490 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "diskprediction_local", 2021-02-13T17:52:31.490 INFO:teuthology.orchestra.run.gibba036.stdout: "can_run": true, 2021-02-13T17:52:31.490 INFO:teuthology.orchestra.run.gibba036.stdout: "error_string": "", 2021-02-13T17:52:31.491 INFO:teuthology.orchestra.run.gibba036.stdout: "module_options": { 2021-02-13T17:52:31.491 INFO:teuthology.orchestra.run.gibba036.stdout: "predict_interval": { 2021-02-13T17:52:31.491 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "predict_interval", 2021-02-13T17:52:31.491 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "str", 2021-02-13T17:52:31.491 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.491 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.491 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "86400", 2021-02-13T17:52:31.491 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.491 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.491 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.491 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.491 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.491 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.491 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.492 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.492 INFO:teuthology.orchestra.run.gibba036.stdout: "sleep_interval": { 2021-02-13T17:52:31.492 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "sleep_interval", 2021-02-13T17:52:31.492 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "str", 2021-02-13T17:52:31.492 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.492 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.492 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "600", 2021-02-13T17:52:31.492 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.492 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.492 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.492 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.492 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.492 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.493 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.493 INFO:teuthology.orchestra.run.gibba036.stdout: } 2021-02-13T17:52:31.493 INFO:teuthology.orchestra.run.gibba036.stdout: } 2021-02-13T17:52:31.493 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.493 INFO:teuthology.orchestra.run.gibba036.stdout: { 2021-02-13T17:52:31.493 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "influx", 2021-02-13T17:52:31.493 INFO:teuthology.orchestra.run.gibba036.stdout: "can_run": false, 2021-02-13T17:52:31.493 INFO:teuthology.orchestra.run.gibba036.stdout: "error_string": "influxdb python module not found", 2021-02-13T17:52:31.493 INFO:teuthology.orchestra.run.gibba036.stdout: "module_options": { 2021-02-13T17:52:31.493 INFO:teuthology.orchestra.run.gibba036.stdout: "batch_size": { 2021-02-13T17:52:31.493 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "batch_size", 2021-02-13T17:52:31.493 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "str", 2021-02-13T17:52:31.493 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.494 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.494 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "5000", 2021-02-13T17:52:31.494 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.494 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.494 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.494 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.494 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.494 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.494 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.494 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.494 INFO:teuthology.orchestra.run.gibba036.stdout: "database": { 2021-02-13T17:52:31.494 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "database", 2021-02-13T17:52:31.494 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "str", 2021-02-13T17:52:31.494 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.495 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.495 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "ceph", 2021-02-13T17:52:31.495 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.495 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.495 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.495 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.495 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.495 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.495 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.495 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.495 INFO:teuthology.orchestra.run.gibba036.stdout: "hostname": { 2021-02-13T17:52:31.495 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "hostname", 2021-02-13T17:52:31.495 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "str", 2021-02-13T17:52:31.495 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.496 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.496 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "None", 2021-02-13T17:52:31.496 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.496 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.496 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.496 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.496 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.496 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.496 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.496 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.496 INFO:teuthology.orchestra.run.gibba036.stdout: "interval": { 2021-02-13T17:52:31.496 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "interval", 2021-02-13T17:52:31.496 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "str", 2021-02-13T17:52:31.497 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.497 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.497 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "30", 2021-02-13T17:52:31.497 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.497 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.497 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.497 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.497 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.497 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.497 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.497 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.497 INFO:teuthology.orchestra.run.gibba036.stdout: "password": { 2021-02-13T17:52:31.497 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "password", 2021-02-13T17:52:31.497 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "str", 2021-02-13T17:52:31.497 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.498 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.498 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "None", 2021-02-13T17:52:31.498 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.498 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.498 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.498 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.498 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.498 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.498 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.498 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.498 INFO:teuthology.orchestra.run.gibba036.stdout: "port": { 2021-02-13T17:52:31.498 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "port", 2021-02-13T17:52:31.498 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "str", 2021-02-13T17:52:31.499 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.499 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.499 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "8086", 2021-02-13T17:52:31.499 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.499 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.499 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.499 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.499 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.499 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.499 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.499 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.499 INFO:teuthology.orchestra.run.gibba036.stdout: "ssl": { 2021-02-13T17:52:31.500 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "ssl", 2021-02-13T17:52:31.500 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "str", 2021-02-13T17:52:31.500 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.500 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.500 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "false", 2021-02-13T17:52:31.500 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.500 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.500 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.500 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.500 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.500 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.500 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.500 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.500 INFO:teuthology.orchestra.run.gibba036.stdout: "threads": { 2021-02-13T17:52:31.501 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "threads", 2021-02-13T17:52:31.501 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "str", 2021-02-13T17:52:31.501 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.501 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.501 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "5", 2021-02-13T17:52:31.501 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.501 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.501 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.501 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.501 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.501 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.501 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.501 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.502 INFO:teuthology.orchestra.run.gibba036.stdout: "username": { 2021-02-13T17:52:31.502 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "username", 2021-02-13T17:52:31.502 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "str", 2021-02-13T17:52:31.502 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.502 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.502 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "None", 2021-02-13T17:52:31.502 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.502 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.502 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.502 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.502 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.502 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.503 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.503 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.503 INFO:teuthology.orchestra.run.gibba036.stdout: "verify_ssl": { 2021-02-13T17:52:31.503 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "verify_ssl", 2021-02-13T17:52:31.503 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "str", 2021-02-13T17:52:31.503 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.503 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.503 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "true", 2021-02-13T17:52:31.503 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.503 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.503 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.503 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.503 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.504 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.504 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.504 INFO:teuthology.orchestra.run.gibba036.stdout: } 2021-02-13T17:52:31.504 INFO:teuthology.orchestra.run.gibba036.stdout: } 2021-02-13T17:52:31.504 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.504 INFO:teuthology.orchestra.run.gibba036.stdout: { 2021-02-13T17:52:31.504 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "insights", 2021-02-13T17:52:31.504 INFO:teuthology.orchestra.run.gibba036.stdout: "can_run": true, 2021-02-13T17:52:31.504 INFO:teuthology.orchestra.run.gibba036.stdout: "error_string": "", 2021-02-13T17:52:31.504 INFO:teuthology.orchestra.run.gibba036.stdout: "module_options": {} 2021-02-13T17:52:31.504 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.504 INFO:teuthology.orchestra.run.gibba036.stdout: { 2021-02-13T17:52:31.504 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "iostat", 2021-02-13T17:52:31.505 INFO:teuthology.orchestra.run.gibba036.stdout: "can_run": true, 2021-02-13T17:52:31.505 INFO:teuthology.orchestra.run.gibba036.stdout: "error_string": "", 2021-02-13T17:52:31.505 INFO:teuthology.orchestra.run.gibba036.stdout: "module_options": {} 2021-02-13T17:52:31.505 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.505 INFO:teuthology.orchestra.run.gibba036.stdout: { 2021-02-13T17:52:31.505 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "localpool", 2021-02-13T17:52:31.505 INFO:teuthology.orchestra.run.gibba036.stdout: "can_run": true, 2021-02-13T17:52:31.505 INFO:teuthology.orchestra.run.gibba036.stdout: "error_string": "", 2021-02-13T17:52:31.505 INFO:teuthology.orchestra.run.gibba036.stdout: "module_options": { 2021-02-13T17:52:31.505 INFO:teuthology.orchestra.run.gibba036.stdout: "failure_domain": { 2021-02-13T17:52:31.505 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "failure_domain", 2021-02-13T17:52:31.505 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "str", 2021-02-13T17:52:31.506 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.506 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 1, 2021-02-13T17:52:31.506 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "host", 2021-02-13T17:52:31.506 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.506 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.506 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.506 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "failure domain for any created local pool", 2021-02-13T17:52:31.506 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.506 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.506 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.506 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.506 INFO:teuthology.orchestra.run.gibba036.stdout: "min_size": { 2021-02-13T17:52:31.506 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "min_size", 2021-02-13T17:52:31.507 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "int", 2021-02-13T17:52:31.507 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.507 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 1, 2021-02-13T17:52:31.507 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "", 2021-02-13T17:52:31.507 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.507 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.507 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.507 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "default min_size for any created local pool", 2021-02-13T17:52:31.507 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.507 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.507 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.507 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.507 INFO:teuthology.orchestra.run.gibba036.stdout: "num_rep": { 2021-02-13T17:52:31.508 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "num_rep", 2021-02-13T17:52:31.508 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "int", 2021-02-13T17:52:31.508 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.508 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 1, 2021-02-13T17:52:31.508 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "3", 2021-02-13T17:52:31.508 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.508 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.508 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.508 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "default replica count for any created local pool", 2021-02-13T17:52:31.508 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.508 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.508 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.508 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.508 INFO:teuthology.orchestra.run.gibba036.stdout: "pg_num": { 2021-02-13T17:52:31.508 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "pg_num", 2021-02-13T17:52:31.509 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "int", 2021-02-13T17:52:31.509 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.509 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 1, 2021-02-13T17:52:31.509 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "128", 2021-02-13T17:52:31.509 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.509 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.509 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.509 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "default pg_num for any created local pool", 2021-02-13T17:52:31.509 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.509 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.509 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.509 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.509 INFO:teuthology.orchestra.run.gibba036.stdout: "prefix": { 2021-02-13T17:52:31.510 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "prefix", 2021-02-13T17:52:31.510 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "str", 2021-02-13T17:52:31.510 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.510 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 1, 2021-02-13T17:52:31.510 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "", 2021-02-13T17:52:31.510 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.510 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.510 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.510 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "name prefix for any created local pool", 2021-02-13T17:52:31.510 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.510 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.510 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.510 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.511 INFO:teuthology.orchestra.run.gibba036.stdout: "subtree": { 2021-02-13T17:52:31.511 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "subtree", 2021-02-13T17:52:31.511 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "str", 2021-02-13T17:52:31.511 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.511 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 1, 2021-02-13T17:52:31.511 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "rack", 2021-02-13T17:52:31.511 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.511 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.511 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.511 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "CRUSH level for which to create a local pool", 2021-02-13T17:52:31.511 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.511 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.511 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.511 INFO:teuthology.orchestra.run.gibba036.stdout: } 2021-02-13T17:52:31.511 INFO:teuthology.orchestra.run.gibba036.stdout: } 2021-02-13T17:52:31.512 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.512 INFO:teuthology.orchestra.run.gibba036.stdout: { 2021-02-13T17:52:31.512 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "orchestrator_cli", 2021-02-13T17:52:31.512 INFO:teuthology.orchestra.run.gibba036.stdout: "can_run": true, 2021-02-13T17:52:31.512 INFO:teuthology.orchestra.run.gibba036.stdout: "error_string": "", 2021-02-13T17:52:31.512 INFO:teuthology.orchestra.run.gibba036.stdout: "module_options": { 2021-02-13T17:52:31.512 INFO:teuthology.orchestra.run.gibba036.stdout: "orchestrator": { 2021-02-13T17:52:31.512 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "orchestrator", 2021-02-13T17:52:31.512 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "str", 2021-02-13T17:52:31.512 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.512 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.512 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "", 2021-02-13T17:52:31.512 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.512 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.513 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.513 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.513 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.513 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.513 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.513 INFO:teuthology.orchestra.run.gibba036.stdout: } 2021-02-13T17:52:31.513 INFO:teuthology.orchestra.run.gibba036.stdout: } 2021-02-13T17:52:31.513 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.513 INFO:teuthology.orchestra.run.gibba036.stdout: { 2021-02-13T17:52:31.513 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "pg_autoscaler", 2021-02-13T17:52:31.513 INFO:teuthology.orchestra.run.gibba036.stdout: "can_run": true, 2021-02-13T17:52:31.513 INFO:teuthology.orchestra.run.gibba036.stdout: "error_string": "", 2021-02-13T17:52:31.513 INFO:teuthology.orchestra.run.gibba036.stdout: "module_options": { 2021-02-13T17:52:31.514 INFO:teuthology.orchestra.run.gibba036.stdout: "sleep_interval": { 2021-02-13T17:52:31.514 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "sleep_interval", 2021-02-13T17:52:31.514 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "str", 2021-02-13T17:52:31.514 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.514 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.514 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "60", 2021-02-13T17:52:31.514 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.514 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.514 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.514 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.514 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.514 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.514 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.515 INFO:teuthology.orchestra.run.gibba036.stdout: } 2021-02-13T17:52:31.515 INFO:teuthology.orchestra.run.gibba036.stdout: } 2021-02-13T17:52:31.515 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.515 INFO:teuthology.orchestra.run.gibba036.stdout: { 2021-02-13T17:52:31.515 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "progress", 2021-02-13T17:52:31.515 INFO:teuthology.orchestra.run.gibba036.stdout: "can_run": true, 2021-02-13T17:52:31.515 INFO:teuthology.orchestra.run.gibba036.stdout: "error_string": "", 2021-02-13T17:52:31.515 INFO:teuthology.orchestra.run.gibba036.stdout: "module_options": { 2021-02-13T17:52:31.515 INFO:teuthology.orchestra.run.gibba036.stdout: "enabled": { 2021-02-13T17:52:31.515 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "enabled", 2021-02-13T17:52:31.515 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "bool", 2021-02-13T17:52:31.515 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.515 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.516 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "True", 2021-02-13T17:52:31.516 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.516 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.516 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.516 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.516 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.516 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.516 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.516 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.516 INFO:teuthology.orchestra.run.gibba036.stdout: "max_completed_events": { 2021-02-13T17:52:31.516 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "max_completed_events", 2021-02-13T17:52:31.516 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "int", 2021-02-13T17:52:31.516 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.516 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 1, 2021-02-13T17:52:31.517 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "50", 2021-02-13T17:52:31.517 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.517 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.517 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.517 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "number of past completed events to remember", 2021-02-13T17:52:31.517 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.517 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.517 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.517 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.517 INFO:teuthology.orchestra.run.gibba036.stdout: "persist_interval": { 2021-02-13T17:52:31.517 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "persist_interval", 2021-02-13T17:52:31.517 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "secs", 2021-02-13T17:52:31.517 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.517 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 1, 2021-02-13T17:52:31.518 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "5", 2021-02-13T17:52:31.518 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.518 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.518 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.518 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "how frequently to persist completed events", 2021-02-13T17:52:31.518 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.518 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.518 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.518 INFO:teuthology.orchestra.run.gibba036.stdout: } 2021-02-13T17:52:31.518 INFO:teuthology.orchestra.run.gibba036.stdout: } 2021-02-13T17:52:31.518 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.518 INFO:teuthology.orchestra.run.gibba036.stdout: { 2021-02-13T17:52:31.518 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "prometheus", 2021-02-13T17:52:31.519 INFO:teuthology.orchestra.run.gibba036.stdout: "can_run": true, 2021-02-13T17:52:31.519 INFO:teuthology.orchestra.run.gibba036.stdout: "error_string": "", 2021-02-13T17:52:31.519 INFO:teuthology.orchestra.run.gibba036.stdout: "module_options": { 2021-02-13T17:52:31.519 INFO:teuthology.orchestra.run.gibba036.stdout: "rbd_stats_pools": { 2021-02-13T17:52:31.519 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "rbd_stats_pools", 2021-02-13T17:52:31.519 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "str", 2021-02-13T17:52:31.519 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.519 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.519 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "", 2021-02-13T17:52:31.519 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.519 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.519 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.519 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.520 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.520 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.520 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.520 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.520 INFO:teuthology.orchestra.run.gibba036.stdout: "rbd_stats_pools_refresh_interval": { 2021-02-13T17:52:31.520 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "rbd_stats_pools_refresh_interval", 2021-02-13T17:52:31.520 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "int", 2021-02-13T17:52:31.520 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.520 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.520 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "300", 2021-02-13T17:52:31.520 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.520 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.520 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.520 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.521 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.521 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.521 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.521 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.521 INFO:teuthology.orchestra.run.gibba036.stdout: "scrape_interval": { 2021-02-13T17:52:31.521 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "scrape_interval", 2021-02-13T17:52:31.521 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "str", 2021-02-13T17:52:31.521 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.521 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.521 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "", 2021-02-13T17:52:31.521 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.521 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.522 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.522 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.522 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.522 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.522 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.522 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.522 INFO:teuthology.orchestra.run.gibba036.stdout: "server_addr": { 2021-02-13T17:52:31.522 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "server_addr", 2021-02-13T17:52:31.522 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "str", 2021-02-13T17:52:31.522 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.522 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.523 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "", 2021-02-13T17:52:31.523 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.523 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.523 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.523 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.523 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.523 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.523 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.523 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.523 INFO:teuthology.orchestra.run.gibba036.stdout: "server_port": { 2021-02-13T17:52:31.523 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "server_port", 2021-02-13T17:52:31.523 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "str", 2021-02-13T17:52:31.523 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.523 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.523 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "", 2021-02-13T17:52:31.524 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.524 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.524 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.524 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.524 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.524 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.524 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.524 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.524 INFO:teuthology.orchestra.run.gibba036.stdout: "stale_cache_strategy": { 2021-02-13T17:52:31.524 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "stale_cache_strategy", 2021-02-13T17:52:31.524 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "str", 2021-02-13T17:52:31.524 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.524 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.524 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "", 2021-02-13T17:52:31.525 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.525 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.525 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.525 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.525 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.525 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.525 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.525 INFO:teuthology.orchestra.run.gibba036.stdout: } 2021-02-13T17:52:31.525 INFO:teuthology.orchestra.run.gibba036.stdout: } 2021-02-13T17:52:31.525 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.525 INFO:teuthology.orchestra.run.gibba036.stdout: { 2021-02-13T17:52:31.525 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "rbd_support", 2021-02-13T17:52:31.525 INFO:teuthology.orchestra.run.gibba036.stdout: "can_run": true, 2021-02-13T17:52:31.526 INFO:teuthology.orchestra.run.gibba036.stdout: "error_string": "", 2021-02-13T17:52:31.526 INFO:teuthology.orchestra.run.gibba036.stdout: "module_options": {} 2021-02-13T17:52:31.526 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.526 INFO:teuthology.orchestra.run.gibba036.stdout: { 2021-02-13T17:52:31.526 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "restful", 2021-02-13T17:52:31.526 INFO:teuthology.orchestra.run.gibba036.stdout: "can_run": true, 2021-02-13T17:52:31.526 INFO:teuthology.orchestra.run.gibba036.stdout: "error_string": "", 2021-02-13T17:52:31.526 INFO:teuthology.orchestra.run.gibba036.stdout: "module_options": { 2021-02-13T17:52:31.526 INFO:teuthology.orchestra.run.gibba036.stdout: "key_file": { 2021-02-13T17:52:31.526 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "key_file", 2021-02-13T17:52:31.526 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "str", 2021-02-13T17:52:31.526 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.526 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.527 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "", 2021-02-13T17:52:31.527 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.527 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.527 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.527 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.527 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.527 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.527 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.527 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.527 INFO:teuthology.orchestra.run.gibba036.stdout: "server_addr": { 2021-02-13T17:52:31.527 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "server_addr", 2021-02-13T17:52:31.527 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "str", 2021-02-13T17:52:31.527 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.527 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.528 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "", 2021-02-13T17:52:31.528 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.528 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.528 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.528 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.528 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.528 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.528 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.528 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.528 INFO:teuthology.orchestra.run.gibba036.stdout: "server_port": { 2021-02-13T17:52:31.528 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "server_port", 2021-02-13T17:52:31.528 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "str", 2021-02-13T17:52:31.528 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.529 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.529 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "", 2021-02-13T17:52:31.529 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.529 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.529 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.529 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.529 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.529 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.529 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.529 INFO:teuthology.orchestra.run.gibba036.stdout: } 2021-02-13T17:52:31.529 INFO:teuthology.orchestra.run.gibba036.stdout: } 2021-02-13T17:52:31.529 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.529 INFO:teuthology.orchestra.run.gibba036.stdout: { 2021-02-13T17:52:31.529 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "rook", 2021-02-13T17:52:31.530 INFO:teuthology.orchestra.run.gibba036.stdout: "can_run": true, 2021-02-13T17:52:31.530 INFO:teuthology.orchestra.run.gibba036.stdout: "error_string": "", 2021-02-13T17:52:31.530 INFO:teuthology.orchestra.run.gibba036.stdout: "module_options": {} 2021-02-13T17:52:31.530 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.530 INFO:teuthology.orchestra.run.gibba036.stdout: { 2021-02-13T17:52:31.530 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "selftest", 2021-02-13T17:52:31.530 INFO:teuthology.orchestra.run.gibba036.stdout: "can_run": true, 2021-02-13T17:52:31.530 INFO:teuthology.orchestra.run.gibba036.stdout: "error_string": "", 2021-02-13T17:52:31.530 INFO:teuthology.orchestra.run.gibba036.stdout: "module_options": { 2021-02-13T17:52:31.530 INFO:teuthology.orchestra.run.gibba036.stdout: "roption1": { 2021-02-13T17:52:31.530 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "roption1", 2021-02-13T17:52:31.531 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "str", 2021-02-13T17:52:31.531 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.531 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.531 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "", 2021-02-13T17:52:31.531 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.531 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.531 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.531 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.531 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.531 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.531 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.531 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.531 INFO:teuthology.orchestra.run.gibba036.stdout: "roption2": { 2021-02-13T17:52:31.532 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "roption2", 2021-02-13T17:52:31.532 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "str", 2021-02-13T17:52:31.532 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.532 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.532 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "xyz", 2021-02-13T17:52:31.532 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.532 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.532 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.532 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.532 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.532 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.532 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.532 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.532 INFO:teuthology.orchestra.run.gibba036.stdout: "rwoption1": { 2021-02-13T17:52:31.533 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "rwoption1", 2021-02-13T17:52:31.533 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "str", 2021-02-13T17:52:31.533 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.533 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.533 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "", 2021-02-13T17:52:31.533 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.533 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.533 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.533 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.533 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.533 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.533 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.533 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.534 INFO:teuthology.orchestra.run.gibba036.stdout: "rwoption2": { 2021-02-13T17:52:31.534 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "rwoption2", 2021-02-13T17:52:31.534 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "int", 2021-02-13T17:52:31.534 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.534 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.534 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "", 2021-02-13T17:52:31.534 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.534 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.534 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.534 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.534 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.534 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.535 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.535 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.535 INFO:teuthology.orchestra.run.gibba036.stdout: "rwoption3": { 2021-02-13T17:52:31.535 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "rwoption3", 2021-02-13T17:52:31.535 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "float", 2021-02-13T17:52:31.535 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.535 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.535 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "", 2021-02-13T17:52:31.535 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.535 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.535 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.535 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.535 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.535 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.536 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.536 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.536 INFO:teuthology.orchestra.run.gibba036.stdout: "rwoption4": { 2021-02-13T17:52:31.536 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "rwoption4", 2021-02-13T17:52:31.536 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "str", 2021-02-13T17:52:31.536 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.536 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.536 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "", 2021-02-13T17:52:31.536 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.537 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.537 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.537 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.537 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.537 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.537 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.537 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.537 INFO:teuthology.orchestra.run.gibba036.stdout: "rwoption5": { 2021-02-13T17:52:31.537 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "rwoption5", 2021-02-13T17:52:31.537 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "bool", 2021-02-13T17:52:31.537 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.537 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.538 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "", 2021-02-13T17:52:31.538 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.538 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.538 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.538 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.538 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.538 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.538 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.538 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.538 INFO:teuthology.orchestra.run.gibba036.stdout: "rwoption6": { 2021-02-13T17:52:31.538 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "rwoption6", 2021-02-13T17:52:31.538 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "bool", 2021-02-13T17:52:31.538 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.538 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.539 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "True", 2021-02-13T17:52:31.539 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.539 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.539 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.539 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.539 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.539 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.539 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.539 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.539 INFO:teuthology.orchestra.run.gibba036.stdout: "testkey": { 2021-02-13T17:52:31.539 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "testkey", 2021-02-13T17:52:31.539 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "str", 2021-02-13T17:52:31.540 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.540 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.540 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "", 2021-02-13T17:52:31.540 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.540 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.540 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.540 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.540 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.540 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.540 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.540 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.540 INFO:teuthology.orchestra.run.gibba036.stdout: "testlkey": { 2021-02-13T17:52:31.540 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "testlkey", 2021-02-13T17:52:31.540 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "str", 2021-02-13T17:52:31.540 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.541 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.541 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "", 2021-02-13T17:52:31.541 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.541 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.541 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.541 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.541 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.541 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.541 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.541 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.541 INFO:teuthology.orchestra.run.gibba036.stdout: "testnewline": { 2021-02-13T17:52:31.541 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "testnewline", 2021-02-13T17:52:31.541 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "str", 2021-02-13T17:52:31.541 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.542 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.542 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "", 2021-02-13T17:52:31.542 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.542 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.542 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.542 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.542 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.542 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.542 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.542 INFO:teuthology.orchestra.run.gibba036.stdout: } 2021-02-13T17:52:31.542 INFO:teuthology.orchestra.run.gibba036.stdout: } 2021-02-13T17:52:31.542 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.543 INFO:teuthology.orchestra.run.gibba036.stdout: { 2021-02-13T17:52:31.543 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "ssh", 2021-02-13T17:52:31.543 INFO:teuthology.orchestra.run.gibba036.stdout: "can_run": true, 2021-02-13T17:52:31.543 INFO:teuthology.orchestra.run.gibba036.stdout: "error_string": "", 2021-02-13T17:52:31.543 INFO:teuthology.orchestra.run.gibba036.stdout: "module_options": { 2021-02-13T17:52:31.543 INFO:teuthology.orchestra.run.gibba036.stdout: "inventory_cache_timeout_min": { 2021-02-13T17:52:31.543 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "inventory_cache_timeout_min", 2021-02-13T17:52:31.543 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "str", 2021-02-13T17:52:31.543 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.543 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.543 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "", 2021-02-13T17:52:31.543 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.543 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.543 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.544 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.544 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.544 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.544 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.544 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.544 INFO:teuthology.orchestra.run.gibba036.stdout: "ssh_config_file": { 2021-02-13T17:52:31.544 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "ssh_config_file", 2021-02-13T17:52:31.544 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "str", 2021-02-13T17:52:31.544 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.544 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.544 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "", 2021-02-13T17:52:31.544 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.544 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.545 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.545 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.545 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.545 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.545 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.545 INFO:teuthology.orchestra.run.gibba036.stdout: } 2021-02-13T17:52:31.545 INFO:teuthology.orchestra.run.gibba036.stdout: } 2021-02-13T17:52:31.545 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.545 INFO:teuthology.orchestra.run.gibba036.stdout: { 2021-02-13T17:52:31.545 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "status", 2021-02-13T17:52:31.545 INFO:teuthology.orchestra.run.gibba036.stdout: "can_run": true, 2021-02-13T17:52:31.545 INFO:teuthology.orchestra.run.gibba036.stdout: "error_string": "", 2021-02-13T17:52:31.545 INFO:teuthology.orchestra.run.gibba036.stdout: "module_options": {} 2021-02-13T17:52:31.546 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.546 INFO:teuthology.orchestra.run.gibba036.stdout: { 2021-02-13T17:52:31.546 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "telegraf", 2021-02-13T17:52:31.546 INFO:teuthology.orchestra.run.gibba036.stdout: "can_run": true, 2021-02-13T17:52:31.546 INFO:teuthology.orchestra.run.gibba036.stdout: "error_string": "", 2021-02-13T17:52:31.546 INFO:teuthology.orchestra.run.gibba036.stdout: "module_options": { 2021-02-13T17:52:31.546 INFO:teuthology.orchestra.run.gibba036.stdout: "address": { 2021-02-13T17:52:31.546 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "address", 2021-02-13T17:52:31.546 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "str", 2021-02-13T17:52:31.546 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.546 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.546 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2021-02-13T17:52:31.546 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.546 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.547 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.547 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.547 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.547 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.547 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.547 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.547 INFO:teuthology.orchestra.run.gibba036.stdout: "interval": { 2021-02-13T17:52:31.547 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "interval", 2021-02-13T17:52:31.547 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "secs", 2021-02-13T17:52:31.547 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.547 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.547 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "15", 2021-02-13T17:52:31.547 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.547 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.548 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.548 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.548 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.548 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.548 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.548 INFO:teuthology.orchestra.run.gibba036.stdout: } 2021-02-13T17:52:31.548 INFO:teuthology.orchestra.run.gibba036.stdout: } 2021-02-13T17:52:31.548 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.548 INFO:teuthology.orchestra.run.gibba036.stdout: { 2021-02-13T17:52:31.548 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "telemetry", 2021-02-13T17:52:31.548 INFO:teuthology.orchestra.run.gibba036.stdout: "can_run": true, 2021-02-13T17:52:31.548 INFO:teuthology.orchestra.run.gibba036.stdout: "error_string": "", 2021-02-13T17:52:31.548 INFO:teuthology.orchestra.run.gibba036.stdout: "module_options": { 2021-02-13T17:52:31.549 INFO:teuthology.orchestra.run.gibba036.stdout: "channel_basic": { 2021-02-13T17:52:31.549 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "channel_basic", 2021-02-13T17:52:31.549 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "bool", 2021-02-13T17:52:31.549 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.549 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.549 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "True", 2021-02-13T17:52:31.549 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.549 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.549 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.549 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "Share basic cluster information (size, version)", 2021-02-13T17:52:31.549 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.549 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.549 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.549 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.550 INFO:teuthology.orchestra.run.gibba036.stdout: "channel_crash": { 2021-02-13T17:52:31.550 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "channel_crash", 2021-02-13T17:52:31.550 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "bool", 2021-02-13T17:52:31.550 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.550 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.550 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "True", 2021-02-13T17:52:31.550 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.550 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.550 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.550 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.550 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.550 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.550 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.551 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.551 INFO:teuthology.orchestra.run.gibba036.stdout: "channel_device": { 2021-02-13T17:52:31.551 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "channel_device", 2021-02-13T17:52:31.551 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "bool", 2021-02-13T17:52:31.551 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.551 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.551 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "True", 2021-02-13T17:52:31.551 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.551 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.551 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.551 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.551 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.551 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.551 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.552 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.552 INFO:teuthology.orchestra.run.gibba036.stdout: "channel_ident": { 2021-02-13T17:52:31.552 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "channel_ident", 2021-02-13T17:52:31.552 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "bool", 2021-02-13T17:52:31.552 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.552 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.552 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "False", 2021-02-13T17:52:31.552 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.552 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.552 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.552 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.552 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.552 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.553 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.553 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.553 INFO:teuthology.orchestra.run.gibba036.stdout: "contact": { 2021-02-13T17:52:31.553 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "contact", 2021-02-13T17:52:31.553 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "str", 2021-02-13T17:52:31.553 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.553 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.553 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "None", 2021-02-13T17:52:31.553 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.553 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.553 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.553 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.553 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.554 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.554 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.554 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.554 INFO:teuthology.orchestra.run.gibba036.stdout: "description": { 2021-02-13T17:52:31.554 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "description", 2021-02-13T17:52:31.554 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "str", 2021-02-13T17:52:31.554 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.554 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.554 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "None", 2021-02-13T17:52:31.554 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.554 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.554 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.554 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.555 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.555 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.555 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.555 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.555 INFO:teuthology.orchestra.run.gibba036.stdout: "device_url": { 2021-02-13T17:52:31.555 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "device_url", 2021-02-13T17:52:31.555 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "str", 2021-02-13T17:52:31.555 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.555 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.555 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "https://telemetry.ceph.com/device", 2021-02-13T17:52:31.555 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.555 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.555 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.556 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.556 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.556 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.556 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.556 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.556 INFO:teuthology.orchestra.run.gibba036.stdout: "enabled": { 2021-02-13T17:52:31.556 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "enabled", 2021-02-13T17:52:31.556 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "bool", 2021-02-13T17:52:31.556 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.556 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.556 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "False", 2021-02-13T17:52:31.556 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.556 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.557 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.557 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.557 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.557 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.557 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.557 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.557 INFO:teuthology.orchestra.run.gibba036.stdout: "interval": { 2021-02-13T17:52:31.557 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "interval", 2021-02-13T17:52:31.557 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "int", 2021-02-13T17:52:31.557 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.557 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.557 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "24", 2021-02-13T17:52:31.557 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "8", 2021-02-13T17:52:31.557 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.557 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.558 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.558 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.558 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.558 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.558 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.558 INFO:teuthology.orchestra.run.gibba036.stdout: "last_opt_revision": { 2021-02-13T17:52:31.558 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "last_opt_revision", 2021-02-13T17:52:31.558 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "int", 2021-02-13T17:52:31.558 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.558 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.558 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "1", 2021-02-13T17:52:31.558 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.558 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.559 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.559 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.559 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.559 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.559 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.559 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.559 INFO:teuthology.orchestra.run.gibba036.stdout: "leaderboard": { 2021-02-13T17:52:31.559 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "leaderboard", 2021-02-13T17:52:31.559 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "bool", 2021-02-13T17:52:31.559 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.559 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.559 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "False", 2021-02-13T17:52:31.560 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.560 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.560 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.560 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.560 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.560 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.560 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.560 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.560 INFO:teuthology.orchestra.run.gibba036.stdout: "organization": { 2021-02-13T17:52:31.560 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "organization", 2021-02-13T17:52:31.560 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "str", 2021-02-13T17:52:31.560 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.560 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.561 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "None", 2021-02-13T17:52:31.561 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.561 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.561 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.561 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.561 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.561 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.561 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.561 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.561 INFO:teuthology.orchestra.run.gibba036.stdout: "proxy": { 2021-02-13T17:52:31.561 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "proxy", 2021-02-13T17:52:31.561 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "str", 2021-02-13T17:52:31.561 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.562 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.562 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "None", 2021-02-13T17:52:31.562 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.562 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.562 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.562 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.562 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.562 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.562 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.562 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.562 INFO:teuthology.orchestra.run.gibba036.stdout: "url": { 2021-02-13T17:52:31.562 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "url", 2021-02-13T17:52:31.562 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "str", 2021-02-13T17:52:31.562 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.563 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.563 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "https://telemetry.ceph.com/report", 2021-02-13T17:52:31.563 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.563 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.563 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.563 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.563 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.563 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.563 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.563 INFO:teuthology.orchestra.run.gibba036.stdout: } 2021-02-13T17:52:31.563 INFO:teuthology.orchestra.run.gibba036.stdout: } 2021-02-13T17:52:31.563 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.563 INFO:teuthology.orchestra.run.gibba036.stdout: { 2021-02-13T17:52:31.563 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "test_orchestrator", 2021-02-13T17:52:31.564 INFO:teuthology.orchestra.run.gibba036.stdout: "can_run": true, 2021-02-13T17:52:31.564 INFO:teuthology.orchestra.run.gibba036.stdout: "error_string": "", 2021-02-13T17:52:31.564 INFO:teuthology.orchestra.run.gibba036.stdout: "module_options": {} 2021-02-13T17:52:31.564 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.564 INFO:teuthology.orchestra.run.gibba036.stdout: { 2021-02-13T17:52:31.564 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "volumes", 2021-02-13T17:52:31.564 INFO:teuthology.orchestra.run.gibba036.stdout: "can_run": true, 2021-02-13T17:52:31.564 INFO:teuthology.orchestra.run.gibba036.stdout: "error_string": "", 2021-02-13T17:52:31.564 INFO:teuthology.orchestra.run.gibba036.stdout: "module_options": { 2021-02-13T17:52:31.564 INFO:teuthology.orchestra.run.gibba036.stdout: "max_concurrent_clones": { 2021-02-13T17:52:31.564 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "max_concurrent_clones", 2021-02-13T17:52:31.564 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "int", 2021-02-13T17:52:31.564 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.564 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.565 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "4", 2021-02-13T17:52:31.565 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.565 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.565 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.565 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "Number of asynchronous cloner threads", 2021-02-13T17:52:31.565 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.565 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.565 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.565 INFO:teuthology.orchestra.run.gibba036.stdout: } 2021-02-13T17:52:31.565 INFO:teuthology.orchestra.run.gibba036.stdout: } 2021-02-13T17:52:31.565 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.565 INFO:teuthology.orchestra.run.gibba036.stdout: { 2021-02-13T17:52:31.565 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "zabbix", 2021-02-13T17:52:31.565 INFO:teuthology.orchestra.run.gibba036.stdout: "can_run": true, 2021-02-13T17:52:31.566 INFO:teuthology.orchestra.run.gibba036.stdout: "error_string": "", 2021-02-13T17:52:31.566 INFO:teuthology.orchestra.run.gibba036.stdout: "module_options": { 2021-02-13T17:52:31.566 INFO:teuthology.orchestra.run.gibba036.stdout: "identifier": { 2021-02-13T17:52:31.566 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "identifier", 2021-02-13T17:52:31.566 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "str", 2021-02-13T17:52:31.566 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.566 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.566 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "", 2021-02-13T17:52:31.566 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.566 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.566 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.566 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.566 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.566 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.567 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.567 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.567 INFO:teuthology.orchestra.run.gibba036.stdout: "interval": { 2021-02-13T17:52:31.567 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "interval", 2021-02-13T17:52:31.567 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "secs", 2021-02-13T17:52:31.567 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.567 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.567 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "60", 2021-02-13T17:52:31.567 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.567 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.567 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.567 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.567 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.567 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.568 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.568 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.568 INFO:teuthology.orchestra.run.gibba036.stdout: "zabbix_host": { 2021-02-13T17:52:31.568 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "zabbix_host", 2021-02-13T17:52:31.568 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "str", 2021-02-13T17:52:31.568 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.568 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.568 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "None", 2021-02-13T17:52:31.568 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.568 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.568 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.568 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.568 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.568 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.569 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.569 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.569 INFO:teuthology.orchestra.run.gibba036.stdout: "zabbix_port": { 2021-02-13T17:52:31.569 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "zabbix_port", 2021-02-13T17:52:31.569 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "int", 2021-02-13T17:52:31.569 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.569 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.569 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "10051", 2021-02-13T17:52:31.569 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.569 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.569 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.569 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.569 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.569 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.570 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.570 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.570 INFO:teuthology.orchestra.run.gibba036.stdout: "zabbix_sender": { 2021-02-13T17:52:31.570 INFO:teuthology.orchestra.run.gibba036.stdout: "name": "zabbix_sender", 2021-02-13T17:52:31.570 INFO:teuthology.orchestra.run.gibba036.stdout: "type": "str", 2021-02-13T17:52:31.570 INFO:teuthology.orchestra.run.gibba036.stdout: "level": "advanced", 2021-02-13T17:52:31.570 INFO:teuthology.orchestra.run.gibba036.stdout: "flags": 0, 2021-02-13T17:52:31.570 INFO:teuthology.orchestra.run.gibba036.stdout: "default_value": "/usr/bin/zabbix_sender", 2021-02-13T17:52:31.570 INFO:teuthology.orchestra.run.gibba036.stdout: "min": "", 2021-02-13T17:52:31.570 INFO:teuthology.orchestra.run.gibba036.stdout: "max": "", 2021-02-13T17:52:31.570 INFO:teuthology.orchestra.run.gibba036.stdout: "enum_allowed": [], 2021-02-13T17:52:31.570 INFO:teuthology.orchestra.run.gibba036.stdout: "desc": "", 2021-02-13T17:52:31.570 INFO:teuthology.orchestra.run.gibba036.stdout: "long_desc": "", 2021-02-13T17:52:31.571 INFO:teuthology.orchestra.run.gibba036.stdout: "tags": [], 2021-02-13T17:52:31.571 INFO:teuthology.orchestra.run.gibba036.stdout: "see_also": [] 2021-02-13T17:52:31.571 INFO:teuthology.orchestra.run.gibba036.stdout: } 2021-02-13T17:52:31.571 INFO:teuthology.orchestra.run.gibba036.stdout: } 2021-02-13T17:52:31.571 INFO:teuthology.orchestra.run.gibba036.stdout: } 2021-02-13T17:52:31.571 INFO:teuthology.orchestra.run.gibba036.stdout: ], 2021-02-13T17:52:31.571 INFO:teuthology.orchestra.run.gibba036.stdout: "services": {}, 2021-02-13T17:52:31.571 INFO:teuthology.orchestra.run.gibba036.stdout: "always_on_modules": { 2021-02-13T17:52:31.571 INFO:teuthology.orchestra.run.gibba036.stdout: "nautilus": [ 2021-02-13T17:52:31.571 INFO:teuthology.orchestra.run.gibba036.stdout: "balancer", 2021-02-13T17:52:31.571 INFO:teuthology.orchestra.run.gibba036.stdout: "crash", 2021-02-13T17:52:31.571 INFO:teuthology.orchestra.run.gibba036.stdout: "devicehealth", 2021-02-13T17:52:31.571 INFO:teuthology.orchestra.run.gibba036.stdout: "orchestrator_cli", 2021-02-13T17:52:31.571 INFO:teuthology.orchestra.run.gibba036.stdout: "progress", 2021-02-13T17:52:31.572 INFO:teuthology.orchestra.run.gibba036.stdout: "rbd_support", 2021-02-13T17:52:31.572 INFO:teuthology.orchestra.run.gibba036.stdout: "status", 2021-02-13T17:52:31.572 INFO:teuthology.orchestra.run.gibba036.stdout: "volumes" 2021-02-13T17:52:31.572 INFO:teuthology.orchestra.run.gibba036.stdout: ] 2021-02-13T17:52:31.572 INFO:teuthology.orchestra.run.gibba036.stdout: } 2021-02-13T17:52:31.572 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.572 INFO:teuthology.orchestra.run.gibba036.stdout: "servicemap": { 2021-02-13T17:52:31.572 INFO:teuthology.orchestra.run.gibba036.stdout: "epoch": 1, 2021-02-13T17:52:31.572 INFO:teuthology.orchestra.run.gibba036.stdout: "modified": "0.000000", 2021-02-13T17:52:31.572 INFO:teuthology.orchestra.run.gibba036.stdout: "services": {} 2021-02-13T17:52:31.572 INFO:teuthology.orchestra.run.gibba036.stdout: }, 2021-02-13T17:52:31.572 INFO:teuthology.orchestra.run.gibba036.stdout: "progress_events": {} 2021-02-13T17:52:31.572 INFO:teuthology.orchestra.run.gibba036.stdout:} 2021-02-13T17:52:31.574 INFO:tasks.ceph.ceph_manager.c2:{'fsid': '554ed120-a4b0-4e13-b48c-53832c6f02bd', 'health': {'checks': {}, 'status': 'HEALTH_OK'}, 'election_epoch': 3, 'quorum': [0], 'quorum_names': ['a'], 'quorum_age': 13, 'monmap': {'epoch': 1, 'min_mon_release_name': '14', 'num_mons': 1}, 'osdmap': {'osdmap': {'epoch': 11, 'num_osds': 3, 'num_up_osds': 3, 'num_in_osds': 3, 'num_remapped_pgs': 0}}, 'pgmap': {'pgs_by_state': [{'state_name': 'active+clean', 'count': 8}], 'num_pgs': 8, 'num_pools': 1, 'num_objects': 0, 'data_bytes': 0, 'bytes_used': 3221528576, 'bytes_avail': 318901018624, 'bytes_total': 322122547200}, 'fsmap': {'epoch': 1, 'by_rank': [], 'up:standby': 0}, 'mgrmap': {'epoch': 3, 'active_gid': 4100, 'active_name': 'x', 'active_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.2.136:6824', 'nonce': 14041}, {'type': 'v1', 'addr': '172.21.2.136:6825', 'nonce': 14041}]}, 'active_addr': '172.21.2.136:6825/14041', 'active_change': '2021-02-13 17:52:19.742256', 'available': True, 'standbys': [], 'modules': ['iostat', 'restful'], 'available_modules': [{'name': 'alerts', 'can_run': True, 'error_string': '', 'module_options': {'interval': {'name': 'interval', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '60', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'How frequently to reexamine health status', 'long_desc': '', 'tags': [], 'see_also': []}, 'smtp_destination': {'name': 'smtp_destination', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'Email address to send alerts to', 'long_desc': '', 'tags': [], 'see_also': []}, 'smtp_from_name': {'name': 'smtp_from_name', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': 'Ceph', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'Email From: name', 'long_desc': '', 'tags': [], 'see_also': []}, 'smtp_host': {'name': 'smtp_host', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'SMTP server', 'long_desc': '', 'tags': [], 'see_also': []}, 'smtp_password': {'name': 'smtp_password', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'Password to authenticate with', 'long_desc': '', 'tags': [], 'see_also': []}, 'smtp_port': {'name': 'smtp_port', 'type': 'int', 'level': 'advanced', 'flags': 1, 'default_value': '465', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'SMTP port', 'long_desc': '', 'tags': [], 'see_also': []}, 'smtp_sender': {'name': 'smtp_sender', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'SMTP envelope sender', 'long_desc': '', 'tags': [], 'see_also': []}, 'smtp_ssl': {'name': 'smtp_ssl', 'type': 'bool', 'level': 'advanced', 'flags': 1, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'Use SSL to connect to SMTP server', 'long_desc': '', 'tags': [], 'see_also': []}, 'smtp_user': {'name': 'smtp_user', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'User to authenticate as', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'ansible', 'can_run': True, 'error_string': '', 'module_options': {'password': {'name': 'password', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'server_url': {'name': 'server_url', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'username': {'name': 'username', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'verify_server': {'name': 'verify_server', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'balancer', 'can_run': True, 'error_string': '', 'module_options': {'active': {'name': 'active', 'type': 'bool', 'level': 'advanced', 'flags': 1, 'default_value': 'False', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'automatically balance PGs across cluster', 'long_desc': '', 'tags': [], 'see_also': []}, 'begin_time': {'name': 'begin_time', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': '0000', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'beginning time of day to automatically balance', 'long_desc': 'This is a time of day in the format HHMM.', 'tags': [], 'see_also': []}, 'begin_weekday': {'name': 'begin_weekday', 'type': 'uint', 'level': 'advanced', 'flags': 1, 'default_value': '0', 'min': '0', 'max': '7', 'enum_allowed': [], 'desc': 'Restrict automatic balancing to this day of the week or later', 'long_desc': '0 or 7 = Sunday, 1 = Monday, etc.', 'tags': [], 'see_also': []}, 'crush_compat_max_iterations': {'name': 'crush_compat_max_iterations', 'type': 'uint', 'level': 'advanced', 'flags': 1, 'default_value': '25', 'min': '1', 'max': '250', 'enum_allowed': [], 'desc': 'maximum number of iterations to attempt optimization', 'long_desc': '', 'tags': [], 'see_also': []}, 'crush_compat_metrics': {'name': 'crush_compat_metrics', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': 'pgs,objects,bytes', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'metrics with which to calculate OSD utilization', 'long_desc': 'Value is a list of one or more of "pgs", "objects", or "bytes", and indicates which metrics to use to balance utilization.', 'tags': [], 'see_also': []}, 'crush_compat_step': {'name': 'crush_compat_step', 'type': 'float', 'level': 'advanced', 'flags': 1, 'default_value': '0.5', 'min': '0.001', 'max': '0.999', 'enum_allowed': [], 'desc': 'aggressiveness of optimization', 'long_desc': '.99 is very aggressive, .01 is less aggressive', 'tags': [], 'see_also': []}, 'end_time': {'name': 'end_time', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': '2400', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'ending time of day to automatically balance', 'long_desc': 'This is a time of day in the format HHMM.', 'tags': [], 'see_also': []}, 'end_weekday': {'name': 'end_weekday', 'type': 'uint', 'level': 'advanced', 'flags': 1, 'default_value': '7', 'min': '0', 'max': '7', 'enum_allowed': [], 'desc': 'Restrict automatic balancing to days of the week earlier than this', 'long_desc': '0 or 7 = Sunday, 1 = Monday, etc.', 'tags': [], 'see_also': []}, 'min_score': {'name': 'min_score', 'type': 'float', 'level': 'advanced', 'flags': 1, 'default_value': '0', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'minimum score, below which no optimization is attempted', 'long_desc': '', 'tags': [], 'see_also': []}, 'mode': {'name': 'mode', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': 'none', 'min': '', 'max': '', 'enum_allowed': ['crush-compat', 'none', 'upmap'], 'desc': 'Balancer mode', 'long_desc': '', 'tags': [], 'see_also': []}, 'pool_ids': {'name': 'pool_ids', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'pools which the automatic balancing will be limited to', 'long_desc': '', 'tags': [], 'see_also': []}, 'sleep_interval': {'name': 'sleep_interval', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '60', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'how frequently to wake up and attempt optimization', 'long_desc': '', 'tags': [], 'see_also': []}, 'upmap_max_deviation': {'name': 'upmap_max_deviation', 'type': 'int', 'level': 'advanced', 'flags': 1, 'default_value': '5', 'min': '1', 'max': '', 'enum_allowed': [], 'desc': 'deviation below which no optimization is attempted', 'long_desc': 'If the number of PGs are within this count then no optimization is attempted', 'tags': [], 'see_also': []}, 'upmap_max_iterations': {'name': 'upmap_max_iterations', 'type': 'uint', 'level': 'advanced', 'flags': 1, 'default_value': '10', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'maximum upmap optimization iterations', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'crash', 'can_run': True, 'error_string': '', 'module_options': {'retain_interval': {'name': 'retain_interval', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '31536000', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'how long to retain crashes before pruning them', 'long_desc': '', 'tags': [], 'see_also': []}, 'warn_recent_interval': {'name': 'warn_recent_interval', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '1209600', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'time interval in which to warn about recent crashes', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'dashboard', 'can_run': True, 'error_string': '', 'module_options': {'ALERTMANAGER_API_HOST': {'name': 'ALERTMANAGER_API_HOST', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'AUDIT_API_ENABLED': {'name': 'AUDIT_API_ENABLED', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'False', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'AUDIT_API_LOG_PAYLOAD': {'name': 'AUDIT_API_LOG_PAYLOAD', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'ENABLE_BROWSABLE_API': {'name': 'ENABLE_BROWSABLE_API', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'FEATURE_TOGGLE_cephfs': {'name': 'FEATURE_TOGGLE_cephfs', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'FEATURE_TOGGLE_iscsi': {'name': 'FEATURE_TOGGLE_iscsi', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'FEATURE_TOGGLE_mirroring': {'name': 'FEATURE_TOGGLE_mirroring', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'FEATURE_TOGGLE_rbd': {'name': 'FEATURE_TOGGLE_rbd', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'FEATURE_TOGGLE_rgw': {'name': 'FEATURE_TOGGLE_rgw', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE': {'name': 'GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'GRAFANA_API_PASSWORD': {'name': 'GRAFANA_API_PASSWORD', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'admin', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'GRAFANA_API_SSL_VERIFY': {'name': 'GRAFANA_API_SSL_VERIFY', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'GRAFANA_API_URL': {'name': 'GRAFANA_API_URL', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'GRAFANA_API_USERNAME': {'name': 'GRAFANA_API_USERNAME', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'admin', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'GRAFANA_FRONTEND_API_URL': {'name': 'GRAFANA_FRONTEND_API_URL', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'GRAFANA_UPDATE_DASHBOARDS': {'name': 'GRAFANA_UPDATE_DASHBOARDS', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'False', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'ISCSI_API_SSL_VERIFICATION': {'name': 'ISCSI_API_SSL_VERIFICATION', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'PROMETHEUS_API_HOST': {'name': 'PROMETHEUS_API_HOST', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'REST_REQUESTS_TIMEOUT': {'name': 'REST_REQUESTS_TIMEOUT', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '45', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'RGW_API_ACCESS_KEY': {'name': 'RGW_API_ACCESS_KEY', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'RGW_API_ADMIN_RESOURCE': {'name': 'RGW_API_ADMIN_RESOURCE', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'admin', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'RGW_API_HOST': {'name': 'RGW_API_HOST', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'RGW_API_PORT': {'name': 'RGW_API_PORT', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '80', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'RGW_API_SCHEME': {'name': 'RGW_API_SCHEME', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'http', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'RGW_API_SECRET_KEY': {'name': 'RGW_API_SECRET_KEY', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'RGW_API_SSL_VERIFY': {'name': 'RGW_API_SSL_VERIFY', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'RGW_API_USER_ID': {'name': 'RGW_API_USER_ID', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'crt_file': {'name': 'crt_file', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'debug': {'name': 'debug', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'False', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'Enable/disable debug options', 'long_desc': '', 'tags': [], 'see_also': []}, 'jwt_token_ttl': {'name': 'jwt_token_ttl', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '28800', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'key_file': {'name': 'key_file', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'password': {'name': 'password', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'server_addr': {'name': 'server_addr', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '::', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'server_port': {'name': 'server_port', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '8080', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'ssl': {'name': 'ssl', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'ssl_server_port': {'name': 'ssl_server_port', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '8443', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'standby_behaviour': {'name': 'standby_behaviour', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'redirect', 'min': '', 'max': '', 'enum_allowed': ['error', 'redirect'], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'standby_error_status_code': {'name': 'standby_error_status_code', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '500', 'min': '400', 'max': '599', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'url_prefix': {'name': 'url_prefix', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'username': {'name': 'username', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'deepsea', 'can_run': True, 'error_string': '', 'module_options': {'salt_api_eauth': {'name': 'salt_api_eauth', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'sharedsecret', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'salt_api_password': {'name': 'salt_api_password', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'salt_api_url': {'name': 'salt_api_url', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'salt_api_username': {'name': 'salt_api_username', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'devicehealth', 'can_run': True, 'error_string': '', 'module_options': {'enable_monitoring': {'name': 'enable_monitoring', 'type': 'bool', 'level': 'advanced', 'flags': 1, 'default_value': 'False', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'monitor device health metrics', 'long_desc': '', 'tags': [], 'see_also': []}, 'mark_out_threshold': {'name': 'mark_out_threshold', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '2419200', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'automatically mark OSD if it may fail before this long', 'long_desc': '', 'tags': [], 'see_also': []}, 'pool_name': {'name': 'pool_name', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': 'device_health_metrics', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'name of pool in which to store device health metrics', 'long_desc': '', 'tags': [], 'see_also': []}, 'retention_period': {'name': 'retention_period', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '15552000', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'how long to retain device health metrics', 'long_desc': '', 'tags': [], 'see_also': []}, 'scrape_frequency': {'name': 'scrape_frequency', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '86400', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'how frequently to scrape device health metrics', 'long_desc': '', 'tags': [], 'see_also': []}, 'self_heal': {'name': 'self_heal', 'type': 'bool', 'level': 'advanced', 'flags': 1, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'preemptively heal cluster around devices that may fail', 'long_desc': '', 'tags': [], 'see_also': []}, 'sleep_interval': {'name': 'sleep_interval', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '600', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'how frequently to wake up and check device health', 'long_desc': '', 'tags': [], 'see_also': []}, 'warn_threshold': {'name': 'warn_threshold', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '7257600', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'raise health warning if OSD may fail before this long', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'diskprediction_cloud', 'can_run': True, 'error_string': '', 'module_options': {'diskprediction_cert_context': {'name': 'diskprediction_cert_context', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'diskprediction_default_authority': {'name': 'diskprediction_default_authority', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'localhost', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'diskprediction_password': {'name': 'diskprediction_password', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'diskprediction_port': {'name': 'diskprediction_port', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '31400', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'diskprediction_retrieve_prediction_interval': {'name': 'diskprediction_retrieve_prediction_interval', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '43200', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'diskprediction_server': {'name': 'diskprediction_server', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'diskprediction_ssl_target_name_override': {'name': 'diskprediction_ssl_target_name_override', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'localhost', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'diskprediction_upload_metrics_interval': {'name': 'diskprediction_upload_metrics_interval', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '600', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'diskprediction_upload_smart_interval': {'name': 'diskprediction_upload_smart_interval', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '43200', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'diskprediction_user': {'name': 'diskprediction_user', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'sleep_interval': {'name': 'sleep_interval', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '600', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'diskprediction_local', 'can_run': True, 'error_string': '', 'module_options': {'predict_interval': {'name': 'predict_interval', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '86400', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'sleep_interval': {'name': 'sleep_interval', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '600', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'influx', 'can_run': False, 'error_string': 'influxdb python module not found', 'module_options': {'batch_size': {'name': 'batch_size', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '5000', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'database': {'name': 'database', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'ceph', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'hostname': {'name': 'hostname', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'None', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'interval': {'name': 'interval', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '30', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'password': {'name': 'password', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'None', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'port': {'name': 'port', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '8086', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'ssl': {'name': 'ssl', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'false', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'threads': {'name': 'threads', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '5', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'username': {'name': 'username', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'None', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'verify_ssl': {'name': 'verify_ssl', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'true', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'insights', 'can_run': True, 'error_string': '', 'module_options': {}}, {'name': 'iostat', 'can_run': True, 'error_string': '', 'module_options': {}}, {'name': 'localpool', 'can_run': True, 'error_string': '', 'module_options': {'failure_domain': {'name': 'failure_domain', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': 'host', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'failure domain for any created local pool', 'long_desc': '', 'tags': [], 'see_also': []}, 'min_size': {'name': 'min_size', 'type': 'int', 'level': 'advanced', 'flags': 1, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'default min_size for any created local pool', 'long_desc': '', 'tags': [], 'see_also': []}, 'num_rep': {'name': 'num_rep', 'type': 'int', 'level': 'advanced', 'flags': 1, 'default_value': '3', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'default replica count for any created local pool', 'long_desc': '', 'tags': [], 'see_also': []}, 'pg_num': {'name': 'pg_num', 'type': 'int', 'level': 'advanced', 'flags': 1, 'default_value': '128', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'default pg_num for any created local pool', 'long_desc': '', 'tags': [], 'see_also': []}, 'prefix': {'name': 'prefix', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'name prefix for any created local pool', 'long_desc': '', 'tags': [], 'see_also': []}, 'subtree': {'name': 'subtree', 'type': 'str', 'level': 'advanced', 'flags': 1, 'default_value': 'rack', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'CRUSH level for which to create a local pool', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'orchestrator_cli', 'can_run': True, 'error_string': '', 'module_options': {'orchestrator': {'name': 'orchestrator', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'pg_autoscaler', 'can_run': True, 'error_string': '', 'module_options': {'sleep_interval': {'name': 'sleep_interval', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '60', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'progress', 'can_run': True, 'error_string': '', 'module_options': {'enabled': {'name': 'enabled', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'max_completed_events': {'name': 'max_completed_events', 'type': 'int', 'level': 'advanced', 'flags': 1, 'default_value': '50', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'number of past completed events to remember', 'long_desc': '', 'tags': [], 'see_also': []}, 'persist_interval': {'name': 'persist_interval', 'type': 'secs', 'level': 'advanced', 'flags': 1, 'default_value': '5', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'how frequently to persist completed events', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'prometheus', 'can_run': True, 'error_string': '', 'module_options': {'rbd_stats_pools': {'name': 'rbd_stats_pools', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'rbd_stats_pools_refresh_interval': {'name': 'rbd_stats_pools_refresh_interval', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '300', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'scrape_interval': {'name': 'scrape_interval', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'server_addr': {'name': 'server_addr', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'server_port': {'name': 'server_port', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'stale_cache_strategy': {'name': 'stale_cache_strategy', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'rbd_support', 'can_run': True, 'error_string': '', 'module_options': {}}, {'name': 'restful', 'can_run': True, 'error_string': '', 'module_options': {'key_file': {'name': 'key_file', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'server_addr': {'name': 'server_addr', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'server_port': {'name': 'server_port', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'rook', 'can_run': True, 'error_string': '', 'module_options': {}}, {'name': 'selftest', 'can_run': True, 'error_string': '', 'module_options': {'roption1': {'name': 'roption1', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'roption2': {'name': 'roption2', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'xyz', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'rwoption1': {'name': 'rwoption1', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'rwoption2': {'name': 'rwoption2', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'rwoption3': {'name': 'rwoption3', 'type': 'float', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'rwoption4': {'name': 'rwoption4', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'rwoption5': {'name': 'rwoption5', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'rwoption6': {'name': 'rwoption6', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'testkey': {'name': 'testkey', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'testlkey': {'name': 'testlkey', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'testnewline': {'name': 'testnewline', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'ssh', 'can_run': True, 'error_string': '', 'module_options': {'inventory_cache_timeout_min': {'name': 'inventory_cache_timeout_min', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'ssh_config_file': {'name': 'ssh_config_file', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'status', 'can_run': True, 'error_string': '', 'module_options': {}}, {'name': 'telegraf', 'can_run': True, 'error_string': '', 'module_options': {'address': {'name': 'address', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'unixgram:///tmp/telegraf.sock', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'interval': {'name': 'interval', 'type': 'secs', 'level': 'advanced', 'flags': 0, 'default_value': '15', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'telemetry', 'can_run': True, 'error_string': '', 'module_options': {'channel_basic': {'name': 'channel_basic', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'Share basic cluster information (size, version)', 'long_desc': '', 'tags': [], 'see_also': []}, 'channel_crash': {'name': 'channel_crash', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'channel_device': {'name': 'channel_device', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'True', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'channel_ident': {'name': 'channel_ident', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'False', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'contact': {'name': 'contact', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'None', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'description': {'name': 'description', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'None', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'device_url': {'name': 'device_url', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'https://telemetry.ceph.com/device', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'enabled': {'name': 'enabled', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'False', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'interval': {'name': 'interval', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '24', 'min': '8', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'last_opt_revision': {'name': 'last_opt_revision', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '1', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'leaderboard': {'name': 'leaderboard', 'type': 'bool', 'level': 'advanced', 'flags': 0, 'default_value': 'False', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'organization': {'name': 'organization', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'None', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'proxy': {'name': 'proxy', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'None', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'url': {'name': 'url', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'https://telemetry.ceph.com/report', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'test_orchestrator', 'can_run': True, 'error_string': '', 'module_options': {}}, {'name': 'volumes', 'can_run': True, 'error_string': '', 'module_options': {'max_concurrent_clones': {'name': 'max_concurrent_clones', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '4', 'min': '', 'max': '', 'enum_allowed': [], 'desc': 'Number of asynchronous cloner threads', 'long_desc': '', 'tags': [], 'see_also': []}}}, {'name': 'zabbix', 'can_run': True, 'error_string': '', 'module_options': {'identifier': {'name': 'identifier', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'interval': {'name': 'interval', 'type': 'secs', 'level': 'advanced', 'flags': 0, 'default_value': '60', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'zabbix_host': {'name': 'zabbix_host', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': 'None', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'zabbix_port': {'name': 'zabbix_port', 'type': 'int', 'level': 'advanced', 'flags': 0, 'default_value': '10051', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}, 'zabbix_sender': {'name': 'zabbix_sender', 'type': 'str', 'level': 'advanced', 'flags': 0, 'default_value': '/usr/bin/zabbix_sender', 'min': '', 'max': '', 'enum_allowed': [], 'desc': '', 'long_desc': '', 'tags': [], 'see_also': []}}}], 'services': {}, 'always_on_modules': {'nautilus': ['balancer', 'crash', 'devicehealth', 'orchestrator_cli', 'progress', 'rbd_support', 'status', 'volumes']}}, 'servicemap': {'epoch': 1, 'modified': '0.000000', 'services': {}}, 'progress_events': {}} 2021-02-13T17:52:31.575 INFO:tasks.ceph.ceph_manager.c2:clean! 2021-02-13T17:52:31.576 INFO:tasks.ceph:Waiting until ceph cluster c2 is healthy... 2021-02-13T17:52:31.576 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster c2 health 2021-02-13T17:52:31.737 INFO:teuthology.misc.health.gibba036.stdout:HEALTH_OK 2021-02-13T17:52:31.751 DEBUG:teuthology.misc:Ceph health: HEALTH_OK 2021-02-13T17:52:31.752 INFO:teuthology.run_tasks:Running task rgw... 2021-02-13T17:52:31.765 DEBUG:tasks.rgw:config is {'c1.client.0': {'port': 8000}, 'c1.client.1': {'port': 8001}, 'c2.client.0': {'port': 8000}, 'c2.client.1': {'port': 8001}} 2021-02-13T17:52:31.766 DEBUG:tasks.rgw:client list is dict_keys(['c1.client.0', 'c1.client.1', 'c2.client.0', 'c2.client.1']) 2021-02-13T17:52:31.766 INFO:tasks.rgw:Creating data pools 2021-02-13T17:52:31.766 DEBUG:tasks.rgw:Obtaining remote for client c1.client.0 2021-02-13T17:52:31.766 DEBUG:teuthology.orchestra.run.gibba025:> sudo ceph osd pool create default.rgw.buckets.data 64 64 --cluster c1 2021-02-13T17:52:31.988 INFO:teuthology.orchestra.run.gibba025.stderr:pool 'default.rgw.buckets.data' created 2021-02-13T17:52:31.996 DEBUG:teuthology.orchestra.run.gibba025:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster c1 2021-02-13T17:52:33.015 INFO:teuthology.orchestra.run.gibba025.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2021-02-13T17:52:33.025 DEBUG:teuthology.orchestra.run.gibba025:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster c1 2021-02-13T17:52:33.996 INFO:teuthology.orchestra.run.gibba025.stderr:pool 'default.rgw.buckets.index' created 2021-02-13T17:52:34.003 DEBUG:teuthology.orchestra.run.gibba025:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster c1 2021-02-13T17:52:35.032 INFO:teuthology.orchestra.run.gibba025.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2021-02-13T17:52:35.042 DEBUG:tasks.rgw:Obtaining remote for client c1.client.1 2021-02-13T17:52:35.042 DEBUG:teuthology.orchestra.run.gibba025:> sudo ceph osd pool create default.rgw.buckets.data 64 64 --cluster c1 2021-02-13T17:52:35.216 INFO:teuthology.orchestra.run.gibba025.stderr:pool 'default.rgw.buckets.data' already exists 2021-02-13T17:52:35.225 DEBUG:teuthology.orchestra.run.gibba025:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster c1 2021-02-13T17:52:36.043 INFO:teuthology.orchestra.run.gibba025.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2021-02-13T17:52:36.055 DEBUG:teuthology.orchestra.run.gibba025:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster c1 2021-02-13T17:52:36.211 INFO:teuthology.orchestra.run.gibba025.stderr:pool 'default.rgw.buckets.index' already exists 2021-02-13T17:52:36.220 DEBUG:teuthology.orchestra.run.gibba025:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster c1 2021-02-13T17:52:37.040 INFO:teuthology.orchestra.run.gibba025.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2021-02-13T17:52:37.053 DEBUG:tasks.rgw:Obtaining remote for client c2.client.0 2021-02-13T17:52:37.053 DEBUG:teuthology.orchestra.run.gibba036:> sudo ceph osd pool create default.rgw.buckets.data 64 64 --cluster c2 2021-02-13T17:52:37.275 INFO:teuthology.orchestra.run.gibba036.stderr:pool 'default.rgw.buckets.data' created 2021-02-13T17:52:37.281 DEBUG:teuthology.orchestra.run.gibba036:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster c2 2021-02-13T17:52:38.301 INFO:teuthology.orchestra.run.gibba036.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2021-02-13T17:52:38.311 DEBUG:teuthology.orchestra.run.gibba036:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster c2 2021-02-13T17:52:39.291 INFO:teuthology.orchestra.run.gibba036.stderr:pool 'default.rgw.buckets.index' created 2021-02-13T17:52:39.301 DEBUG:teuthology.orchestra.run.gibba036:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster c2 2021-02-13T17:52:40.322 INFO:teuthology.orchestra.run.gibba036.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2021-02-13T17:52:40.345 DEBUG:tasks.rgw:Obtaining remote for client c2.client.1 2021-02-13T17:52:40.346 DEBUG:teuthology.orchestra.run.gibba036:> sudo ceph osd pool create default.rgw.buckets.data 64 64 --cluster c2 2021-02-13T17:52:40.554 INFO:teuthology.orchestra.run.gibba036.stderr:pool 'default.rgw.buckets.data' already exists 2021-02-13T17:52:40.569 DEBUG:teuthology.orchestra.run.gibba036:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster c2 2021-02-13T17:52:41.342 INFO:teuthology.orchestra.run.gibba036.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2021-02-13T17:52:41.358 DEBUG:teuthology.orchestra.run.gibba036:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster c2 2021-02-13T17:52:41.519 INFO:teuthology.orchestra.run.gibba036.stderr:pool 'default.rgw.buckets.index' already exists 2021-02-13T17:52:41.527 DEBUG:teuthology.orchestra.run.gibba036:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster c2 2021-02-13T17:52:42.344 INFO:teuthology.orchestra.run.gibba036.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2021-02-13T17:52:42.361 DEBUG:tasks.rgw:Pools created 2021-02-13T17:52:42.361 INFO:tasks.rgw:Configuring compression type = random 2021-02-13T17:52:42.362 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['user', 'list'] 2021-02-13T17:52:42.362 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'user', 'list'] 2021-02-13T17:52:42.362 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 user list 2021-02-13T17:52:42.396 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:42.390 7f7d191d5940 20 rados->read ofs=0 len=0 2021-02-13T17:52:43.467 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:43.462 7f7d191d5940 20 rados_obj.operate() r=-2 bl.length=0 2021-02-13T17:52:43.467 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:43.462 7f7d191d5940 20 rados->read ofs=0 len=0 2021-02-13T17:52:43.470 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:43.466 7f7d191d5940 20 rados_obj.operate() r=-2 bl.length=0 2021-02-13T17:52:43.470 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:43.466 7f7d191d5940 20 rados->read ofs=0 len=0 2021-02-13T17:52:43.471 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:43.466 7f7d191d5940 20 rados_obj.operate() r=-2 bl.length=0 2021-02-13T17:52:43.471 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:43.466 7f7d191d5940 20 rados->read ofs=0 len=0 2021-02-13T17:52:43.471 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:43.466 7f7d191d5940 20 rados_obj.operate() r=-2 bl.length=0 2021-02-13T17:52:43.478 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:43.474 7f7d191d5940 20 rados->read ofs=0 len=0 2021-02-13T17:52:43.479 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:43.474 7f7d191d5940 20 rados_obj.operate() r=-2 bl.length=0 2021-02-13T17:52:43.479 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:43.474 7f7d191d5940 20 rados->read ofs=0 len=0 2021-02-13T17:52:43.480 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:43.474 7f7d191d5940 20 rados_obj.operate() r=-2 bl.length=0 2021-02-13T17:52:43.480 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:43.474 7f7d191d5940 20 rados->read ofs=0 len=0 2021-02-13T17:52:43.480 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:43.474 7f7d191d5940 20 rados_obj.operate() r=-2 bl.length=0 2021-02-13T17:52:43.480 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:43.474 7f7d191d5940 10 cannot find current period zonegroup using local zonegroup 2021-02-13T17:52:43.480 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:43.474 7f7d191d5940 20 rados->read ofs=0 len=0 2021-02-13T17:52:43.480 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:43.474 7f7d191d5940 20 rados_obj.operate() r=-2 bl.length=0 2021-02-13T17:52:43.480 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:43.474 7f7d191d5940 20 rados->read ofs=0 len=0 2021-02-13T17:52:43.480 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:43.474 7f7d191d5940 20 rados_obj.operate() r=-2 bl.length=0 2021-02-13T17:52:43.480 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:43.474 7f7d191d5940 10 Creating default zonegroup 2021-02-13T17:52:43.481 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:43.474 7f7d191d5940 20 get_system_obj_state: rctx=0x7ffe328ebde0 obj=:.pools.avail state=0x560ccfccae70 s->prefetch_data=0 2021-02-13T17:52:43.481 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:43.474 7f7d191d5940 10 couldn't find old data placement pools config, setting up new ones for the zone 2021-02-13T17:52:43.489 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:43.482 7f7d191d5940 10 WARNING: store->list_zones() returned r=-2 2021-02-13T17:52:43.489 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:43.482 7f7d191d5940 20 rados->read ofs=0 len=0 2021-02-13T17:52:43.489 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:43.482 7f7d191d5940 20 rados_obj.operate() r=-2 bl.length=0 2021-02-13T17:52:43.492 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:43.486 7f7d191d5940 20 rados->read ofs=0 len=0 2021-02-13T17:52:43.492 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:43.486 7f7d191d5940 20 rados_obj.operate() r=-2 bl.length=0 2021-02-13T17:52:43.492 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:43.486 7f7d191d5940 10 could not read realm id: (2) No such file or directory 2021-02-13T17:52:43.493 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:43.486 7f7d191d5940 10 WARNING: failed to set zone as default, r=-22 2021-02-13T17:52:43.493 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:43.486 7f7d191d5940 20 rados->read ofs=0 len=0 2021-02-13T17:52:43.493 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:43.486 7f7d191d5940 20 rados_obj.operate() r=-2 bl.length=0 2021-02-13T17:52:43.496 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:43.490 7f7d191d5940 20 rados->read ofs=0 len=0 2021-02-13T17:52:43.496 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:43.490 7f7d191d5940 20 rados_obj.operate() r=0 bl.length=805 2021-02-13T17:52:43.496 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:43.490 7f7d191d5940 20 rados->read ofs=0 len=0 2021-02-13T17:52:43.497 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:43.490 7f7d191d5940 20 rados_obj.operate() r=0 bl.length=348 2021-02-13T17:52:43.497 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:43.490 7f7d191d5940 20 zonegroup default 2021-02-13T17:52:43.497 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:43.490 7f7d191d5940 20 rados->read ofs=0 len=0 2021-02-13T17:52:43.497 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:43.490 7f7d191d5940 20 rados_obj.operate() r=-2 bl.length=0 2021-02-13T17:52:43.497 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:43.490 7f7d191d5940 10 Cannot find current period zone using local zone 2021-02-13T17:52:43.497 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:43.490 7f7d191d5940 10 Using default name default 2021-02-13T17:52:43.497 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:43.490 7f7d191d5940 20 rados->read ofs=0 len=0 2021-02-13T17:52:43.498 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:43.490 7f7d191d5940 20 rados_obj.operate() r=0 bl.length=46 2021-02-13T17:52:43.498 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:43.490 7f7d191d5940 20 rados->read ofs=0 len=0 2021-02-13T17:52:43.498 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:43.490 7f7d191d5940 20 rados_obj.operate() r=0 bl.length=805 2021-02-13T17:52:43.498 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:43.490 7f7d191d5940 20 zone default 2021-02-13T17:52:45.490 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:45.482 7f7d191d5940 20 add_watcher() i=0 2021-02-13T17:52:45.491 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:45.482 7f7d191d5940 20 add_watcher() i=1 2021-02-13T17:52:45.491 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:45.482 7f7d191d5940 20 add_watcher() i=2 2021-02-13T17:52:45.491 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:45.482 7f7d191d5940 20 add_watcher() i=3 2021-02-13T17:52:45.491 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:45.482 7f7d191d5940 20 add_watcher() i=4 2021-02-13T17:52:45.491 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:45.482 7f7d191d5940 20 add_watcher() i=5 2021-02-13T17:52:45.491 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:45.482 7f7d191d5940 20 add_watcher() i=6 2021-02-13T17:52:45.491 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:45.486 7f7d191d5940 20 add_watcher() i=7 2021-02-13T17:52:45.492 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:45.486 7f7d191d5940 2 all 8 watchers are set, enabling cache 2021-02-13T17:52:45.493 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:45.486 7f7cdd7fa700 2 RGWDataChangesLog::ChangesRenewThread: start 2021-02-13T17:52:47.491 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:47.486 7f7d191d5940 10 rgw_init_ioctx warning: failed to set pg_autoscale_bias on default.rgw.meta 2021-02-13T17:52:47.492 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:47.486 7f7d191d5940 10 rgw_init_ioctx warning: failed to set pg_num_min on default.rgw.meta 2021-02-13T17:52:49.507 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:49.502 7f7d191d5940 10 rgw_init_ioctx warning: failed to set pg_autoscale_bias on default.rgw.log 2021-02-13T17:52:49.507 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:49.502 7f7d191d5940 10 rgw_init_ioctx warning: failed to set pg_num_min on default.rgw.log 2021-02-13T17:52:49.517 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:49.510 7f7cb7fdf700 20 reqs_thread_entry: start 2021-02-13T17:52:49.517 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:49.510 7f7d191d5940 20 init_complete bucket index max shards: 0 2021-02-13T17:52:49.517 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:49.510 7f7cb5fdb700 20 reqs_thread_entry: start 2021-02-13T17:52:49.517 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:49.510 7f7c27fff700 20 reqs_thread_entry: start 2021-02-13T17:52:49.529 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:49.522 7f7d191d5940 20 remove_watcher() i=0 2021-02-13T17:52:49.529 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:49.522 7f7d191d5940 2 removed watcher, disabling cache 2021-02-13T17:52:49.530 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:49.522 7f7d191d5940 20 remove_watcher() i=1 2021-02-13T17:52:49.531 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:49.526 7f7d191d5940 20 remove_watcher() i=2 2021-02-13T17:52:49.532 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:49.526 7f7d191d5940 20 remove_watcher() i=3 2021-02-13T17:52:49.533 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:49.526 7f7d191d5940 20 remove_watcher() i=4 2021-02-13T17:52:49.534 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:49.526 7f7d191d5940 20 remove_watcher() i=5 2021-02-13T17:52:49.536 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:49.530 7f7d191d5940 20 remove_watcher() i=6 2021-02-13T17:52:49.537 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:49.530 7f7d191d5940 20 remove_watcher() i=7 2021-02-13T17:52:49.540 INFO:teuthology.orchestra.run.gibba025.stdout:[] 2021-02-13T17:52:49.540 DEBUG:tasks.util.rgw: json result: [] 2021-02-13T17:52:49.540 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2021-02-13T17:52:49.540 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2021-02-13T17:52:49.541 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zone placement modify --rgw-zone default --placement-id default-placement --compression random 2021-02-13T17:52:49.657 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:49.650 7f27fd7fa700 2 RGWDataChangesLog::ChangesRenewThread: start 2021-02-13T17:52:49.658 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:49.650 7f283560c940 20 rados->read ofs=0 len=0 2021-02-13T17:52:49.658 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:49.650 7f27fcff9700 20 reqs_thread_entry: start 2021-02-13T17:52:49.659 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:49.654 7f283560c940 20 rados_obj.operate() r=0 bl.length=46 2021-02-13T17:52:49.659 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:49.654 7f283560c940 20 rados->read ofs=0 len=0 2021-02-13T17:52:49.659 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:49.654 7f283560c940 20 rados_obj.operate() r=0 bl.length=805 2021-02-13T17:52:49.660 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:49.654 7f283560c940 20 rados->read ofs=0 len=0 2021-02-13T17:52:49.660 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:49.654 7f283560c940 20 rados_obj.operate() r=-2 bl.length=0 2021-02-13T17:52:49.660 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:49.654 7f283560c940 20 rados->read ofs=0 len=0 2021-02-13T17:52:49.660 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:49.654 7f283560c940 20 rados_obj.operate() r=0 bl.length=46 2021-02-13T17:52:49.661 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:49.654 7f283560c940 20 rados->read ofs=0 len=0 2021-02-13T17:52:49.661 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:49.654 7f283560c940 20 rados_obj.operate() r=0 bl.length=348 2021-02-13T17:52:49.666 INFO:teuthology.orchestra.run.gibba025.stdout:{"id":"73172596-8ead-42c2-aa9f-035780586655","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0}}],"metadata_heap":"","realm_id":""} 2021-02-13T17:52:49.667 DEBUG:tasks.util.rgw: json result: {'id': '73172596-8ead-42c2-aa9f-035780586655', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0}}], 'metadata_heap': '', 'realm_id': ''} 2021-02-13T17:52:49.667 INFO:tasks.util.rgw:rgwadmin: c1.client.1 : ['user', 'list'] 2021-02-13T17:52:49.667 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.1', '--cluster', 'c1', 'user', 'list'] 2021-02-13T17:52:49.667 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.1 --cluster c1 user list 2021-02-13T17:52:49.689 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:49.682 7fdf84249940 20 rados->read ofs=0 len=0 2021-02-13T17:52:49.690 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:49.686 7fdf84249940 20 rados_obj.operate() r=-2 bl.length=0 2021-02-13T17:52:49.691 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:49.686 7fdf84249940 20 rados->read ofs=0 len=0 2021-02-13T17:52:49.691 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:49.686 7fdf84249940 20 rados_obj.operate() r=-2 bl.length=0 2021-02-13T17:52:49.691 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:49.686 7fdf84249940 20 rados->read ofs=0 len=0 2021-02-13T17:52:49.692 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:49.686 7fdf84249940 20 rados_obj.operate() r=-2 bl.length=0 2021-02-13T17:52:49.692 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:49.686 7fdf84249940 20 rados->read ofs=0 len=0 2021-02-13T17:52:49.692 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:49.686 7fdf84249940 20 rados_obj.operate() r=0 bl.length=46 2021-02-13T17:52:49.701 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:49.694 7fdf84249940 20 RGWRados::pool_iterate: got zone_info.73172596-8ead-42c2-aa9f-035780586655 2021-02-13T17:52:49.701 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:49.694 7fdf84249940 20 RGWRados::pool_iterate: got zonegroup_info.d50e0ea2-5dd7-4945-944c-692c4e2957ed 2021-02-13T17:52:49.701 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:49.694 7fdf84249940 20 RGWRados::pool_iterate: got zone_names.default 2021-02-13T17:52:49.701 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:49.694 7fdf84249940 20 RGWRados::pool_iterate: got zonegroups_names.default 2021-02-13T17:52:49.701 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:49.694 7fdf84249940 20 rados->read ofs=0 len=0 2021-02-13T17:52:49.701 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:49.694 7fdf84249940 20 rados_obj.operate() r=0 bl.length=46 2021-02-13T17:52:49.702 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:49.694 7fdf84249940 20 rados->read ofs=0 len=0 2021-02-13T17:52:49.703 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:49.694 7fdf84249940 20 rados_obj.operate() r=0 bl.length=821 2021-02-13T17:52:49.703 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:49.694 7fdf84249940 20 rados->read ofs=0 len=0 2021-02-13T17:52:49.703 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:49.694 7fdf84249940 20 rados_obj.operate() r=0 bl.length=46 2021-02-13T17:52:49.703 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:49.694 7fdf84249940 20 rados->read ofs=0 len=0 2021-02-13T17:52:49.703 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:49.694 7fdf84249940 20 rados_obj.operate() r=0 bl.length=348 2021-02-13T17:52:49.703 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:49.694 7fdf84249940 20 rados->read ofs=0 len=0 2021-02-13T17:52:49.703 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:49.694 7fdf84249940 20 rados_obj.operate() r=-2 bl.length=0 2021-02-13T17:52:49.703 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:49.694 7fdf84249940 10 cannot find current period zonegroup using local zonegroup 2021-02-13T17:52:49.703 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:49.694 7fdf84249940 20 rados->read ofs=0 len=0 2021-02-13T17:52:49.703 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:49.698 7fdf84249940 20 rados_obj.operate() r=-2 bl.length=0 2021-02-13T17:52:49.704 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:49.698 7fdf84249940 20 rados->read ofs=0 len=0 2021-02-13T17:52:49.705 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:49.698 7fdf84249940 20 rados_obj.operate() r=0 bl.length=46 2021-02-13T17:52:49.705 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:49.698 7fdf84249940 20 rados->read ofs=0 len=0 2021-02-13T17:52:49.705 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:49.698 7fdf84249940 20 rados_obj.operate() r=0 bl.length=348 2021-02-13T17:52:49.705 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:49.698 7fdf84249940 20 zonegroup default 2021-02-13T17:52:49.705 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:49.698 7fdf84249940 20 rados->read ofs=0 len=0 2021-02-13T17:52:49.705 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:49.698 7fdf84249940 20 rados_obj.operate() r=-2 bl.length=0 2021-02-13T17:52:49.705 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:49.698 7fdf84249940 10 Cannot find current period zone using local zone 2021-02-13T17:52:49.705 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:49.698 7fdf84249940 20 rados->read ofs=0 len=0 2021-02-13T17:52:49.706 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:49.698 7fdf84249940 20 rados_obj.operate() r=-2 bl.length=0 2021-02-13T17:52:49.706 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:49.698 7fdf84249940 20 rados->read ofs=0 len=0 2021-02-13T17:52:49.706 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:49.698 7fdf84249940 20 rados_obj.operate() r=0 bl.length=46 2021-02-13T17:52:49.706 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:49.698 7fdf84249940 20 rados->read ofs=0 len=0 2021-02-13T17:52:49.706 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:49.698 7fdf84249940 20 rados_obj.operate() r=0 bl.length=821 2021-02-13T17:52:49.706 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:49.698 7fdf84249940 20 zone default 2021-02-13T17:52:49.715 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:49.710 7fdf84249940 20 add_watcher() i=0 2021-02-13T17:52:49.715 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:49.710 7fdf84249940 20 add_watcher() i=1 2021-02-13T17:52:49.715 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:49.710 7fdf84249940 20 add_watcher() i=2 2021-02-13T17:52:49.715 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:49.710 7fdf84249940 20 add_watcher() i=3 2021-02-13T17:52:49.716 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:49.710 7fdf84249940 20 add_watcher() i=4 2021-02-13T17:52:49.716 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:49.710 7fdf84249940 20 add_watcher() i=5 2021-02-13T17:52:49.716 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:49.710 7fdf84249940 20 add_watcher() i=6 2021-02-13T17:52:49.716 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:49.710 7fdf84249940 20 add_watcher() i=7 2021-02-13T17:52:49.716 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:49.710 7fdf84249940 2 all 8 watchers are set, enabling cache 2021-02-13T17:52:49.718 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:49.710 7fdf47fff700 2 RGWDataChangesLog::ChangesRenewThread: start 2021-02-13T17:52:49.720 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:49.714 7fdf2efe5700 20 reqs_thread_entry: start 2021-02-13T17:52:49.720 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:49.714 7fdf84249940 20 init_complete bucket index max shards: 0 2021-02-13T17:52:49.720 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:49.714 7fdf2cfe1700 20 reqs_thread_entry: start 2021-02-13T17:52:49.720 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:49.714 7fdf267e4700 20 reqs_thread_entry: start 2021-02-13T17:52:49.733 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:49.726 7fdf84249940 20 remove_watcher() i=0 2021-02-13T17:52:49.733 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:49.726 7fdf84249940 2 removed watcher, disabling cache 2021-02-13T17:52:49.734 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:49.726 7fdf84249940 20 remove_watcher() i=1 2021-02-13T17:52:49.735 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:49.730 7fdf84249940 20 remove_watcher() i=2 2021-02-13T17:52:49.737 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:49.730 7fdf84249940 20 remove_watcher() i=3 2021-02-13T17:52:49.738 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:49.730 7fdf84249940 20 remove_watcher() i=4 2021-02-13T17:52:49.739 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:49.734 7fdf84249940 20 remove_watcher() i=5 2021-02-13T17:52:49.740 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:49.734 7fdf84249940 20 remove_watcher() i=6 2021-02-13T17:52:49.741 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:49.734 7fdf84249940 20 remove_watcher() i=7 2021-02-13T17:52:49.744 INFO:teuthology.orchestra.run.gibba025.stdout:[] 2021-02-13T17:52:49.744 DEBUG:tasks.util.rgw: json result: [] 2021-02-13T17:52:49.744 INFO:tasks.util.rgw:rgwadmin: c1.client.1 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2021-02-13T17:52:49.744 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.1', '--cluster', 'c1', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2021-02-13T17:52:49.745 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.1 --cluster c1 zone placement modify --rgw-zone default --placement-id default-placement --compression random 2021-02-13T17:52:49.858 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:49.850 7fdb21ffb700 2 RGWDataChangesLog::ChangesRenewThread: start 2021-02-13T17:52:49.859 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:49.854 7fdb5e544940 20 rados->read ofs=0 len=0 2021-02-13T17:52:49.859 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:49.854 7fdb217fa700 20 reqs_thread_entry: start 2021-02-13T17:52:49.860 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:49.854 7fdb5e544940 20 rados_obj.operate() r=0 bl.length=46 2021-02-13T17:52:49.860 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:49.854 7fdb5e544940 20 rados->read ofs=0 len=0 2021-02-13T17:52:49.861 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:49.854 7fdb5e544940 20 rados_obj.operate() r=0 bl.length=821 2021-02-13T17:52:49.861 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:49.854 7fdb5e544940 20 rados->read ofs=0 len=0 2021-02-13T17:52:49.861 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:49.854 7fdb5e544940 20 rados_obj.operate() r=-2 bl.length=0 2021-02-13T17:52:49.861 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:49.854 7fdb5e544940 20 rados->read ofs=0 len=0 2021-02-13T17:52:49.862 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:49.854 7fdb5e544940 20 rados_obj.operate() r=0 bl.length=46 2021-02-13T17:52:49.862 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:49.854 7fdb5e544940 20 rados->read ofs=0 len=0 2021-02-13T17:52:49.862 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:49.858 7fdb5e544940 20 rados_obj.operate() r=0 bl.length=348 2021-02-13T17:52:49.867 INFO:teuthology.orchestra.run.gibba025.stdout:{"id":"73172596-8ead-42c2-aa9f-035780586655","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0}}],"metadata_heap":"","realm_id":""} 2021-02-13T17:52:49.867 DEBUG:tasks.util.rgw: json result: {'id': '73172596-8ead-42c2-aa9f-035780586655', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0}}], 'metadata_heap': '', 'realm_id': ''} 2021-02-13T17:52:49.867 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['user', 'list'] 2021-02-13T17:52:49.867 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'user', 'list'] 2021-02-13T17:52:49.867 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 user list 2021-02-13T17:52:49.895 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:49.891 7f83f0f39940 20 rados->read ofs=0 len=0 2021-02-13T17:52:51.833 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:51.827 7f83f0f39940 20 rados_obj.operate() r=-2 bl.length=0 2021-02-13T17:52:51.833 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:51.827 7f83f0f39940 20 rados->read ofs=0 len=0 2021-02-13T17:52:51.836 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:51.831 7f83f0f39940 20 rados_obj.operate() r=-2 bl.length=0 2021-02-13T17:52:51.836 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:51.831 7f83f0f39940 20 rados->read ofs=0 len=0 2021-02-13T17:52:51.837 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:51.831 7f83f0f39940 20 rados_obj.operate() r=-2 bl.length=0 2021-02-13T17:52:51.837 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:51.831 7f83f0f39940 20 rados->read ofs=0 len=0 2021-02-13T17:52:51.837 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:51.831 7f83f0f39940 20 rados_obj.operate() r=-2 bl.length=0 2021-02-13T17:52:51.845 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:51.839 7f83f0f39940 20 rados->read ofs=0 len=0 2021-02-13T17:52:51.845 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:51.839 7f83f0f39940 20 rados_obj.operate() r=-2 bl.length=0 2021-02-13T17:52:51.845 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:51.839 7f83f0f39940 20 rados->read ofs=0 len=0 2021-02-13T17:52:51.845 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:51.839 7f83f0f39940 20 rados_obj.operate() r=-2 bl.length=0 2021-02-13T17:52:51.845 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:51.839 7f83f0f39940 20 rados->read ofs=0 len=0 2021-02-13T17:52:51.847 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:51.839 7f83f0f39940 20 rados_obj.operate() r=-2 bl.length=0 2021-02-13T17:52:51.847 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:51.839 7f83f0f39940 10 cannot find current period zonegroup using local zonegroup 2021-02-13T17:52:51.847 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:51.839 7f83f0f39940 20 rados->read ofs=0 len=0 2021-02-13T17:52:51.847 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:51.839 7f83f0f39940 20 rados_obj.operate() r=-2 bl.length=0 2021-02-13T17:52:51.847 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:51.839 7f83f0f39940 20 rados->read ofs=0 len=0 2021-02-13T17:52:51.847 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:51.839 7f83f0f39940 20 rados_obj.operate() r=-2 bl.length=0 2021-02-13T17:52:51.847 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:51.839 7f83f0f39940 10 Creating default zonegroup 2021-02-13T17:52:51.847 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:51.839 7f83f0f39940 20 get_system_obj_state: rctx=0x7ffe4fe81a00 obj=:.pools.avail state=0x55e8bffeae70 s->prefetch_data=0 2021-02-13T17:52:51.847 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:51.843 7f83f0f39940 10 couldn't find old data placement pools config, setting up new ones for the zone 2021-02-13T17:52:51.854 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:51.851 7f83f0f39940 10 WARNING: store->list_zones() returned r=-2 2021-02-13T17:52:51.855 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:51.851 7f83f0f39940 20 rados->read ofs=0 len=0 2021-02-13T17:52:51.855 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:51.851 7f83f0f39940 20 rados_obj.operate() r=-2 bl.length=0 2021-02-13T17:52:51.857 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:51.851 7f83f0f39940 20 rados->read ofs=0 len=0 2021-02-13T17:52:51.858 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:51.851 7f83f0f39940 20 rados_obj.operate() r=-2 bl.length=0 2021-02-13T17:52:51.858 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:51.851 7f83f0f39940 10 could not read realm id: (2) No such file or directory 2021-02-13T17:52:51.858 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:51.851 7f83f0f39940 10 WARNING: failed to set zone as default, r=-22 2021-02-13T17:52:51.858 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:51.851 7f83f0f39940 20 rados->read ofs=0 len=0 2021-02-13T17:52:51.858 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:51.851 7f83f0f39940 20 rados_obj.operate() r=-2 bl.length=0 2021-02-13T17:52:51.861 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:51.855 7f83f0f39940 20 rados->read ofs=0 len=0 2021-02-13T17:52:51.861 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:51.855 7f83f0f39940 20 rados_obj.operate() r=0 bl.length=805 2021-02-13T17:52:51.861 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:51.855 7f83f0f39940 20 rados->read ofs=0 len=0 2021-02-13T17:52:51.862 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:51.855 7f83f0f39940 20 rados_obj.operate() r=0 bl.length=348 2021-02-13T17:52:51.862 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:51.855 7f83f0f39940 20 zonegroup default 2021-02-13T17:52:51.862 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:51.855 7f83f0f39940 20 rados->read ofs=0 len=0 2021-02-13T17:52:51.862 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:51.855 7f83f0f39940 20 rados_obj.operate() r=-2 bl.length=0 2021-02-13T17:52:51.862 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:51.855 7f83f0f39940 10 Cannot find current period zone using local zone 2021-02-13T17:52:51.862 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:51.855 7f83f0f39940 10 Using default name default 2021-02-13T17:52:51.862 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:51.855 7f83f0f39940 20 rados->read ofs=0 len=0 2021-02-13T17:52:51.863 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:51.859 7f83f0f39940 20 rados_obj.operate() r=0 bl.length=46 2021-02-13T17:52:51.863 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:51.859 7f83f0f39940 20 rados->read ofs=0 len=0 2021-02-13T17:52:51.863 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:51.859 7f83f0f39940 20 rados_obj.operate() r=0 bl.length=805 2021-02-13T17:52:51.863 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:51.859 7f83f0f39940 20 zone default 2021-02-13T17:52:53.861 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:53.855 7f83f0f39940 20 add_watcher() i=0 2021-02-13T17:52:53.861 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:53.855 7f83f0f39940 20 add_watcher() i=1 2021-02-13T17:52:53.861 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:53.855 7f83f0f39940 20 add_watcher() i=2 2021-02-13T17:52:53.861 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:53.855 7f83f0f39940 20 add_watcher() i=3 2021-02-13T17:52:53.861 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:53.855 7f83f0f39940 20 add_watcher() i=4 2021-02-13T17:52:53.861 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:53.855 7f83f0f39940 20 add_watcher() i=5 2021-02-13T17:52:53.861 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:53.855 7f83f0f39940 20 add_watcher() i=6 2021-02-13T17:52:53.862 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:53.855 7f83f0f39940 20 add_watcher() i=7 2021-02-13T17:52:53.862 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:53.855 7f83f0f39940 2 all 8 watchers are set, enabling cache 2021-02-13T17:52:53.864 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:53.859 7f83b97fa700 2 RGWDataChangesLog::ChangesRenewThread: start 2021-02-13T17:52:55.862 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:55.855 7f83f0f39940 10 rgw_init_ioctx warning: failed to set pg_autoscale_bias on default.rgw.meta 2021-02-13T17:52:55.863 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:55.859 7f83f0f39940 10 rgw_init_ioctx warning: failed to set pg_num_min on default.rgw.meta 2021-02-13T17:52:57.884 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:57.879 7f83f0f39940 10 rgw_init_ioctx warning: failed to set pg_autoscale_bias on default.rgw.log 2021-02-13T17:52:57.884 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:57.879 7f83f0f39940 10 rgw_init_ioctx warning: failed to set pg_num_min on default.rgw.log 2021-02-13T17:52:57.889 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:57.883 7f838ffdf700 20 reqs_thread_entry: start 2021-02-13T17:52:57.890 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:57.883 7f838dfdb700 20 reqs_thread_entry: start 2021-02-13T17:52:57.890 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:57.883 7f83f0f39940 20 init_complete bucket index max shards: 0 2021-02-13T17:52:57.890 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:57.883 7f82fffff700 20 reqs_thread_entry: start 2021-02-13T17:52:57.901 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:57.895 7f83f0f39940 20 remove_watcher() i=0 2021-02-13T17:52:57.901 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:57.895 7f83f0f39940 2 removed watcher, disabling cache 2021-02-13T17:52:57.902 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:57.899 7f83f0f39940 20 remove_watcher() i=1 2021-02-13T17:52:57.904 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:57.899 7f83f0f39940 20 remove_watcher() i=2 2021-02-13T17:52:57.905 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:57.899 7f83f0f39940 20 remove_watcher() i=3 2021-02-13T17:52:57.906 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:57.903 7f83f0f39940 20 remove_watcher() i=4 2021-02-13T17:52:57.907 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:57.903 7f83f0f39940 20 remove_watcher() i=5 2021-02-13T17:52:57.909 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:57.903 7f83f0f39940 20 remove_watcher() i=6 2021-02-13T17:52:57.910 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:57.903 7f83f0f39940 20 remove_watcher() i=7 2021-02-13T17:52:57.913 INFO:teuthology.orchestra.run.gibba036.stdout:[] 2021-02-13T17:52:57.913 DEBUG:tasks.util.rgw: json result: [] 2021-02-13T17:52:57.913 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2021-02-13T17:52:57.913 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2021-02-13T17:52:57.913 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone placement modify --rgw-zone default --placement-id default-placement --compression random 2021-02-13T17:52:58.023 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:58.019 7fd6d2ffd700 2 RGWDataChangesLog::ChangesRenewThread: start 2021-02-13T17:52:58.024 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:58.019 7fd6d27fc700 20 reqs_thread_entry: start 2021-02-13T17:52:58.024 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:58.019 7fd70f668940 20 rados->read ofs=0 len=0 2021-02-13T17:52:58.025 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:58.019 7fd70f668940 20 rados_obj.operate() r=0 bl.length=46 2021-02-13T17:52:58.025 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:58.019 7fd70f668940 20 rados->read ofs=0 len=0 2021-02-13T17:52:58.026 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:58.019 7fd70f668940 20 rados_obj.operate() r=0 bl.length=805 2021-02-13T17:52:58.026 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:58.019 7fd70f668940 20 rados->read ofs=0 len=0 2021-02-13T17:52:58.026 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:58.019 7fd70f668940 20 rados_obj.operate() r=-2 bl.length=0 2021-02-13T17:52:58.026 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:58.019 7fd70f668940 20 rados->read ofs=0 len=0 2021-02-13T17:52:58.027 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:58.019 7fd70f668940 20 rados_obj.operate() r=0 bl.length=46 2021-02-13T17:52:58.027 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:58.019 7fd70f668940 20 rados->read ofs=0 len=0 2021-02-13T17:52:58.027 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:58.023 7fd70f668940 20 rados_obj.operate() r=0 bl.length=348 2021-02-13T17:52:58.031 INFO:teuthology.orchestra.run.gibba036.stdout:{"id":"78347678-7542-4906-b42e-fb107c20f23d","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0}}],"metadata_heap":"","realm_id":""} 2021-02-13T17:52:58.031 DEBUG:tasks.util.rgw: json result: {'id': '78347678-7542-4906-b42e-fb107c20f23d', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0}}], 'metadata_heap': '', 'realm_id': ''} 2021-02-13T17:52:58.031 INFO:tasks.util.rgw:rgwadmin: c2.client.1 : ['user', 'list'] 2021-02-13T17:52:58.032 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.1', '--cluster', 'c2', 'user', 'list'] 2021-02-13T17:52:58.032 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.1 --cluster c2 user list 2021-02-13T17:52:58.056 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:58.051 7f299e46b940 20 rados->read ofs=0 len=0 2021-02-13T17:52:58.058 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:58.051 7f299e46b940 20 rados_obj.operate() r=-2 bl.length=0 2021-02-13T17:52:58.058 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:58.051 7f299e46b940 20 rados->read ofs=0 len=0 2021-02-13T17:52:58.058 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:58.055 7f299e46b940 20 rados_obj.operate() r=-2 bl.length=0 2021-02-13T17:52:58.058 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:58.055 7f299e46b940 20 rados->read ofs=0 len=0 2021-02-13T17:52:58.059 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:58.055 7f299e46b940 20 rados_obj.operate() r=-2 bl.length=0 2021-02-13T17:52:58.059 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:58.055 7f299e46b940 20 rados->read ofs=0 len=0 2021-02-13T17:52:58.059 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:58.055 7f299e46b940 20 rados_obj.operate() r=0 bl.length=46 2021-02-13T17:52:58.071 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:58.067 7f299e46b940 20 RGWRados::pool_iterate: got zonegroup_info.9b411961-3387-4c8b-8d0d-91ab4c209d29 2021-02-13T17:52:58.071 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:58.067 7f299e46b940 20 RGWRados::pool_iterate: got zone_info.78347678-7542-4906-b42e-fb107c20f23d 2021-02-13T17:52:58.071 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:58.067 7f299e46b940 20 RGWRados::pool_iterate: got zone_names.default 2021-02-13T17:52:58.071 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:58.067 7f299e46b940 20 RGWRados::pool_iterate: got zonegroups_names.default 2021-02-13T17:52:58.071 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:58.067 7f299e46b940 20 rados->read ofs=0 len=0 2021-02-13T17:52:58.071 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:58.067 7f299e46b940 20 rados_obj.operate() r=0 bl.length=46 2021-02-13T17:52:58.071 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:58.067 7f299e46b940 20 rados->read ofs=0 len=0 2021-02-13T17:52:58.072 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:58.067 7f299e46b940 20 rados_obj.operate() r=0 bl.length=821 2021-02-13T17:52:58.072 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:58.067 7f299e46b940 20 rados->read ofs=0 len=0 2021-02-13T17:52:58.072 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:58.067 7f299e46b940 20 rados_obj.operate() r=0 bl.length=46 2021-02-13T17:52:58.072 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:58.067 7f299e46b940 20 rados->read ofs=0 len=0 2021-02-13T17:52:58.072 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:58.067 7f299e46b940 20 rados_obj.operate() r=0 bl.length=348 2021-02-13T17:52:58.073 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:58.067 7f299e46b940 20 rados->read ofs=0 len=0 2021-02-13T17:52:58.073 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:58.067 7f299e46b940 20 rados_obj.operate() r=-2 bl.length=0 2021-02-13T17:52:58.073 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:58.067 7f299e46b940 10 cannot find current period zonegroup using local zonegroup 2021-02-13T17:52:58.073 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:58.067 7f299e46b940 20 rados->read ofs=0 len=0 2021-02-13T17:52:58.073 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:58.067 7f299e46b940 20 rados_obj.operate() r=-2 bl.length=0 2021-02-13T17:52:58.073 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:58.067 7f299e46b940 20 rados->read ofs=0 len=0 2021-02-13T17:52:58.074 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:58.067 7f299e46b940 20 rados_obj.operate() r=0 bl.length=46 2021-02-13T17:52:58.074 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:58.067 7f299e46b940 20 rados->read ofs=0 len=0 2021-02-13T17:52:58.074 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:58.067 7f299e46b940 20 rados_obj.operate() r=0 bl.length=348 2021-02-13T17:52:58.074 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:58.067 7f299e46b940 20 zonegroup default 2021-02-13T17:52:58.074 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:58.067 7f299e46b940 20 rados->read ofs=0 len=0 2021-02-13T17:52:58.075 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:58.067 7f299e46b940 20 rados_obj.operate() r=-2 bl.length=0 2021-02-13T17:52:58.075 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:58.067 7f299e46b940 10 Cannot find current period zone using local zone 2021-02-13T17:52:58.075 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:58.067 7f299e46b940 20 rados->read ofs=0 len=0 2021-02-13T17:52:58.075 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:58.071 7f299e46b940 20 rados_obj.operate() r=-2 bl.length=0 2021-02-13T17:52:58.075 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:58.071 7f299e46b940 20 rados->read ofs=0 len=0 2021-02-13T17:52:58.075 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:58.071 7f299e46b940 20 rados_obj.operate() r=0 bl.length=46 2021-02-13T17:52:58.075 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:58.071 7f299e46b940 20 rados->read ofs=0 len=0 2021-02-13T17:52:58.076 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:58.071 7f299e46b940 20 rados_obj.operate() r=0 bl.length=821 2021-02-13T17:52:58.076 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:58.071 7f299e46b940 20 zone default 2021-02-13T17:52:58.086 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:58.079 7f299e46b940 20 add_watcher() i=0 2021-02-13T17:52:58.086 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:58.079 7f299e46b940 20 add_watcher() i=1 2021-02-13T17:52:58.086 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:58.079 7f299e46b940 20 add_watcher() i=2 2021-02-13T17:52:58.086 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:58.079 7f299e46b940 20 add_watcher() i=3 2021-02-13T17:52:58.086 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:58.079 7f299e46b940 20 add_watcher() i=4 2021-02-13T17:52:58.086 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:58.079 7f299e46b940 20 add_watcher() i=5 2021-02-13T17:52:58.086 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:58.079 7f299e46b940 20 add_watcher() i=6 2021-02-13T17:52:58.087 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:58.083 7f299e46b940 20 add_watcher() i=7 2021-02-13T17:52:58.087 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:58.083 7f299e46b940 2 all 8 watchers are set, enabling cache 2021-02-13T17:52:58.089 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:58.083 7f2961ffb700 2 RGWDataChangesLog::ChangesRenewThread: start 2021-02-13T17:52:58.091 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:58.087 7f2948fe1700 20 reqs_thread_entry: start 2021-02-13T17:52:58.091 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:58.087 7f299e46b940 20 init_complete bucket index max shards: 0 2021-02-13T17:52:58.091 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:58.087 7f29427fc700 20 reqs_thread_entry: start 2021-02-13T17:52:58.091 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:58.087 7f28b3fff700 20 reqs_thread_entry: start 2021-02-13T17:52:58.104 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:58.099 7f299e46b940 20 remove_watcher() i=0 2021-02-13T17:52:58.104 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:58.099 7f299e46b940 2 removed watcher, disabling cache 2021-02-13T17:52:58.106 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:58.099 7f299e46b940 20 remove_watcher() i=1 2021-02-13T17:52:58.107 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:58.103 7f299e46b940 20 remove_watcher() i=2 2021-02-13T17:52:58.108 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:58.103 7f299e46b940 20 remove_watcher() i=3 2021-02-13T17:52:58.109 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:58.103 7f299e46b940 20 remove_watcher() i=4 2021-02-13T17:52:58.111 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:58.107 7f299e46b940 20 remove_watcher() i=5 2021-02-13T17:52:58.112 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:58.107 7f299e46b940 20 remove_watcher() i=6 2021-02-13T17:52:58.113 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:58.107 7f299e46b940 20 remove_watcher() i=7 2021-02-13T17:52:58.116 INFO:teuthology.orchestra.run.gibba036.stdout:[] 2021-02-13T17:52:58.116 DEBUG:tasks.util.rgw: json result: [] 2021-02-13T17:52:58.117 INFO:tasks.util.rgw:rgwadmin: c2.client.1 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2021-02-13T17:52:58.117 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.1', '--cluster', 'c2', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2021-02-13T17:52:58.117 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.1 --cluster c2 zone placement modify --rgw-zone default --placement-id default-placement --compression random 2021-02-13T17:52:58.214 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:58.207 7f49867fc700 2 RGWDataChangesLog::ChangesRenewThread: start 2021-02-13T17:52:58.214 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:58.211 7f49c2cc5940 20 rados->read ofs=0 len=0 2021-02-13T17:52:58.214 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:58.211 7f4985ffb700 20 reqs_thread_entry: start 2021-02-13T17:52:58.215 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:58.211 7f49c2cc5940 20 rados_obj.operate() r=0 bl.length=46 2021-02-13T17:52:58.216 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:58.211 7f49c2cc5940 20 rados->read ofs=0 len=0 2021-02-13T17:52:58.216 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:58.211 7f49c2cc5940 20 rados_obj.operate() r=0 bl.length=821 2021-02-13T17:52:58.216 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:58.211 7f49c2cc5940 20 rados->read ofs=0 len=0 2021-02-13T17:52:58.217 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:58.211 7f49c2cc5940 20 rados_obj.operate() r=-2 bl.length=0 2021-02-13T17:52:58.217 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:58.211 7f49c2cc5940 20 rados->read ofs=0 len=0 2021-02-13T17:52:58.217 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:58.211 7f49c2cc5940 20 rados_obj.operate() r=0 bl.length=46 2021-02-13T17:52:58.217 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:58.211 7f49c2cc5940 20 rados->read ofs=0 len=0 2021-02-13T17:52:58.218 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:52:58.211 7f49c2cc5940 20 rados_obj.operate() r=0 bl.length=348 2021-02-13T17:52:58.223 INFO:teuthology.orchestra.run.gibba036.stdout:{"id":"78347678-7542-4906-b42e-fb107c20f23d","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0}}],"metadata_heap":"","realm_id":""} 2021-02-13T17:52:58.223 DEBUG:tasks.util.rgw: json result: {'id': '78347678-7542-4906-b42e-fb107c20f23d', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0}}], 'metadata_heap': '', 'realm_id': ''} 2021-02-13T17:52:58.223 INFO:tasks.rgw:Starting rgw... 2021-02-13T17:52:58.223 INFO:tasks.rgw:rgw c1.client.0 config is {'port': 8000} 2021-02-13T17:52:58.223 INFO:tasks.rgw:Using civetweb as radosgw frontend 2021-02-13T17:52:58.224 INFO:tasks.rgw.c1.client.0:Restarting daemon 2021-02-13T17:52:58.224 DEBUG:teuthology.orchestra.run.gibba025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'civetweb port=8000' -n client.0 --cluster c1 -k /etc/ceph/c1.client.0.keyring --log-file /var/log/ceph/rgw.c1.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c1.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.c1.client.0.stdout 2>&1 2021-02-13T17:52:58.227 INFO:tasks.rgw.c1.client.0:Started 2021-02-13T17:52:58.227 INFO:tasks.rgw:rgw c1.client.1 config is {'port': 8001} 2021-02-13T17:52:58.227 INFO:tasks.rgw:Using civetweb as radosgw frontend 2021-02-13T17:52:58.227 INFO:tasks.rgw.c1.client.1:Restarting daemon 2021-02-13T17:52:58.227 DEBUG:teuthology.orchestra.run.gibba025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'civetweb port=8001' -n client.1 --cluster c1 -k /etc/ceph/c1.client.1.keyring --log-file /var/log/ceph/rgw.c1.client.1.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c1.client.1.sock --foreground | sudo tee /var/log/ceph/rgw.c1.client.1.stdout 2>&1 2021-02-13T17:52:58.230 INFO:tasks.rgw.c1.client.1:Started 2021-02-13T17:52:58.230 INFO:tasks.rgw:rgw c2.client.0 config is {'port': 8000} 2021-02-13T17:52:58.230 INFO:tasks.rgw:Using civetweb as radosgw frontend 2021-02-13T17:52:58.230 INFO:tasks.rgw.c2.client.0:Restarting daemon 2021-02-13T17:52:58.230 DEBUG:teuthology.orchestra.run.gibba036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'civetweb port=8000' -n client.0 --cluster c2 -k /etc/ceph/c2.client.0.keyring --log-file /var/log/ceph/rgw.c2.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.c2.client.0.stdout 2>&1 2021-02-13T17:52:58.232 INFO:tasks.rgw.c2.client.0:Started 2021-02-13T17:52:58.232 INFO:tasks.rgw:rgw c2.client.1 config is {'port': 8001} 2021-02-13T17:52:58.232 INFO:tasks.rgw:Using civetweb as radosgw frontend 2021-02-13T17:52:58.232 INFO:tasks.rgw.c2.client.1:Restarting daemon 2021-02-13T17:52:58.232 DEBUG:teuthology.orchestra.run.gibba036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'civetweb port=8001' -n client.1 --cluster c2 -k /etc/ceph/c2.client.1.keyring --log-file /var/log/ceph/rgw.c2.client.1.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.1.sock --foreground | sudo tee /var/log/ceph/rgw.c2.client.1.stdout 2>&1 2021-02-13T17:52:58.234 INFO:tasks.rgw.c2.client.1:Started 2021-02-13T17:52:58.234 INFO:tasks.rgw:Polling c1.client.0 until it starts accepting connections on http://gibba025.front.sepia.ceph.com:8000/ 2021-02-13T17:52:58.234 DEBUG:teuthology.orchestra.run.gibba025:> curl http://gibba025.front.sepia.ceph.com:8000/ 2021-02-13T17:52:58.248 INFO:teuthology.orchestra.run.gibba025.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2021-02-13T17:52:58.248 INFO:teuthology.orchestra.run.gibba025.stderr: Dload Upload Total Spent Left Speed 2021-02-13T17:52:58.253 INFO:teuthology.orchestra.run.gibba025.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0curl: (7) Failed to connect to gibba025.front.sepia.ceph.com port 8000: Connection refused 2021-02-13T17:52:58.253 DEBUG:teuthology.orchestra.run:got remote process result: 7 2021-02-13T17:52:59.254 DEBUG:teuthology.orchestra.run.gibba025:> curl http://gibba025.front.sepia.ceph.com:8000/ 2021-02-13T17:52:59.265 INFO:teuthology.orchestra.run.gibba025.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2021-02-13T17:52:59.266 INFO:teuthology.orchestra.run.gibba025.stderr: Dload Upload Total Spent Left Speed 2021-02-13T17:52:59.271 INFO:teuthology.orchestra.run.gibba025.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 214 0 214 0 0 42800 0 --:--:-- --:--:-- --:--:-- 42800 2021-02-13T17:52:59.271 INFO:teuthology.orchestra.run.gibba025.stdout:anonymous 2021-02-13T17:52:59.272 INFO:tasks.rgw:Polling c1.client.1 until it starts accepting connections on http://gibba025.front.sepia.ceph.com:8001/ 2021-02-13T17:52:59.272 DEBUG:teuthology.orchestra.run.gibba025:> curl http://gibba025.front.sepia.ceph.com:8001/ 2021-02-13T17:52:59.324 INFO:teuthology.orchestra.run.gibba025.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2021-02-13T17:52:59.324 INFO:teuthology.orchestra.run.gibba025.stderr: Dload Upload Total Spent Left Speed 2021-02-13T17:52:59.329 INFO:teuthology.orchestra.run.gibba025.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 214 0 214 0 0 42800 0 --:--:-- --:--:-- --:--:-- 42800 2021-02-13T17:52:59.330 INFO:teuthology.orchestra.run.gibba025.stdout:anonymous 2021-02-13T17:52:59.330 INFO:tasks.rgw:Polling c2.client.0 until it starts accepting connections on http://gibba036.front.sepia.ceph.com:8000/ 2021-02-13T17:52:59.330 DEBUG:teuthology.orchestra.run.gibba036:> curl http://gibba036.front.sepia.ceph.com:8000/ 2021-02-13T17:52:59.354 INFO:teuthology.orchestra.run.gibba036.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2021-02-13T17:52:59.355 INFO:teuthology.orchestra.run.gibba036.stderr: Dload Upload Total Spent Left Speed 2021-02-13T17:52:59.360 INFO:teuthology.orchestra.run.gibba036.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 214 0 214 0 0 19454 0 --:--:-- --:--:-- --:--:-- 42800 2021-02-13T17:52:59.360 INFO:teuthology.orchestra.run.gibba036.stdout:anonymous 2021-02-13T17:52:59.361 INFO:tasks.rgw:Polling c2.client.1 until it starts accepting connections on http://gibba036.front.sepia.ceph.com:8001/ 2021-02-13T17:52:59.361 DEBUG:teuthology.orchestra.run.gibba036:> curl http://gibba036.front.sepia.ceph.com:8001/ 2021-02-13T17:52:59.411 INFO:teuthology.orchestra.run.gibba036.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2021-02-13T17:52:59.412 INFO:teuthology.orchestra.run.gibba036.stderr: Dload Upload Total Spent Left Speed 2021-02-13T17:52:59.418 INFO:teuthology.orchestra.run.gibba036.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 214 0 214 0 0 42800 0 --:--:-- --:--:-- --:--:-- 42800 2021-02-13T17:52:59.418 INFO:teuthology.orchestra.run.gibba036.stdout:anonymous 2021-02-13T17:52:59.418 INFO:teuthology.run_tasks:Running task rgw-multisite... 2021-02-13T17:52:59.772 INFO:tasks.rgw_multisite:creating realm.. 2021-02-13T17:52:59.772 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['realm', 'create', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T17:52:59.772 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'realm', 'create', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T17:52:59.772 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 realm create --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 2021-02-13T17:52:59.819 INFO:teuthology.orchestra.run.gibba025.stdout:{"id":"c0c9dba8-b0a7-4e01-b0aa-e4c8b23f42b5","name":"test-realm","current_period":"99e22614-2503-4cef-b9b0-3ddbb8dc47c9","epoch":1} 2021-02-13T17:52:59.819 INFO:tasks.rgw_multisite:creating master zonegroup.. 2021-02-13T17:52:59.819 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zonegroup', 'set', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--default', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T17:52:59.819 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zonegroup', 'set', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--default', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T17:52:59.820 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zonegroup set --rgw-zonegroup test-zonegroup --rgw-realm test-realm --default --cluster c1 --debug-rgw 0 --debug-ms 0 2021-02-13T17:52:59.911 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:52:59.906 7ff81aed0940 -1 old format 2021-02-13T17:52:59.919 INFO:teuthology.orchestra.run.gibba025.stdout:{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":"true","endpoints":["http://gibba025.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"","zones":[],"placement_targets":[],"default_placement":"","realm_id":"c0c9dba8-b0a7-4e01-b0aa-e4c8b23f42b5"} 2021-02-13T17:52:59.919 INFO:tasks.rgw_multisite:creating master zone.. 2021-02-13T17:52:59.919 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zone', 'create', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--default', '--master', '--access-key', 'UVQW931EG3AB4CYL', '--secret', 'iSUph5ZNlZA0jRgR14y90OM0mpNVa9gv', '--endpoints', 'http://gibba025.front.sepia.ceph.com:8000', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T17:52:59.920 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zone', 'create', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--default', '--master', '--access-key', 'UVQW931EG3AB4CYL', '--secret', 'iSUph5ZNlZA0jRgR14y90OM0mpNVa9gv', '--endpoints', 'http://gibba025.front.sepia.ceph.com:8000', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T17:52:59.920 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zone create --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --default --master --access-key UVQW931EG3AB4CYL --secret iSUph5ZNlZA0jRgR14y90OM0mpNVa9gv --endpoints http://gibba025.front.sepia.ceph.com:8000 --cluster c1 --debug-rgw 0 --debug-ms 0 2021-02-13T17:53:00.028 INFO:teuthology.orchestra.run.gibba025.stdout:{"id":"671230a8-4b04-4e98-83d8-0a04dcd55dc0","name":"test-zone1","domain_root":"test-zone1.rgw.meta:root","control_pool":"test-zone1.rgw.control","gc_pool":"test-zone1.rgw.log:gc","lc_pool":"test-zone1.rgw.log:lc","log_pool":"test-zone1.rgw.log","intent_log_pool":"test-zone1.rgw.log:intent","usage_log_pool":"test-zone1.rgw.log:usage","reshard_pool":"test-zone1.rgw.log:reshard","user_keys_pool":"test-zone1.rgw.meta:users.keys","user_email_pool":"test-zone1.rgw.meta:users.email","user_swift_pool":"test-zone1.rgw.meta:users.swift","user_uid_pool":"test-zone1.rgw.meta:users.uid","otp_pool":"test-zone1.rgw.otp","system_key":{"access_key":"UVQW931EG3AB4CYL","secret_key":"iSUph5ZNlZA0jRgR14y90OM0mpNVa9gv"},"placement_pools":[{"key":"default-placement","val":{"index_pool":"test-zone1.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"test-zone1.rgw.buckets.data"}},"data_extra_pool":"test-zone1.rgw.buckets.non-ec","index_type":0}}],"metadata_heap":"","realm_id":"c0c9dba8-b0a7-4e01-b0aa-e4c8b23f42b5"} 2021-02-13T17:53:00.029 DEBUG:teuthology.orchestra.run.gibba025:> sudo ceph osd pool create test-zone1.rgw.buckets.data 64 64 --cluster c1 2021-02-13T17:53:00.247 INFO:teuthology.orchestra.run.gibba025.stderr:pool 'test-zone1.rgw.buckets.data' created 2021-02-13T17:53:00.254 DEBUG:teuthology.orchestra.run.gibba025:> sudo ceph osd pool application enable test-zone1.rgw.buckets.data rgw --cluster c1 2021-02-13T17:53:01.276 INFO:teuthology.orchestra.run.gibba025.stderr:enabled application 'rgw' on pool 'test-zone1.rgw.buckets.data' 2021-02-13T17:53:01.285 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zone', 'placement', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', 'modify', '--placement-id', 'default-placement', '--compression', 'random', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T17:53:01.285 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zone', 'placement', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', 'modify', '--placement-id', 'default-placement', '--compression', 'random', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T17:53:01.286 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zone placement --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm modify --placement-id default-placement --compression random --cluster c1 --debug-rgw 0 --debug-ms 0 2021-02-13T17:53:01.327 INFO:teuthology.orchestra.run.gibba025.stdout:{"id":"671230a8-4b04-4e98-83d8-0a04dcd55dc0","name":"test-zone1","domain_root":"test-zone1.rgw.meta:root","control_pool":"test-zone1.rgw.control","gc_pool":"test-zone1.rgw.log:gc","lc_pool":"test-zone1.rgw.log:lc","log_pool":"test-zone1.rgw.log","intent_log_pool":"test-zone1.rgw.log:intent","usage_log_pool":"test-zone1.rgw.log:usage","reshard_pool":"test-zone1.rgw.log:reshard","user_keys_pool":"test-zone1.rgw.meta:users.keys","user_email_pool":"test-zone1.rgw.meta:users.email","user_swift_pool":"test-zone1.rgw.meta:users.swift","user_uid_pool":"test-zone1.rgw.meta:users.uid","otp_pool":"test-zone1.rgw.otp","system_key":{"access_key":"UVQW931EG3AB4CYL","secret_key":"iSUph5ZNlZA0jRgR14y90OM0mpNVa9gv"},"placement_pools":[{"key":"default-placement","val":{"index_pool":"test-zone1.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"test-zone1.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"test-zone1.rgw.buckets.non-ec","index_type":0}}],"metadata_heap":"","realm_id":""} 2021-02-13T17:53:01.328 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['period', 'update', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T17:53:01.328 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'period', 'update', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T17:53:01.328 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 period update --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c1 --debug-rgw 0 --debug-ms 0 2021-02-13T17:53:07.343 INFO:teuthology.orchestra.run.gibba025.stdout:{"id":"138dc4ba-dc02-4957-87c3-e8bf2d80917c","epoch":1,"predecessor_uuid":"99e22614-2503-4cef-b9b0-3ddbb8dc47c9","sync_status":[],"period_map":{"id":"138dc4ba-dc02-4957-87c3-e8bf2d80917c","zonegroups":[{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":"true","endpoints":["http://gibba025.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"671230a8-4b04-4e98-83d8-0a04dcd55dc0","zones":[{"id":"671230a8-4b04-4e98-83d8-0a04dcd55dc0","name":"test-zone1","endpoints":["http://gibba025.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"false","bucket_index_max_shards":0,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"c0c9dba8-b0a7-4e01-b0aa-e4c8b23f42b5"}],"short_zone_ids":[{"key":"671230a8-4b04-4e98-83d8-0a04dcd55dc0","val":450442592}]},"master_zonegroup":"test-zonegroup","master_zone":"671230a8-4b04-4e98-83d8-0a04dcd55dc0","period_config":{"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}},"realm_id":"c0c9dba8-b0a7-4e01-b0aa-e4c8b23f42b5","realm_name":"test-realm","realm_epoch":2} 2021-02-13T17:53:07.343 DEBUG:tasks.rgw.c1.client.0:waiting for process to exit 2021-02-13T17:53:07.344 INFO:teuthology.orchestra.run:waiting for 300 2021-02-13T17:53:07.344 INFO:tasks.rgw.c1.client.0.gibba025.stdout:2021-02-13 17:53:07.338 7f8a4655f700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term radosgw --rgw-frontends civetweb port=8000 -n client.0 --cluster c1 -k /etc/ceph/c1.client.0.keyring --log-file /var/log/ceph/rgw.c1.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c1.client.0.sock --foreground (PID: 15659) UID: 0 2021-02-13T17:53:07.344 INFO:tasks.rgw.c1.client.0.gibba025.stdout:2021-02-13 17:53:07.338 7f8a5cea6980 -1 shutting down 2021-02-13T17:53:13.445 INFO:tasks.rgw.c1.client.0:Stopped 2021-02-13T17:53:13.446 INFO:tasks.rgw.c1.client.0:Restarting daemon 2021-02-13T17:53:13.446 DEBUG:teuthology.orchestra.run.gibba025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'civetweb port=8000' -n client.0 --cluster c1 -k /etc/ceph/c1.client.0.keyring --log-file /var/log/ceph/rgw.c1.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c1.client.0.sock --foreground --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm | sudo tee /var/log/ceph/rgw.c1.client.0.stdout 2>&1 2021-02-13T17:53:13.449 INFO:tasks.rgw.c1.client.0:Started 2021-02-13T17:53:13.449 DEBUG:teuthology.orchestra.run.gibba025:> curl http://gibba025.front.sepia.ceph.com:8000 2021-02-13T17:53:13.460 INFO:teuthology.orchestra.run.gibba025.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2021-02-13T17:53:13.461 INFO:teuthology.orchestra.run.gibba025.stderr: Dload Upload Total Spent Left Speed 2021-02-13T17:53:13.465 INFO:teuthology.orchestra.run.gibba025.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0curl: (7) Failed to connect to gibba025.front.sepia.ceph.com port 8000: Connection refused 2021-02-13T17:53:13.465 DEBUG:teuthology.orchestra.run:got remote process result: 7 2021-02-13T17:53:14.466 DEBUG:teuthology.orchestra.run.gibba025:> curl http://gibba025.front.sepia.ceph.com:8000 2021-02-13T17:53:14.478 INFO:teuthology.orchestra.run.gibba025.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2021-02-13T17:53:14.478 INFO:teuthology.orchestra.run.gibba025.stderr: Dload Upload Total Spent Left Speed 2021-02-13T17:53:14.484 INFO:teuthology.orchestra.run.gibba025.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 214 0 214 0 0 42800 0 --:--:-- --:--:-- --:--:-- 42800 2021-02-13T17:53:14.484 INFO:teuthology.orchestra.run.gibba025.stdout:anonymous 2021-02-13T17:53:14.484 INFO:tasks.rgw_multisite:creating admin user.. 2021-02-13T17:53:14.485 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['user', 'create', '--uid', 'realm-admin', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--display-name', 'Realm Admin', '--system', '--access-key', 'UVQW931EG3AB4CYL', '--secret', 'iSUph5ZNlZA0jRgR14y90OM0mpNVa9gv', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T17:53:14.485 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'user', 'create', '--uid', 'realm-admin', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--display-name', 'Realm Admin', '--system', '--access-key', 'UVQW931EG3AB4CYL', '--secret', 'iSUph5ZNlZA0jRgR14y90OM0mpNVa9gv', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T17:53:14.485 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 user create --uid realm-admin --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --display-name 'Realm Admin' --system --access-key UVQW931EG3AB4CYL --secret iSUph5ZNlZA0jRgR14y90OM0mpNVa9gv --cluster c1 --debug-rgw 0 --debug-ms 0 2021-02-13T17:53:14.622 INFO:teuthology.orchestra.run.gibba025.stdout:{"user_id":"realm-admin","display_name":"Realm Admin","email":"","suspended":0,"max_buckets":1000,"subusers":[],"keys":[{"user":"realm-admin","access_key":"UVQW931EG3AB4CYL","secret_key":"iSUph5ZNlZA0jRgR14y90OM0mpNVa9gv"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","system":"true","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2021-02-13T17:53:14.637 INFO:tasks.rgw_multisite:pulling realm configuration to c2 2021-02-13T17:53:14.637 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['realm', 'pull', '--rgw-realm', 'test-realm', '--url', 'http://gibba025.front.sepia.ceph.com:8000', '--access-key', 'UVQW931EG3AB4CYL', '--secret', 'iSUph5ZNlZA0jRgR14y90OM0mpNVa9gv', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T17:53:14.637 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'realm', 'pull', '--rgw-realm', 'test-realm', '--url', 'http://gibba025.front.sepia.ceph.com:8000', '--access-key', 'UVQW931EG3AB4CYL', '--secret', 'iSUph5ZNlZA0jRgR14y90OM0mpNVa9gv', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T17:53:14.637 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 realm pull --rgw-realm test-realm --url http://gibba025.front.sepia.ceph.com:8000 --access-key UVQW931EG3AB4CYL --secret iSUph5ZNlZA0jRgR14y90OM0mpNVa9gv --cluster c2 --debug-rgw 0 --debug-ms 0 2021-02-13T17:53:14.814 INFO:teuthology.orchestra.run.gibba036.stdout:{"id":"c0c9dba8-b0a7-4e01-b0aa-e4c8b23f42b5","name":"test-realm","current_period":"138dc4ba-dc02-4957-87c3-e8bf2d80917c","epoch":2} 2021-02-13T17:53:14.815 INFO:tasks.rgw_multisite:creating zone.. 2021-02-13T17:53:14.815 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'create', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--default', '--access-key', 'UVQW931EG3AB4CYL', '--secret', 'iSUph5ZNlZA0jRgR14y90OM0mpNVa9gv', '--endpoints', 'http://gibba036.front.sepia.ceph.com:8000', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T17:53:14.815 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'create', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--default', '--access-key', 'UVQW931EG3AB4CYL', '--secret', 'iSUph5ZNlZA0jRgR14y90OM0mpNVa9gv', '--endpoints', 'http://gibba036.front.sepia.ceph.com:8000', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T17:53:14.816 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone create --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --default --access-key UVQW931EG3AB4CYL --secret iSUph5ZNlZA0jRgR14y90OM0mpNVa9gv --endpoints http://gibba036.front.sepia.ceph.com:8000 --cluster c2 --debug-rgw 0 --debug-ms 0 2021-02-13T17:53:14.909 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:53:14.903 7fe4ad869940 0 failed reading obj info from .rgw.root:zone_info.671230a8-4b04-4e98-83d8-0a04dcd55dc0: (2) No such file or directory 2021-02-13T17:53:14.909 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:53:14.903 7fe4ad869940 0 WARNING: could not read zone params for zone id=671230a8-4b04-4e98-83d8-0a04dcd55dc0 name=test-zone1 2021-02-13T17:53:14.915 INFO:teuthology.orchestra.run.gibba036.stdout:{"id":"e658a22d-79d5-4296-b285-f122e7115b09","name":"test-zone2","domain_root":"test-zone2.rgw.meta:root","control_pool":"test-zone2.rgw.control","gc_pool":"test-zone2.rgw.log:gc","lc_pool":"test-zone2.rgw.log:lc","log_pool":"test-zone2.rgw.log","intent_log_pool":"test-zone2.rgw.log:intent","usage_log_pool":"test-zone2.rgw.log:usage","reshard_pool":"test-zone2.rgw.log:reshard","user_keys_pool":"test-zone2.rgw.meta:users.keys","user_email_pool":"test-zone2.rgw.meta:users.email","user_swift_pool":"test-zone2.rgw.meta:users.swift","user_uid_pool":"test-zone2.rgw.meta:users.uid","otp_pool":"test-zone2.rgw.otp","system_key":{"access_key":"UVQW931EG3AB4CYL","secret_key":"iSUph5ZNlZA0jRgR14y90OM0mpNVa9gv"},"placement_pools":[{"key":"default-placement","val":{"index_pool":"test-zone2.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"test-zone2.rgw.buckets.data"}},"data_extra_pool":"test-zone2.rgw.buckets.non-ec","index_type":0}}],"metadata_heap":"","realm_id":"c0c9dba8-b0a7-4e01-b0aa-e4c8b23f42b5"} 2021-02-13T17:53:14.916 DEBUG:teuthology.orchestra.run.gibba036:> sudo ceph osd pool create test-zone2.rgw.buckets.data 64 64 --cluster c2 2021-02-13T17:53:15.140 INFO:teuthology.orchestra.run.gibba036.stderr:pool 'test-zone2.rgw.buckets.data' created 2021-02-13T17:53:15.146 DEBUG:teuthology.orchestra.run.gibba036:> sudo ceph osd pool application enable test-zone2.rgw.buckets.data rgw --cluster c2 2021-02-13T17:53:16.165 INFO:teuthology.orchestra.run.gibba036.stderr:enabled application 'rgw' on pool 'test-zone2.rgw.buckets.data' 2021-02-13T17:53:16.172 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'placement', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', 'modify', '--placement-id', 'default-placement', '--compression', 'random', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T17:53:16.172 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'placement', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', 'modify', '--placement-id', 'default-placement', '--compression', 'random', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T17:53:16.172 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone placement --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm modify --placement-id default-placement --compression random --cluster c2 --debug-rgw 0 --debug-ms 0 2021-02-13T17:53:16.208 INFO:teuthology.orchestra.run.gibba036.stdout:{"id":"e658a22d-79d5-4296-b285-f122e7115b09","name":"test-zone2","domain_root":"test-zone2.rgw.meta:root","control_pool":"test-zone2.rgw.control","gc_pool":"test-zone2.rgw.log:gc","lc_pool":"test-zone2.rgw.log:lc","log_pool":"test-zone2.rgw.log","intent_log_pool":"test-zone2.rgw.log:intent","usage_log_pool":"test-zone2.rgw.log:usage","reshard_pool":"test-zone2.rgw.log:reshard","user_keys_pool":"test-zone2.rgw.meta:users.keys","user_email_pool":"test-zone2.rgw.meta:users.email","user_swift_pool":"test-zone2.rgw.meta:users.swift","user_uid_pool":"test-zone2.rgw.meta:users.uid","otp_pool":"test-zone2.rgw.otp","system_key":{"access_key":"UVQW931EG3AB4CYL","secret_key":"iSUph5ZNlZA0jRgR14y90OM0mpNVa9gv"},"placement_pools":[{"key":"default-placement","val":{"index_pool":"test-zone2.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"test-zone2.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"test-zone2.rgw.buckets.non-ec","index_type":0}}],"metadata_heap":"","realm_id":""} 2021-02-13T17:53:16.208 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T17:53:16.208 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T17:53:16.209 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 period update --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c2 --debug-rgw 0 --debug-ms 0 2021-02-13T17:53:22.212 INFO:teuthology.orchestra.run.gibba036.stdout:Sending period to new master zone 671230a8-4b04-4e98-83d8-0a04dcd55dc0 2021-02-13T17:53:23.304 INFO:teuthology.orchestra.run.gibba036.stdout:{"id":"138dc4ba-dc02-4957-87c3-e8bf2d80917c","epoch":2,"predecessor_uuid":"99e22614-2503-4cef-b9b0-3ddbb8dc47c9","sync_status":[],"period_map":{"id":"138dc4ba-dc02-4957-87c3-e8bf2d80917c","zonegroups":[{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":"true","endpoints":["http://gibba025.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"671230a8-4b04-4e98-83d8-0a04dcd55dc0","zones":[{"id":"671230a8-4b04-4e98-83d8-0a04dcd55dc0","name":"test-zone1","endpoints":["http://gibba025.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":0,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"e658a22d-79d5-4296-b285-f122e7115b09","name":"test-zone2","endpoints":["http://gibba036.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":0,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"c0c9dba8-b0a7-4e01-b0aa-e4c8b23f42b5"}],"short_zone_ids":[{"key":"671230a8-4b04-4e98-83d8-0a04dcd55dc0","val":450442592},{"key":"e658a22d-79d5-4296-b285-f122e7115b09","val":3525659260}]},"master_zonegroup":"test-zonegroup","master_zone":"671230a8-4b04-4e98-83d8-0a04dcd55dc0","period_config":{"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}},"realm_id":"c0c9dba8-b0a7-4e01-b0aa-e4c8b23f42b5","realm_name":"test-realm","realm_epoch":2} 2021-02-13T17:53:23.304 DEBUG:tasks.rgw.c2.client.0:waiting for process to exit 2021-02-13T17:53:23.305 INFO:teuthology.orchestra.run:waiting for 300 2021-02-13T17:53:23.305 INFO:tasks.rgw.c2.client.0.gibba036.stdout:2021-02-13 17:53:23.299 7faf82f1a700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term radosgw --rgw-frontends civetweb port=8000 -n client.0 --cluster c2 -k /etc/ceph/c2.client.0.keyring --log-file /var/log/ceph/rgw.c2.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.0.sock --foreground (PID: 15682) UID: 0 2021-02-13T17:53:23.305 INFO:tasks.rgw.c2.client.0.gibba036.stdout:2021-02-13 17:53:23.299 7faf99861980 -1 shutting down 2021-02-13T17:53:29.406 INFO:tasks.rgw.c2.client.0:Stopped 2021-02-13T17:53:29.406 INFO:tasks.rgw.c2.client.0:Restarting daemon 2021-02-13T17:53:29.407 DEBUG:teuthology.orchestra.run.gibba036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'civetweb port=8000' -n client.0 --cluster c2 -k /etc/ceph/c2.client.0.keyring --log-file /var/log/ceph/rgw.c2.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.0.sock --foreground --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm | sudo tee /var/log/ceph/rgw.c2.client.0.stdout 2>&1 2021-02-13T17:53:29.410 INFO:tasks.rgw.c2.client.0:Started 2021-02-13T17:53:29.410 DEBUG:teuthology.orchestra.run.gibba036:> curl http://gibba036.front.sepia.ceph.com:8000 2021-02-13T17:53:29.422 INFO:teuthology.orchestra.run.gibba036.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2021-02-13T17:53:29.422 INFO:teuthology.orchestra.run.gibba036.stderr: Dload Upload Total Spent Left Speed 2021-02-13T17:53:29.425 INFO:teuthology.orchestra.run.gibba036.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0curl: (7) Failed to connect to gibba036.front.sepia.ceph.com port 8000: Connection refused 2021-02-13T17:53:29.426 DEBUG:teuthology.orchestra.run:got remote process result: 7 2021-02-13T17:53:30.427 DEBUG:teuthology.orchestra.run.gibba036:> curl http://gibba036.front.sepia.ceph.com:8000 2021-02-13T17:53:30.438 INFO:teuthology.orchestra.run.gibba036.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2021-02-13T17:53:30.438 INFO:teuthology.orchestra.run.gibba036.stderr: Dload Upload Total Spent Left Speed 2021-02-13T17:53:30.444 INFO:teuthology.orchestra.run.gibba036.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 214 0 214 0 0 42800 0 --:--:-- --:--:-- --:--:-- 42800 2021-02-13T17:53:30.444 INFO:teuthology.orchestra.run.gibba036.stdout:anonymous 2021-02-13T17:53:30.445 INFO:tasks.rgw_multisite:creating zone.. 2021-02-13T17:53:30.445 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zone', 'create', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--access-key', 'UVQW931EG3AB4CYL', '--secret', 'iSUph5ZNlZA0jRgR14y90OM0mpNVa9gv', '--endpoints', 'http://gibba025.front.sepia.ceph.com:8001', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T17:53:30.445 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zone', 'create', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--access-key', 'UVQW931EG3AB4CYL', '--secret', 'iSUph5ZNlZA0jRgR14y90OM0mpNVa9gv', '--endpoints', 'http://gibba025.front.sepia.ceph.com:8001', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T17:53:30.446 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zone create --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --access-key UVQW931EG3AB4CYL --secret iSUph5ZNlZA0jRgR14y90OM0mpNVa9gv --endpoints http://gibba025.front.sepia.ceph.com:8001 --cluster c1 --debug-rgw 0 --debug-ms 0 2021-02-13T17:53:30.501 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:53:30.494 7f2832662940 0 failed reading obj info from .rgw.root:zone_info.e658a22d-79d5-4296-b285-f122e7115b09: (2) No such file or directory 2021-02-13T17:53:30.501 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 17:53:30.494 7f2832662940 0 WARNING: could not read zone params for zone id=e658a22d-79d5-4296-b285-f122e7115b09 name=test-zone2 2021-02-13T17:53:30.504 INFO:teuthology.orchestra.run.gibba025.stdout:{"id":"7441352a-0312-41b4-8a2a-b3cee61559db","name":"test-zone3","domain_root":"test-zone3.rgw.meta:root","control_pool":"test-zone3.rgw.control","gc_pool":"test-zone3.rgw.log:gc","lc_pool":"test-zone3.rgw.log:lc","log_pool":"test-zone3.rgw.log","intent_log_pool":"test-zone3.rgw.log:intent","usage_log_pool":"test-zone3.rgw.log:usage","reshard_pool":"test-zone3.rgw.log:reshard","user_keys_pool":"test-zone3.rgw.meta:users.keys","user_email_pool":"test-zone3.rgw.meta:users.email","user_swift_pool":"test-zone3.rgw.meta:users.swift","user_uid_pool":"test-zone3.rgw.meta:users.uid","otp_pool":"test-zone3.rgw.otp","system_key":{"access_key":"UVQW931EG3AB4CYL","secret_key":"iSUph5ZNlZA0jRgR14y90OM0mpNVa9gv"},"placement_pools":[{"key":"default-placement","val":{"index_pool":"test-zone3.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"test-zone3.rgw.buckets.data"}},"data_extra_pool":"test-zone3.rgw.buckets.non-ec","index_type":0}}],"metadata_heap":"","realm_id":"c0c9dba8-b0a7-4e01-b0aa-e4c8b23f42b5"} 2021-02-13T17:53:30.505 DEBUG:teuthology.orchestra.run.gibba025:> sudo ceph osd pool create test-zone3.rgw.buckets.data 64 64 --cluster c1 2021-02-13T17:53:30.727 INFO:teuthology.orchestra.run.gibba025.stderr:pool 'test-zone3.rgw.buckets.data' created 2021-02-13T17:53:30.733 DEBUG:teuthology.orchestra.run.gibba025:> sudo ceph osd pool application enable test-zone3.rgw.buckets.data rgw --cluster c1 2021-02-13T17:53:31.752 INFO:teuthology.orchestra.run.gibba025.stderr:enabled application 'rgw' on pool 'test-zone3.rgw.buckets.data' 2021-02-13T17:53:31.759 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zone', 'placement', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', 'modify', '--placement-id', 'default-placement', '--compression', 'random', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T17:53:31.759 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zone', 'placement', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', 'modify', '--placement-id', 'default-placement', '--compression', 'random', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T17:53:31.759 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zone placement --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm modify --placement-id default-placement --compression random --cluster c1 --debug-rgw 0 --debug-ms 0 2021-02-13T17:53:31.798 INFO:teuthology.orchestra.run.gibba025.stdout:{"id":"7441352a-0312-41b4-8a2a-b3cee61559db","name":"test-zone3","domain_root":"test-zone3.rgw.meta:root","control_pool":"test-zone3.rgw.control","gc_pool":"test-zone3.rgw.log:gc","lc_pool":"test-zone3.rgw.log:lc","log_pool":"test-zone3.rgw.log","intent_log_pool":"test-zone3.rgw.log:intent","usage_log_pool":"test-zone3.rgw.log:usage","reshard_pool":"test-zone3.rgw.log:reshard","user_keys_pool":"test-zone3.rgw.meta:users.keys","user_email_pool":"test-zone3.rgw.meta:users.email","user_swift_pool":"test-zone3.rgw.meta:users.swift","user_uid_pool":"test-zone3.rgw.meta:users.uid","otp_pool":"test-zone3.rgw.otp","system_key":{"access_key":"UVQW931EG3AB4CYL","secret_key":"iSUph5ZNlZA0jRgR14y90OM0mpNVa9gv"},"placement_pools":[{"key":"default-placement","val":{"index_pool":"test-zone3.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"test-zone3.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"test-zone3.rgw.buckets.non-ec","index_type":0}}],"metadata_heap":"","realm_id":""} 2021-02-13T17:53:31.799 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['period', 'update', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T17:53:31.799 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'period', 'update', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T17:53:31.799 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 period update --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c1 --debug-rgw 0 --debug-ms 0 2021-02-13T17:53:37.798 INFO:teuthology.orchestra.run.gibba025.stdout:Sending period to new master zone 671230a8-4b04-4e98-83d8-0a04dcd55dc0 2021-02-13T17:53:38.846 INFO:teuthology.orchestra.run.gibba025.stdout:{"id":"138dc4ba-dc02-4957-87c3-e8bf2d80917c","epoch":3,"predecessor_uuid":"99e22614-2503-4cef-b9b0-3ddbb8dc47c9","sync_status":[],"period_map":{"id":"138dc4ba-dc02-4957-87c3-e8bf2d80917c","zonegroups":[{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":"true","endpoints":["http://gibba025.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"671230a8-4b04-4e98-83d8-0a04dcd55dc0","zones":[{"id":"671230a8-4b04-4e98-83d8-0a04dcd55dc0","name":"test-zone1","endpoints":["http://gibba025.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":0,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"7441352a-0312-41b4-8a2a-b3cee61559db","name":"test-zone3","endpoints":["http://gibba025.front.sepia.ceph.com:8001"],"log_meta":"false","log_data":"true","bucket_index_max_shards":0,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"e658a22d-79d5-4296-b285-f122e7115b09","name":"test-zone2","endpoints":["http://gibba036.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":0,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"c0c9dba8-b0a7-4e01-b0aa-e4c8b23f42b5"}],"short_zone_ids":[{"key":"671230a8-4b04-4e98-83d8-0a04dcd55dc0","val":450442592},{"key":"7441352a-0312-41b4-8a2a-b3cee61559db","val":3844419010},{"key":"e658a22d-79d5-4296-b285-f122e7115b09","val":3525659260}]},"master_zonegroup":"test-zonegroup","master_zone":"671230a8-4b04-4e98-83d8-0a04dcd55dc0","period_config":{"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}},"realm_id":"c0c9dba8-b0a7-4e01-b0aa-e4c8b23f42b5","realm_name":"test-realm","realm_epoch":2} 2021-02-13T17:53:38.847 DEBUG:tasks.rgw.c1.client.1:waiting for process to exit 2021-02-13T17:53:38.847 INFO:teuthology.orchestra.run:waiting for 300 2021-02-13T17:53:38.848 INFO:tasks.rgw.c1.client.1.gibba025.stdout:2021-02-13 17:53:38.841 7f3ef27fb700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term radosgw --rgw-frontends civetweb port=8001 -n client.1 --cluster c1 -k /etc/ceph/c1.client.1.keyring --log-file /var/log/ceph/rgw.c1.client.1.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c1.client.1.sock --foreground (PID: 15661) UID: 0 2021-02-13T17:53:38.848 INFO:tasks.rgw.c1.client.1.gibba025.stdout:2021-02-13 17:53:38.841 7f3f09142980 -1 shutting down 2021-02-13T17:53:38.900 INFO:tasks.rgw.c1.client.1:Stopped 2021-02-13T17:53:38.901 INFO:tasks.rgw.c1.client.1:Restarting daemon 2021-02-13T17:53:38.901 DEBUG:teuthology.orchestra.run.gibba025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'civetweb port=8001' -n client.1 --cluster c1 -k /etc/ceph/c1.client.1.keyring --log-file /var/log/ceph/rgw.c1.client.1.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c1.client.1.sock --foreground --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm | sudo tee /var/log/ceph/rgw.c1.client.1.stdout 2>&1 2021-02-13T17:53:38.949 INFO:tasks.rgw.c1.client.1:Started 2021-02-13T17:53:38.950 DEBUG:teuthology.orchestra.run.gibba025:> curl http://gibba025.front.sepia.ceph.com:8001 2021-02-13T17:53:38.956 INFO:teuthology.orchestra.run.gibba025.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2021-02-13T17:53:38.956 INFO:teuthology.orchestra.run.gibba025.stderr: Dload Upload Total Spent Left Speed 2021-02-13T17:53:38.960 INFO:teuthology.orchestra.run.gibba025.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0curl: (7) Failed to connect to gibba025.front.sepia.ceph.com port 8001: Connection refused 2021-02-13T17:53:38.960 DEBUG:teuthology.orchestra.run:got remote process result: 7 2021-02-13T17:53:39.962 DEBUG:teuthology.orchestra.run.gibba025:> curl http://gibba025.front.sepia.ceph.com:8001 2021-02-13T17:53:39.977 INFO:teuthology.orchestra.run.gibba025.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2021-02-13T17:53:39.977 INFO:teuthology.orchestra.run.gibba025.stderr: Dload Upload Total Spent Left Speed 2021-02-13T17:53:39.983 INFO:teuthology.orchestra.run.gibba025.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 214 0 214 0 0 42800 0 --:--:-- --:--:-- --:--:-- 42800 2021-02-13T17:53:39.983 INFO:teuthology.orchestra.run.gibba025.stdout:anonymous 2021-02-13T17:53:39.984 INFO:tasks.rgw_multisite:pulling realm configuration to c2 2021-02-13T17:53:39.984 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['realm', 'pull', '--rgw-realm', 'test-realm', '--url', 'http://gibba025.front.sepia.ceph.com:8000', '--access-key', 'UVQW931EG3AB4CYL', '--secret', 'iSUph5ZNlZA0jRgR14y90OM0mpNVa9gv', '--url', 'http://gibba025.front.sepia.ceph.com:8000', '--access-key', 'UVQW931EG3AB4CYL', '--secret', 'iSUph5ZNlZA0jRgR14y90OM0mpNVa9gv', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T17:53:39.984 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'realm', 'pull', '--rgw-realm', 'test-realm', '--url', 'http://gibba025.front.sepia.ceph.com:8000', '--access-key', 'UVQW931EG3AB4CYL', '--secret', 'iSUph5ZNlZA0jRgR14y90OM0mpNVa9gv', '--url', 'http://gibba025.front.sepia.ceph.com:8000', '--access-key', 'UVQW931EG3AB4CYL', '--secret', 'iSUph5ZNlZA0jRgR14y90OM0mpNVa9gv', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T17:53:39.984 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 realm pull --rgw-realm test-realm --url http://gibba025.front.sepia.ceph.com:8000 --access-key UVQW931EG3AB4CYL --secret iSUph5ZNlZA0jRgR14y90OM0mpNVa9gv --url http://gibba025.front.sepia.ceph.com:8000 --access-key UVQW931EG3AB4CYL --secret iSUph5ZNlZA0jRgR14y90OM0mpNVa9gv --cluster c2 --debug-rgw 0 --debug-ms 0 2021-02-13T17:53:40.077 INFO:tasks.rgw.c2.client.0.gibba036.stdout:2021-02-13 17:53:40.071 7f343fd7c700 -1 rgw realm watcher: RGWRealmWatcher::handle_error oid=realms.c0c9dba8-b0a7-4e01-b0aa-e4c8b23f42b5.control err=-107 2021-02-13T17:53:40.086 INFO:teuthology.orchestra.run.gibba036.stdout:{"id":"c0c9dba8-b0a7-4e01-b0aa-e4c8b23f42b5","name":"test-realm","current_period":"138dc4ba-dc02-4957-87c3-e8bf2d80917c","epoch":2} 2021-02-13T17:53:40.087 INFO:tasks.rgw_multisite:creating zone.. 2021-02-13T17:53:40.087 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'create', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--access-key', 'UVQW931EG3AB4CYL', '--secret', 'iSUph5ZNlZA0jRgR14y90OM0mpNVa9gv', '--endpoints', 'http://gibba036.front.sepia.ceph.com:8001', '--tier-type', 'pubsub', '--sync-from-all=0', '--sync-from', 'test-zone1', '--tier-config', 'start_with_full_sync=false,event_retention_days=7', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T17:53:40.087 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'create', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--access-key', 'UVQW931EG3AB4CYL', '--secret', 'iSUph5ZNlZA0jRgR14y90OM0mpNVa9gv', '--endpoints', 'http://gibba036.front.sepia.ceph.com:8001', '--tier-type', 'pubsub', '--sync-from-all=0', '--sync-from', 'test-zone1', '--tier-config', 'start_with_full_sync=false,event_retention_days=7', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T17:53:40.087 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone create --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --access-key UVQW931EG3AB4CYL --secret iSUph5ZNlZA0jRgR14y90OM0mpNVa9gv --endpoints http://gibba036.front.sepia.ceph.com:8001 --tier-type pubsub --sync-from-all=0 --sync-from test-zone1 --tier-config start_with_full_sync=false,event_retention_days=7 --cluster c2 --debug-rgw 0 --debug-ms 0 2021-02-13T17:53:40.143 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:53:40.139 7ff9e6a63940 0 failed reading obj info from .rgw.root:zone_info.671230a8-4b04-4e98-83d8-0a04dcd55dc0: (2) No such file or directory 2021-02-13T17:53:40.143 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:53:40.139 7ff9e6a63940 0 WARNING: could not read zone params for zone id=671230a8-4b04-4e98-83d8-0a04dcd55dc0 name=test-zone1 2021-02-13T17:53:40.143 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:53:40.139 7ff9e6a63940 0 failed reading obj info from .rgw.root:zone_info.7441352a-0312-41b4-8a2a-b3cee61559db: (2) No such file or directory 2021-02-13T17:53:40.143 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 17:53:40.139 7ff9e6a63940 0 WARNING: could not read zone params for zone id=7441352a-0312-41b4-8a2a-b3cee61559db name=test-zone3 2021-02-13T17:53:40.147 INFO:teuthology.orchestra.run.gibba036.stdout:{"id":"1bf208ef-d5d9-46b7-8924-f1c8f37c366c","name":"test-zone4","domain_root":"test-zone4.rgw.meta:root","control_pool":"test-zone4.rgw.control","gc_pool":"test-zone4.rgw.log:gc","lc_pool":"test-zone4.rgw.log:lc","log_pool":"test-zone4.rgw.log","intent_log_pool":"test-zone4.rgw.log:intent","usage_log_pool":"test-zone4.rgw.log:usage","reshard_pool":"test-zone4.rgw.log:reshard","user_keys_pool":"test-zone4.rgw.meta:users.keys","user_email_pool":"test-zone4.rgw.meta:users.email","user_swift_pool":"test-zone4.rgw.meta:users.swift","user_uid_pool":"test-zone4.rgw.meta:users.uid","otp_pool":"test-zone4.rgw.otp","system_key":{"access_key":"UVQW931EG3AB4CYL","secret_key":"iSUph5ZNlZA0jRgR14y90OM0mpNVa9gv"},"placement_pools":[{"key":"default-placement","val":{"index_pool":"test-zone4.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"test-zone4.rgw.buckets.data"}},"data_extra_pool":"test-zone4.rgw.buckets.non-ec","index_type":0}}],"metadata_heap":"","tier_config":{"event_retention_days":7,"start_with_full_sync":false},"realm_id":"c0c9dba8-b0a7-4e01-b0aa-e4c8b23f42b5"} 2021-02-13T17:53:40.147 DEBUG:teuthology.orchestra.run.gibba036:> sudo ceph osd pool create test-zone4.rgw.buckets.data 64 64 --cluster c2 2021-02-13T17:53:40.879 INFO:teuthology.orchestra.run.gibba036.stderr:pool 'test-zone4.rgw.buckets.data' created 2021-02-13T17:53:40.888 DEBUG:teuthology.orchestra.run.gibba036:> sudo ceph osd pool application enable test-zone4.rgw.buckets.data rgw --cluster c2 2021-02-13T17:53:41.858 INFO:teuthology.orchestra.run.gibba036.stderr:enabled application 'rgw' on pool 'test-zone4.rgw.buckets.data' 2021-02-13T17:53:41.874 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'placement', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', 'modify', '--placement-id', 'default-placement', '--compression', 'random', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T17:53:41.875 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'placement', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', 'modify', '--placement-id', 'default-placement', '--compression', 'random', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T17:53:41.875 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone placement --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm modify --placement-id default-placement --compression random --cluster c2 --debug-rgw 0 --debug-ms 0 2021-02-13T17:53:41.915 INFO:teuthology.orchestra.run.gibba036.stdout:{"id":"1bf208ef-d5d9-46b7-8924-f1c8f37c366c","name":"test-zone4","domain_root":"test-zone4.rgw.meta:root","control_pool":"test-zone4.rgw.control","gc_pool":"test-zone4.rgw.log:gc","lc_pool":"test-zone4.rgw.log:lc","log_pool":"test-zone4.rgw.log","intent_log_pool":"test-zone4.rgw.log:intent","usage_log_pool":"test-zone4.rgw.log:usage","reshard_pool":"test-zone4.rgw.log:reshard","user_keys_pool":"test-zone4.rgw.meta:users.keys","user_email_pool":"test-zone4.rgw.meta:users.email","user_swift_pool":"test-zone4.rgw.meta:users.swift","user_uid_pool":"test-zone4.rgw.meta:users.uid","otp_pool":"test-zone4.rgw.otp","system_key":{"access_key":"UVQW931EG3AB4CYL","secret_key":"iSUph5ZNlZA0jRgR14y90OM0mpNVa9gv"},"placement_pools":[{"key":"default-placement","val":{"index_pool":"test-zone4.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"test-zone4.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"test-zone4.rgw.buckets.non-ec","index_type":0}}],"metadata_heap":"","tier_config":{"event_retention_days":7,"start_with_full_sync":false},"realm_id":""} 2021-02-13T17:53:41.916 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['period', 'update', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T17:53:41.916 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'period', 'update', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T17:53:41.916 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 period update --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c2 --debug-rgw 0 --debug-ms 0 2021-02-13T17:53:47.935 INFO:teuthology.orchestra.run.gibba036.stdout:Sending period to new master zone 671230a8-4b04-4e98-83d8-0a04dcd55dc0 2021-02-13T17:53:49.122 INFO:teuthology.orchestra.run.gibba036.stdout:{"id":"138dc4ba-dc02-4957-87c3-e8bf2d80917c","epoch":4,"predecessor_uuid":"99e22614-2503-4cef-b9b0-3ddbb8dc47c9","sync_status":[],"period_map":{"id":"138dc4ba-dc02-4957-87c3-e8bf2d80917c","zonegroups":[{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":"true","endpoints":["http://gibba025.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"671230a8-4b04-4e98-83d8-0a04dcd55dc0","zones":[{"id":"1bf208ef-d5d9-46b7-8924-f1c8f37c366c","name":"test-zone4","endpoints":["http://gibba036.front.sepia.ceph.com:8001"],"log_meta":"false","log_data":"true","bucket_index_max_shards":0,"read_only":"false","tier_type":"pubsub","sync_from_all":"false","sync_from":["test-zone1"],"redirect_zone":""},{"id":"671230a8-4b04-4e98-83d8-0a04dcd55dc0","name":"test-zone1","endpoints":["http://gibba025.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":0,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"7441352a-0312-41b4-8a2a-b3cee61559db","name":"test-zone3","endpoints":["http://gibba025.front.sepia.ceph.com:8001"],"log_meta":"false","log_data":"true","bucket_index_max_shards":0,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"e658a22d-79d5-4296-b285-f122e7115b09","name":"test-zone2","endpoints":["http://gibba036.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":0,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"c0c9dba8-b0a7-4e01-b0aa-e4c8b23f42b5"}],"short_zone_ids":[{"key":"1bf208ef-d5d9-46b7-8924-f1c8f37c366c","val":1463523823},{"key":"671230a8-4b04-4e98-83d8-0a04dcd55dc0","val":450442592},{"key":"7441352a-0312-41b4-8a2a-b3cee61559db","val":3844419010},{"key":"e658a22d-79d5-4296-b285-f122e7115b09","val":3525659260}]},"master_zonegroup":"test-zonegroup","master_zone":"671230a8-4b04-4e98-83d8-0a04dcd55dc0","period_config":{"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}},"realm_id":"c0c9dba8-b0a7-4e01-b0aa-e4c8b23f42b5","realm_name":"test-realm","realm_epoch":2} 2021-02-13T17:53:49.123 DEBUG:tasks.rgw.c2.client.1:waiting for process to exit 2021-02-13T17:53:49.123 INFO:teuthology.orchestra.run:waiting for 300 2021-02-13T17:53:49.125 INFO:tasks.rgw.c2.client.1.gibba036.stdout:2021-02-13 17:53:49.119 7fa1fd293700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term radosgw --rgw-frontends civetweb port=8001 -n client.1 --cluster c2 -k /etc/ceph/c2.client.1.keyring --log-file /var/log/ceph/rgw.c2.client.1.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.1.sock --foreground (PID: 15686) UID: 0 2021-02-13T17:53:49.125 INFO:tasks.rgw.c2.client.1.gibba036.stdout:2021-02-13 17:53:49.119 7fa213bda980 -1 shutting down 2021-02-13T17:53:55.225 INFO:tasks.rgw.c2.client.1:Stopped 2021-02-13T17:53:55.226 INFO:tasks.rgw.c2.client.1:Restarting daemon 2021-02-13T17:53:55.226 DEBUG:teuthology.orchestra.run.gibba036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'civetweb port=8001' -n client.1 --cluster c2 -k /etc/ceph/c2.client.1.keyring --log-file /var/log/ceph/rgw.c2.client.1.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.1.sock --foreground --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm | sudo tee /var/log/ceph/rgw.c2.client.1.stdout 2>&1 2021-02-13T17:53:55.229 INFO:tasks.rgw.c2.client.1:Started 2021-02-13T17:53:55.229 DEBUG:teuthology.orchestra.run.gibba036:> curl http://gibba036.front.sepia.ceph.com:8001 2021-02-13T17:53:55.241 INFO:teuthology.orchestra.run.gibba036.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2021-02-13T17:53:55.241 INFO:teuthology.orchestra.run.gibba036.stderr: Dload Upload Total Spent Left Speed 2021-02-13T17:53:55.245 INFO:teuthology.orchestra.run.gibba036.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0curl: (7) Failed to connect to gibba036.front.sepia.ceph.com port 8001: Connection refused 2021-02-13T17:53:55.245 DEBUG:teuthology.orchestra.run:got remote process result: 7 2021-02-13T17:53:56.246 DEBUG:teuthology.orchestra.run.gibba036:> curl http://gibba036.front.sepia.ceph.com:8001 2021-02-13T17:53:56.258 INFO:teuthology.orchestra.run.gibba036.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2021-02-13T17:53:56.258 INFO:teuthology.orchestra.run.gibba036.stderr: Dload Upload Total Spent Left Speed 2021-02-13T17:53:56.262 INFO:teuthology.orchestra.run.gibba036.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 134 100 134 0 0 33500 0 --:--:-- --:--:-- --:--:-- 33500 2021-02-13T17:53:56.263 INFO:teuthology.orchestra.run.gibba036.stdout:{"Code":"MethodNotAllowed","RequestId":"tx000000000000000000001-0060281234-10df-test-zone4","HostId":"10df-test-zone4-test-zonegroup"} 2021-02-13T17:53:56.263 INFO:tasks.rgw_multisite:rgw multisite configuration completed 2021-02-13T17:53:56.264 INFO:teuthology.run_tasks:Running task rgw-multisite-tests... 2021-02-13T17:53:56.325 INFO:tasks.rgw_multisite_tests:creating test user.. 2021-02-13T17:53:56.325 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['user', 'create', '--uid', 'rgw-multisite-test-user', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--display-name', 'Multisite Test User', '--gen-access-key', '--gen-secret', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T17:53:56.325 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'user', 'create', '--uid', 'rgw-multisite-test-user', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--display-name', 'Multisite Test User', '--gen-access-key', '--gen-secret', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T17:53:56.326 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 user create --uid rgw-multisite-test-user --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --display-name 'Multisite Test User' --gen-access-key --gen-secret --cluster c1 --debug-rgw 0 --debug-ms 0 2021-02-13T17:53:56.399 INFO:teuthology.orchestra.run.gibba025.stdout:{"user_id":"rgw-multisite-test-user","display_name":"Multisite Test User","email":"","suspended":0,"max_buckets":1000,"subusers":[],"keys":[{"user":"rgw-multisite-test-user","access_key":"M21222R45J8SN9EPLLXF","secret_key":"YRc5l1B5ZEfL4AMlLZZ41ZBi0OwUiTOWALGnnN0Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2021-02-13T17:53:56.412 INFO:rgw_multi.tests:meta checkpoint 2021-02-13T17:53:56.413 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:53:56.413 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:53:56.413 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:53:56.472 INFO:teuthology.orchestra.run.gibba025.stderr:No --period given, using current period=138dc4ba-dc02-4957-87c3-e8bf2d80917c 2021-02-13T17:53:56.488 INFO:teuthology.orchestra.run.gibba025.stdout:[{"marker":"1_1613238836.394578_31.1","last_update":"2021-02-13 17:53:56.394578Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2021-02-13T17:53:56.489 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-02-13T17:53:56.489 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:53:56.489 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:53:56.489 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:53:56.574 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"138dc4ba-dc02-4957-87c3-e8bf2d80917c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:53:56.574 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1613238836.394578_31.1 target= 2021-02-13T17:54:01.575 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:54:01.575 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:54:01.576 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:54:01.658 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"138dc4ba-dc02-4957-87c3-e8bf2d80917c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:54:01.658 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1613238836.394578_31.1 target= 2021-02-13T17:54:06.659 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:54:06.660 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:54:06.660 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:54:06.743 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"138dc4ba-dc02-4957-87c3-e8bf2d80917c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:54:06.744 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1613238836.394578_31.1 target= 2021-02-13T17:54:11.744 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:54:11.745 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:54:11.745 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:54:11.827 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"138dc4ba-dc02-4957-87c3-e8bf2d80917c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:54:11.827 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1613238836.394578_31.1 target= 2021-02-13T17:54:16.828 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:54:16.828 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:54:16.828 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:54:16.906 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"138dc4ba-dc02-4957-87c3-e8bf2d80917c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:54:16.906 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1613238836.394578_31.1 target= 2021-02-13T17:54:21.907 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:54:21.908 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:54:21.908 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:54:21.993 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"138dc4ba-dc02-4957-87c3-e8bf2d80917c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:54:21.993 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1613238836.394578_31.1 target= 2021-02-13T17:54:26.994 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:54:26.994 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:54:26.994 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:54:27.072 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"138dc4ba-dc02-4957-87c3-e8bf2d80917c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:54:27.073 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1613238836.394578_31.1 target= 2021-02-13T17:54:32.073 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:54:32.073 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:54:32.074 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:54:32.161 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"138dc4ba-dc02-4957-87c3-e8bf2d80917c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:54:32.162 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1613238836.394578_31.1 target= 2021-02-13T17:54:37.162 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:54:37.163 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:54:37.163 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:54:37.241 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"138dc4ba-dc02-4957-87c3-e8bf2d80917c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:54:37.241 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1613238836.394578_31.1 target= 2021-02-13T17:54:42.243 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:54:42.243 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:54:42.243 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:54:42.596 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"138dc4ba-dc02-4957-87c3-e8bf2d80917c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:54:42.596 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1613238836.394578_31.1 target= 2021-02-13T17:54:47.597 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:54:47.597 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:54:47.598 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:54:47.683 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"138dc4ba-dc02-4957-87c3-e8bf2d80917c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:54:47.684 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1613238836.394578_31.1 target= 2021-02-13T17:54:52.685 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:54:52.685 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:54:52.685 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:54:52.770 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"138dc4ba-dc02-4957-87c3-e8bf2d80917c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:54:52.770 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1613238836.394578_31.1 target= 2021-02-13T17:54:57.771 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:54:57.771 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:54:57.771 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:54:57.848 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"138dc4ba-dc02-4957-87c3-e8bf2d80917c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:54:57.848 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1613238836.394578_31.1 target= 2021-02-13T17:55:02.849 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:55:02.849 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:55:02.850 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:55:02.935 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"138dc4ba-dc02-4957-87c3-e8bf2d80917c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:55:02.935 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1613238836.394578_31.1 target= 2021-02-13T17:55:07.936 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:55:07.936 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:55:07.936 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:55:08.020 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"138dc4ba-dc02-4957-87c3-e8bf2d80917c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:55:08.020 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1613238836.394578_31.1 target= 2021-02-13T17:55:13.021 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:55:13.022 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:55:13.022 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:55:13.107 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"138dc4ba-dc02-4957-87c3-e8bf2d80917c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:55:13.107 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1613238836.394578_31.1 target= 2021-02-13T17:55:18.108 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:55:18.108 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:55:18.108 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:55:18.194 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"138dc4ba-dc02-4957-87c3-e8bf2d80917c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:55:18.195 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1613238836.394578_31.1 target= 2021-02-13T17:55:23.195 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:55:23.196 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:55:23.196 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:55:23.275 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"138dc4ba-dc02-4957-87c3-e8bf2d80917c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:55:23.276 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1613238836.394578_31.1 target= 2021-02-13T17:55:28.277 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:55:28.277 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:55:28.277 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:55:28.357 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"138dc4ba-dc02-4957-87c3-e8bf2d80917c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:55:28.358 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1613238836.394578_31.1 target= 2021-02-13T17:55:33.360 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:55:33.360 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:55:33.360 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:55:33.445 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"138dc4ba-dc02-4957-87c3-e8bf2d80917c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:55:33.445 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1613238836.394578_31.1 target= 2021-02-13T17:55:38.446 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:55:38.447 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:55:38.447 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:55:38.534 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"138dc4ba-dc02-4957-87c3-e8bf2d80917c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:55:38.534 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1613238836.394578_31.1 target= 2021-02-13T17:55:43.535 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:55:43.535 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:55:43.535 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:55:43.614 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"138dc4ba-dc02-4957-87c3-e8bf2d80917c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:55:43.614 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1613238836.394578_31.1 target= 2021-02-13T17:55:48.615 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:55:48.615 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:55:48.616 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:55:48.703 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"138dc4ba-dc02-4957-87c3-e8bf2d80917c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:55:48.703 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1613238836.394578_31.1 target= 2021-02-13T17:55:53.704 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:55:53.704 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:55:53.705 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:55:53.793 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"138dc4ba-dc02-4957-87c3-e8bf2d80917c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:55:53.794 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-02-13T17:55:53.794 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-02-13T17:55:53.794 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:55:53.794 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:55:53.794 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:55:53.874 INFO:teuthology.orchestra.run.gibba025.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"138dc4ba-dc02-4957-87c3-e8bf2d80917c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:55:53.874 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-02-13T17:55:53.874 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T17:55:53.874 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:55:53.875 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:55:53.875 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:55:54.050 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"138dc4ba-dc02-4957-87c3-e8bf2d80917c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:55:54.050 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T17:55:54.051 INFO:rgw_multi.tests:meta checkpoint 2021-02-13T17:55:54.051 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:55:54.051 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:55:54.051 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:55:54.115 INFO:teuthology.orchestra.run.gibba025.stderr:No --period given, using current period=138dc4ba-dc02-4957-87c3-e8bf2d80917c 2021-02-13T17:55:54.130 INFO:teuthology.orchestra.run.gibba025.stdout:[{"marker":"1_1613238836.394578_31.1","last_update":"2021-02-13 17:53:56.394578Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2021-02-13T17:55:54.131 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-02-13T17:55:54.131 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:55:54.131 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:55:54.131 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:55:54.212 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"138dc4ba-dc02-4957-87c3-e8bf2d80917c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:55:54.213 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-02-13T17:55:54.213 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-02-13T17:55:54.213 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:55:54.213 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:55:54.214 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:55:54.295 INFO:teuthology.orchestra.run.gibba025.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"138dc4ba-dc02-4957-87c3-e8bf2d80917c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:55:54.295 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-02-13T17:55:54.295 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T17:55:54.295 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:55:54.295 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:55:54.296 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:55:54.470 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"138dc4ba-dc02-4957-87c3-e8bf2d80917c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:55:54.470 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T17:55:54.471 INFO:tasks.rgw_multisite_tests:running rgw multisite tests on 'tasks.rgw_multi.tests' with args=[] 2021-02-13T17:55:54.483 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=ejuwhf-1 2021-02-13T17:55:55.588 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=ejuwhf-2 2021-02-13T17:55:56.734 INFO:rgw_multi.tests:create bucket zone=test-zone3 name=ejuwhf-3 2021-02-13T17:55:58.602 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:55:58.603 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:55:58.603 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:55:58.663 INFO:teuthology.orchestra.run.gibba025.stderr:No --period given, using current period=138dc4ba-dc02-4957-87c3-e8bf2d80917c 2021-02-13T17:55:58.679 INFO:teuthology.orchestra.run.gibba025.stdout:[{"marker":"1_1613238836.394578_31.1","last_update":"2021-02-13 17:53:56.394578Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613238956.791138_45.1","last_update":"2021-02-13 17:55:56.791138Z"},{"marker":"","last_update":"0.000000"}] 2021-02-13T17:55:58.679 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-02-13T17:55:58.680 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:55:58.680 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:55:58.680 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:55:58.781 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"138dc4ba-dc02-4957-87c3-e8bf2d80917c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238956.791138_45.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:55:56.791138Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:55:58.781 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-02-13T17:55:58.781 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-02-13T17:55:58.781 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:55:58.782 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:55:58.782 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:55:58.903 INFO:teuthology.orchestra.run.gibba025.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"138dc4ba-dc02-4957-87c3-e8bf2d80917c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238956.791138_45.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:55:56.791138Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:55:58.904 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-02-13T17:55:58.904 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T17:55:58.904 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:55:58.905 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:55:58.905 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:55:59.121 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"138dc4ba-dc02-4957-87c3-e8bf2d80917c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238956.791138_45.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:55:56.791138Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:55:59.121 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T17:56:00.588 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.tests.test_bucket_create ... ok 2021-02-13T17:56:00.588 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=ejuwhf-4 2021-02-13T17:56:00.652 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=ejuwhf-5 2021-02-13T17:56:00.752 INFO:rgw_multi.tests:create bucket zone=test-zone3 name=ejuwhf-6 2021-02-13T17:56:00.854 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:56:00.854 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:56:00.854 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:56:00.955 INFO:teuthology.orchestra.run.gibba025.stderr:No --period given, using current period=138dc4ba-dc02-4957-87c3-e8bf2d80917c 2021-02-13T17:56:00.971 INFO:teuthology.orchestra.run.gibba025.stdout:[{"marker":"1_1613238836.394578_31.1","last_update":"2021-02-13 17:53:56.394578Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613238960.804035_57.1","last_update":"2021-02-13 17:56:00.804035Z"},{"marker":"","last_update":"0.000000"}] 2021-02-13T17:56:00.971 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-02-13T17:56:00.971 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:56:00.971 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:56:00.972 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:56:01.061 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"138dc4ba-dc02-4957-87c3-e8bf2d80917c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238956.791138_45.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:55:56.791138Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:56:01.062 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1613238960.804035_57.1 target=1_1613238956.791138_45.1 2021-02-13T17:56:06.062 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:56:06.063 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:56:06.063 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:56:06.148 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"138dc4ba-dc02-4957-87c3-e8bf2d80917c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238960.804035_57.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:00.804035Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:56:06.148 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-02-13T17:56:06.148 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-02-13T17:56:06.148 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:56:06.148 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:56:06.149 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:56:06.230 INFO:teuthology.orchestra.run.gibba025.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"138dc4ba-dc02-4957-87c3-e8bf2d80917c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238960.804035_57.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:00.804035Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:56:06.230 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-02-13T17:56:06.230 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T17:56:06.230 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:56:06.230 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:56:06.231 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:56:06.406 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"138dc4ba-dc02-4957-87c3-e8bf2d80917c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238960.804035_57.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:00.804035Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:56:06.406 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T17:56:11.861 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:56:11.861 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:56:11.861 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:56:11.924 INFO:teuthology.orchestra.run.gibba025.stderr:No --period given, using current period=138dc4ba-dc02-4957-87c3-e8bf2d80917c 2021-02-13T17:56:11.939 INFO:teuthology.orchestra.run.gibba025.stdout:[{"marker":"1_1613238836.394578_31.1","last_update":"2021-02-13 17:53:56.394578Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613238970.149013_111.1","last_update":"2021-02-13 17:56:10.149013Z"},{"marker":"","last_update":"0.000000"}] 2021-02-13T17:56:11.940 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-02-13T17:56:11.940 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:56:11.940 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:56:11.940 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:56:12.023 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"138dc4ba-dc02-4957-87c3-e8bf2d80917c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238970.016320_97.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:10.016320Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:56:12.024 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1613238970.149013_111.1 target=1_1613238970.016320_97.1 2021-02-13T17:56:17.024 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:56:17.025 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:56:17.025 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:56:17.111 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"138dc4ba-dc02-4957-87c3-e8bf2d80917c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238970.138703_107.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:10.138703Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:56:17.111 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1613238970.149013_111.1 target=1_1613238970.138703_107.1 2021-02-13T17:56:22.112 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:56:22.112 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:56:22.113 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:56:22.190 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"138dc4ba-dc02-4957-87c3-e8bf2d80917c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238970.149013_111.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:10.149013Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:56:22.190 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-02-13T17:56:22.191 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-02-13T17:56:22.191 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:56:22.191 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:56:22.191 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:56:22.279 INFO:teuthology.orchestra.run.gibba025.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"138dc4ba-dc02-4957-87c3-e8bf2d80917c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238970.149013_111.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:10.149013Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:56:22.280 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-02-13T17:56:22.280 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T17:56:22.280 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:56:22.280 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:56:22.280 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:56:22.493 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"138dc4ba-dc02-4957-87c3-e8bf2d80917c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238970.149013_111.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:10.149013Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:56:22.493 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T17:56:23.129 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.tests.test_bucket_recreate ... ok 2021-02-13T17:56:23.130 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=ejuwhf-7 2021-02-13T17:56:23.190 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=ejuwhf-8 2021-02-13T17:56:23.289 INFO:rgw_multi.tests:create bucket zone=test-zone3 name=ejuwhf-9 2021-02-13T17:56:23.389 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:56:23.389 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:56:23.389 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:56:23.481 INFO:teuthology.orchestra.run.gibba025.stderr:No --period given, using current period=138dc4ba-dc02-4957-87c3-e8bf2d80917c 2021-02-13T17:56:23.497 INFO:teuthology.orchestra.run.gibba025.stdout:[{"marker":"1_1613238836.394578_31.1","last_update":"2021-02-13 17:53:56.394578Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613238983.341158_123.1","last_update":"2021-02-13 17:56:23.341158Z"},{"marker":"","last_update":"0.000000"}] 2021-02-13T17:56:23.497 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-02-13T17:56:23.497 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:56:23.497 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:56:23.498 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:56:23.586 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"138dc4ba-dc02-4957-87c3-e8bf2d80917c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238970.149013_111.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:10.149013Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:56:23.586 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1613238983.341158_123.1 target=1_1613238970.149013_111.1 2021-02-13T17:56:28.587 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:56:28.588 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:56:28.588 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:56:28.671 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"138dc4ba-dc02-4957-87c3-e8bf2d80917c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238983.341158_123.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:23.341158Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:56:28.671 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-02-13T17:56:28.671 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-02-13T17:56:28.672 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:56:28.672 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:56:28.672 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:56:28.748 INFO:teuthology.orchestra.run.gibba025.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"138dc4ba-dc02-4957-87c3-e8bf2d80917c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238983.341158_123.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:23.341158Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:56:28.748 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-02-13T17:56:28.748 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T17:56:28.748 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:56:28.748 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:56:28.749 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:56:28.960 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"138dc4ba-dc02-4957-87c3-e8bf2d80917c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238983.341158_123.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:23.341158Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:56:28.960 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T17:56:29.818 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:56:29.819 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:56:29.819 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:56:29.922 INFO:teuthology.orchestra.run.gibba025.stderr:No --period given, using current period=138dc4ba-dc02-4957-87c3-e8bf2d80917c 2021-02-13T17:56:29.938 INFO:teuthology.orchestra.run.gibba025.stdout:[{"marker":"1_1613238836.394578_31.1","last_update":"2021-02-13 17:53:56.394578Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613238989.770436_129.1","last_update":"2021-02-13 17:56:29.770436Z"},{"marker":"","last_update":"0.000000"}] 2021-02-13T17:56:29.939 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-02-13T17:56:29.939 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:56:29.939 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:56:29.939 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:56:30.022 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"138dc4ba-dc02-4957-87c3-e8bf2d80917c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.631574_125.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.631574Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:56:30.022 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=2 master=1_1613238989.770436_129.1 target=1_1613238989.631574_125.1 2021-02-13T17:56:35.023 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:56:35.023 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:56:35.024 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:56:35.106 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"138dc4ba-dc02-4957-87c3-e8bf2d80917c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:56:35.107 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-02-13T17:56:35.107 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-02-13T17:56:35.107 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:56:35.107 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:56:35.107 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:56:35.186 INFO:teuthology.orchestra.run.gibba025.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"138dc4ba-dc02-4957-87c3-e8bf2d80917c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:56:35.187 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-02-13T17:56:35.187 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T17:56:35.187 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:56:35.187 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:56:35.187 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:56:35.398 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"138dc4ba-dc02-4957-87c3-e8bf2d80917c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:56:35.399 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T17:56:36.400 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.tests.test_bucket_remove ... ok 2021-02-13T17:56:36.400 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=ejuwhf-10 2021-02-13T17:56:36.462 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=ejuwhf-11 2021-02-13T17:56:36.558 INFO:rgw_multi.tests:create bucket zone=test-zone3 name=ejuwhf-12 2021-02-13T17:56:37.239 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:56:37.239 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:56:37.239 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:56:37.340 INFO:teuthology.orchestra.run.gibba025.stderr:No --period given, using current period=138dc4ba-dc02-4957-87c3-e8bf2d80917c 2021-02-13T17:56:37.355 INFO:teuthology.orchestra.run.gibba025.stdout:[{"marker":"1_1613238836.394578_31.1","last_update":"2021-02-13 17:53:56.394578Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613238989.770436_129.1","last_update":"2021-02-13 17:56:29.770436Z"},{"marker":"1_1613238996.608007_31.1","last_update":"2021-02-13 17:56:36.608007Z"}] 2021-02-13T17:56:37.355 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-02-13T17:56:37.356 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:56:37.356 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:56:37.356 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:56:37.440 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"138dc4ba-dc02-4957-87c3-e8bf2d80917c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:56:37.440 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=3 master=1_1613238996.608007_31.1 target= 2021-02-13T17:56:42.441 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:56:42.442 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:56:42.442 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:56:42.525 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"138dc4ba-dc02-4957-87c3-e8bf2d80917c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613238996.608007_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:36.608007Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:56:42.525 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-02-13T17:56:42.526 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-02-13T17:56:42.526 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:56:42.526 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:56:42.526 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:56:42.611 INFO:teuthology.orchestra.run.gibba025.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"138dc4ba-dc02-4957-87c3-e8bf2d80917c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613238996.608007_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:36.608007Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:56:42.611 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-02-13T17:56:42.611 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T17:56:42.612 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:56:42.612 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:56:42.612 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:56:42.788 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"138dc4ba-dc02-4957-87c3-e8bf2d80917c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613238996.608007_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:36.608007Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T17:56:42.788 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T17:56:42.789 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-10', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:56:42.789 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-10', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:56:42.789 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ejuwhf-10 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:56:42.876 INFO:teuthology.orchestra.run.gibba025.stdout:{"markers":[{"key":0,"val":"00000000008.10.5"}]} 2021-02-13T17:56:42.877 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=ejuwhf-10 2021-02-13T17:56:42.877 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-10', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:56:42.877 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-10', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:56:42.877 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ejuwhf-10 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:56:42.968 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"myobj","instance":"","ns":""},"count":4},"inc_marker":{"position":"0#00000000008.10.5"}}}] 2021-02-13T17:56:42.969 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=ejuwhf-10 2021-02-13T17:56:42.969 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ejuwhf-10 zones={test-zone2, test-zone1} 2021-02-13T17:56:43.453 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-02-13T17:56:43.462 DEBUG:tasks.rgw_multi.zone_rados:o=& 2021-02-13T17:56:43.462 DEBUG:tasks.rgw_multi.zone_rados:o=: 2021-02-13T17:56:43.462 DEBUG:tasks.rgw_multi.zone_rados:o=_myobj 2021-02-13T17:56:43.462 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2021-02-13T17:56:43.462 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-02-13T17:56:43.468 DEBUG:tasks.rgw_multi.zone_rados:o=& 2021-02-13T17:56:43.468 DEBUG:tasks.rgw_multi.zone_rados:o=: 2021-02-13T17:56:43.468 DEBUG:tasks.rgw_multi.zone_rados:o=_myobj 2021-02-13T17:56:43.468 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2021-02-13T17:56:43.479 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=& 2021-02-13T17:56:43.539 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=& 2021-02-13T17:56:43.651 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=& 2021-02-13T17:56:43.760 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=: 2021-02-13T17:56:43.819 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=: 2021-02-13T17:56:43.936 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=: 2021-02-13T17:56:44.049 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=_myobj 2021-02-13T17:56:44.112 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=_myobj 2021-02-13T17:56:44.228 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=_myobj 2021-02-13T17:56:44.331 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2021-02-13T17:56:44.390 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2021-02-13T17:56:44.503 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2021-02-13T17:56:44.612 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ejuwhf-10 zones={test-zone2, test-zone1} 2021-02-13T17:56:44.612 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-10', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:56:44.612 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-10', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:56:44.612 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ejuwhf-10 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:56:44.735 INFO:teuthology.orchestra.run.gibba025.stdout:{"markers":[{"key":0,"val":"00000000008.10.5"}]} 2021-02-13T17:56:44.736 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=ejuwhf-10 2021-02-13T17:56:44.736 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-10', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:56:44.736 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-10', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:56:44.736 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ejuwhf-10 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:56:44.818 INFO:teuthology.orchestra.run.gibba025.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"myobj","instance":"","ns":""},"count":4},"inc_marker":{"position":"0#00000000008.10.5"}}}] 2021-02-13T17:56:44.818 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=ejuwhf-10 2021-02-13T17:56:44.818 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ejuwhf-10 zones={test-zone3, test-zone1} 2021-02-13T17:56:45.068 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-02-13T17:56:45.073 DEBUG:tasks.rgw_multi.zone_rados:o=& 2021-02-13T17:56:45.073 DEBUG:tasks.rgw_multi.zone_rados:o=: 2021-02-13T17:56:45.073 DEBUG:tasks.rgw_multi.zone_rados:o=_myobj 2021-02-13T17:56:45.073 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2021-02-13T17:56:45.073 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-02-13T17:56:45.078 DEBUG:tasks.rgw_multi.zone_rados:o=& 2021-02-13T17:56:45.078 DEBUG:tasks.rgw_multi.zone_rados:o=: 2021-02-13T17:56:45.078 DEBUG:tasks.rgw_multi.zone_rados:o=_myobj 2021-02-13T17:56:45.078 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2021-02-13T17:56:45.088 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=& 2021-02-13T17:56:45.147 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=& 2021-02-13T17:56:45.260 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=& 2021-02-13T17:56:45.364 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=: 2021-02-13T17:56:45.423 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=: 2021-02-13T17:56:45.536 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=: 2021-02-13T17:56:45.643 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=_myobj 2021-02-13T17:56:45.708 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=_myobj 2021-02-13T17:56:45.819 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=_myobj 2021-02-13T17:56:45.927 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2021-02-13T17:56:45.988 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2021-02-13T17:56:46.099 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2021-02-13T17:56:46.209 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ejuwhf-10 zones={test-zone3, test-zone1} 2021-02-13T17:56:46.209 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-10', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:56:46.209 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-10', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:56:46.210 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ejuwhf-10 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:56:46.331 INFO:teuthology.orchestra.run.gibba025.stdout:{"markers":[{"key":0,"val":"00000000008.10.5"}]} 2021-02-13T17:56:46.331 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone4 source_zone=test-zone1 bucket=ejuwhf-10 2021-02-13T17:56:46.331 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-10', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:56:46.332 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-10', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:56:46.332 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ejuwhf-10 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:56:46.508 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"myobj","instance":"","ns":""},"count":4},"inc_marker":{"position":"0#00000000008.10.5"}}}] 2021-02-13T17:56:46.508 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone4 source_zone=test-zone1 bucket=ejuwhf-10 2021-02-13T17:56:46.508 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:56:46.509 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:56:46.509 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ejuwhf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:56:46.585 INFO:teuthology.orchestra.run.gibba036.stdout:{"markers":[{"key":0,"val":"00000000008.8.5"}]} 2021-02-13T17:56:46.586 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=ejuwhf-11 2021-02-13T17:56:46.586 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:56:46.586 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:56:46.586 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-11 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:56:46.680 INFO:teuthology.orchestra.run.gibba025.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"myobj","instance":"","ns":""},"count":4},"inc_marker":{"position":"0#00000000008.8.5"}}}] 2021-02-13T17:56:46.680 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=ejuwhf-11 2021-02-13T17:56:46.680 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ejuwhf-11 zones={test-zone1, test-zone2} 2021-02-13T17:56:46.869 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-02-13T17:56:46.875 DEBUG:tasks.rgw_multi.zone_rados:o=& 2021-02-13T17:56:46.875 DEBUG:tasks.rgw_multi.zone_rados:o=: 2021-02-13T17:56:46.875 DEBUG:tasks.rgw_multi.zone_rados:o=_myobj 2021-02-13T17:56:46.875 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2021-02-13T17:56:46.876 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-02-13T17:56:46.881 DEBUG:tasks.rgw_multi.zone_rados:o=& 2021-02-13T17:56:46.881 DEBUG:tasks.rgw_multi.zone_rados:o=: 2021-02-13T17:56:46.881 DEBUG:tasks.rgw_multi.zone_rados:o=_myobj 2021-02-13T17:56:46.881 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2021-02-13T17:56:46.892 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=& 2021-02-13T17:56:46.954 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=& 2021-02-13T17:56:47.067 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=& 2021-02-13T17:56:47.179 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=: 2021-02-13T17:56:47.238 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=: 2021-02-13T17:56:47.352 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=: 2021-02-13T17:56:47.455 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=_myobj 2021-02-13T17:56:47.515 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=_myobj 2021-02-13T17:56:47.627 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=_myobj 2021-02-13T17:56:47.731 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2021-02-13T17:56:47.794 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2021-02-13T17:56:47.907 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2021-02-13T17:56:48.011 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ejuwhf-11 zones={test-zone1, test-zone2} 2021-02-13T17:56:48.012 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:56:48.012 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:56:48.012 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ejuwhf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:56:48.131 INFO:teuthology.orchestra.run.gibba036.stdout:{"markers":[{"key":0,"val":"00000000008.8.5"}]} 2021-02-13T17:56:48.132 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone2 bucket=ejuwhf-11 2021-02-13T17:56:48.132 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:56:48.132 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:56:48.132 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-11 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:56:48.219 INFO:teuthology.orchestra.run.gibba025.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"myobj","instance":"","ns":""},"count":4},"inc_marker":{"position":"0#00000000008.8.5"}}}] 2021-02-13T17:56:48.219 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone2 bucket=ejuwhf-11 2021-02-13T17:56:48.219 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ejuwhf-11 zones={test-zone3, test-zone2} 2021-02-13T17:56:49.003 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-02-13T17:56:49.009 DEBUG:tasks.rgw_multi.zone_rados:o=& 2021-02-13T17:56:49.009 DEBUG:tasks.rgw_multi.zone_rados:o=: 2021-02-13T17:56:49.009 DEBUG:tasks.rgw_multi.zone_rados:o=_myobj 2021-02-13T17:56:49.009 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2021-02-13T17:56:49.009 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-02-13T17:56:49.016 DEBUG:tasks.rgw_multi.zone_rados:o=& 2021-02-13T17:56:49.016 DEBUG:tasks.rgw_multi.zone_rados:o=: 2021-02-13T17:56:49.016 DEBUG:tasks.rgw_multi.zone_rados:o=_myobj 2021-02-13T17:56:49.016 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2021-02-13T17:56:49.027 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=& 2021-02-13T17:56:49.087 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=& 2021-02-13T17:56:49.205 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=& 2021-02-13T17:56:49.309 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=: 2021-02-13T17:56:49.367 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=: 2021-02-13T17:56:49.479 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=: 2021-02-13T17:56:49.583 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=_myobj 2021-02-13T17:56:49.644 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=_myobj 2021-02-13T17:56:49.757 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=_myobj 2021-02-13T17:56:49.867 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2021-02-13T17:56:49.932 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2021-02-13T17:56:50.044 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2021-02-13T17:56:50.144 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ejuwhf-11 zones={test-zone3, test-zone2} 2021-02-13T17:56:50.145 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:56:50.145 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:56:50.145 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ejuwhf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:56:50.229 INFO:teuthology.orchestra.run.gibba036.stdout:{"markers":[{"key":0,"val":"00000000008.8.5"}]} 2021-02-13T17:56:50.229 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone4 source_zone=test-zone2 bucket=ejuwhf-11 2021-02-13T17:56:50.229 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:56:50.229 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:56:50.229 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:56:50.404 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:56:50.405 WARNING:rgw_multi.tests:bucket ejuwhf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T17:56:55.405 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:56:55.405 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:56:55.406 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:56:55.578 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:56:55.579 WARNING:rgw_multi.tests:bucket ejuwhf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T17:57:00.580 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:57:00.580 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:57:00.581 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:57:00.760 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:57:00.761 WARNING:rgw_multi.tests:bucket ejuwhf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T17:57:05.762 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:57:05.762 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:57:05.763 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:57:05.938 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:57:05.938 WARNING:rgw_multi.tests:bucket ejuwhf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T17:57:10.938 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:57:10.939 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:57:10.939 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:57:11.114 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:57:11.114 WARNING:rgw_multi.tests:bucket ejuwhf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T17:57:16.115 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:57:16.116 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:57:16.116 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:57:16.298 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:57:16.298 WARNING:rgw_multi.tests:bucket ejuwhf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T17:57:21.300 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:57:21.300 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:57:21.300 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:57:21.481 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:57:21.481 WARNING:rgw_multi.tests:bucket ejuwhf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T17:57:26.482 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:57:26.482 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:57:26.483 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:57:26.658 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:57:26.658 WARNING:rgw_multi.tests:bucket ejuwhf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T17:57:31.658 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:57:31.659 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:57:31.659 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:57:31.833 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:57:31.834 WARNING:rgw_multi.tests:bucket ejuwhf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T17:57:36.834 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:57:36.834 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:57:36.835 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:57:37.009 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:57:37.009 WARNING:rgw_multi.tests:bucket ejuwhf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T17:57:42.010 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:57:42.010 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:57:42.011 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:57:42.194 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:57:42.194 WARNING:rgw_multi.tests:bucket ejuwhf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T17:57:47.195 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:57:47.195 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:57:47.195 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:57:47.378 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:57:47.379 WARNING:rgw_multi.tests:bucket ejuwhf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T17:57:52.380 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:57:52.380 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:57:52.380 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:57:52.553 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:57:52.553 WARNING:rgw_multi.tests:bucket ejuwhf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T17:57:57.554 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:57:57.554 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:57:57.554 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:57:57.727 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:57:57.728 WARNING:rgw_multi.tests:bucket ejuwhf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T17:58:02.729 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:58:02.730 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:58:02.730 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:58:02.910 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:58:02.910 WARNING:rgw_multi.tests:bucket ejuwhf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T17:58:07.910 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:58:07.911 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:58:07.911 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:58:08.087 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:58:08.088 WARNING:rgw_multi.tests:bucket ejuwhf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T17:58:13.089 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:58:13.089 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:58:13.090 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:58:13.261 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:58:13.262 WARNING:rgw_multi.tests:bucket ejuwhf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T17:58:18.263 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:58:18.263 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:58:18.263 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:58:18.443 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:58:18.444 WARNING:rgw_multi.tests:bucket ejuwhf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T17:58:23.445 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:58:23.445 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:58:23.446 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:58:23.624 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:58:23.624 WARNING:rgw_multi.tests:bucket ejuwhf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T17:58:28.625 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:58:28.625 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:58:28.626 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:58:28.806 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:58:28.807 WARNING:rgw_multi.tests:bucket ejuwhf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T17:58:33.807 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:58:33.808 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:58:33.808 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:58:33.989 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:58:33.989 WARNING:rgw_multi.tests:bucket ejuwhf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T17:58:38.990 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:58:38.990 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:58:38.990 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:58:39.170 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:58:39.171 WARNING:rgw_multi.tests:bucket ejuwhf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T17:58:44.172 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:58:44.172 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:58:44.172 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:58:44.349 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:58:44.349 WARNING:rgw_multi.tests:bucket ejuwhf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T17:58:49.351 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:58:49.351 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:58:49.351 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:58:49.534 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:58:49.534 WARNING:rgw_multi.tests:bucket ejuwhf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T17:58:54.535 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:58:54.536 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:58:54.536 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:58:54.712 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:58:54.712 WARNING:rgw_multi.tests:bucket ejuwhf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T17:58:59.713 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:58:59.714 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:58:59.714 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:58:59.887 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:58:59.888 WARNING:rgw_multi.tests:bucket ejuwhf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T17:59:04.888 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:59:04.889 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:59:04.889 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:59:05.071 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:59:05.071 WARNING:rgw_multi.tests:bucket ejuwhf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T17:59:10.072 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:59:10.073 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:59:10.073 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:59:10.247 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:59:10.247 WARNING:rgw_multi.tests:bucket ejuwhf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T17:59:15.248 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:59:15.249 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:59:15.249 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:59:15.432 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:59:15.432 WARNING:rgw_multi.tests:bucket ejuwhf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T17:59:20.433 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:59:20.433 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:59:20.434 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:59:20.608 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:59:20.608 WARNING:rgw_multi.tests:bucket ejuwhf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T17:59:25.609 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:59:25.609 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:59:25.610 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:59:25.792 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:59:25.793 WARNING:rgw_multi.tests:bucket ejuwhf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T17:59:30.794 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:59:30.794 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:59:30.795 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:59:30.970 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:59:30.970 WARNING:rgw_multi.tests:bucket ejuwhf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T17:59:35.971 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:59:35.971 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:59:35.972 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:59:36.152 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:59:36.153 WARNING:rgw_multi.tests:bucket ejuwhf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T17:59:41.154 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:59:41.154 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:59:41.155 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:59:41.331 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:59:41.332 WARNING:rgw_multi.tests:bucket ejuwhf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T17:59:46.332 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:59:46.332 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:59:46.333 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:59:46.505 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:59:46.506 WARNING:rgw_multi.tests:bucket ejuwhf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T17:59:51.507 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:59:51.507 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:59:51.507 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:59:51.690 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:59:51.690 WARNING:rgw_multi.tests:bucket ejuwhf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T17:59:56.691 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:59:56.692 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T17:59:56.692 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T17:59:56.869 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T17:59:56.870 WARNING:rgw_multi.tests:bucket ejuwhf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T18:00:01.870 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:00:01.871 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:00:01.871 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:00:02.037 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:00:02.038 WARNING:rgw_multi.tests:bucket ejuwhf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T18:00:07.038 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:00:07.038 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:00:07.039 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:00:07.215 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:00:07.215 WARNING:rgw_multi.tests:bucket ejuwhf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T18:00:12.216 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:00:12.216 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:00:12.216 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:00:12.398 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:00:12.398 WARNING:rgw_multi.tests:bucket ejuwhf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T18:00:17.400 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:00:17.400 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:00:17.400 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:00:17.575 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:00:17.576 WARNING:rgw_multi.tests:bucket ejuwhf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T18:00:22.576 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:00:22.577 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:00:22.577 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:00:22.759 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:00:22.759 WARNING:rgw_multi.tests:bucket ejuwhf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T18:00:27.760 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:00:27.761 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:00:27.761 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:00:27.942 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:00:27.942 WARNING:rgw_multi.tests:bucket ejuwhf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T18:00:32.943 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:00:32.944 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:00:32.944 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:00:33.125 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:00:33.126 WARNING:rgw_multi.tests:bucket ejuwhf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T18:00:38.126 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:00:38.127 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:00:38.127 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:00:38.305 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:00:38.306 WARNING:rgw_multi.tests:bucket ejuwhf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T18:00:43.307 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:00:43.307 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:00:43.308 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:00:43.490 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:00:43.490 WARNING:rgw_multi.tests:bucket ejuwhf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T18:00:48.491 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:00:48.491 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:00:48.492 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:00:48.667 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:00:48.667 WARNING:rgw_multi.tests:bucket ejuwhf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T18:00:53.668 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:00:53.669 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:00:53.669 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:00:53.847 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:00:53.848 WARNING:rgw_multi.tests:bucket ejuwhf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T18:00:58.849 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:00:58.849 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:00:58.850 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:00:59.031 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:00:59.032 WARNING:rgw_multi.tests:bucket ejuwhf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T18:01:04.032 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:01:04.033 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:01:04.033 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:01:04.207 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:01:04.207 WARNING:rgw_multi.tests:bucket ejuwhf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T18:01:09.208 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:01:09.209 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:01:09.209 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:01:09.391 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:01:09.391 WARNING:rgw_multi.tests:bucket ejuwhf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T18:01:14.393 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:01:14.393 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:01:14.393 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:01:14.570 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:01:14.570 WARNING:rgw_multi.tests:bucket ejuwhf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T18:01:19.572 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:01:19.572 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:01:19.572 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:01:19.748 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:01:19.749 WARNING:rgw_multi.tests:bucket ejuwhf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T18:01:24.749 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:01:24.750 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:01:24.750 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:01:24.931 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:01:24.931 WARNING:rgw_multi.tests:bucket ejuwhf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T18:01:29.932 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:01:29.933 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:01:29.933 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:01:30.109 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:01:30.110 WARNING:rgw_multi.tests:bucket ejuwhf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T18:01:35.111 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:01:35.111 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:01:35.111 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:01:35.286 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:01:35.287 WARNING:rgw_multi.tests:bucket ejuwhf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T18:01:40.287 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:01:40.287 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:01:40.288 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:01:40.470 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:01:40.470 WARNING:rgw_multi.tests:bucket ejuwhf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T18:01:45.471 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:01:45.472 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:01:45.472 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:01:45.657 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:01:45.657 WARNING:rgw_multi.tests:bucket ejuwhf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T18:01:50.659 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:01:50.659 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:01:50.659 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:01:50.838 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:01:50.839 WARNING:rgw_multi.tests:bucket ejuwhf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T18:01:55.840 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:01:55.841 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:01:55.841 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:01:56.053 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:01:56.053 WARNING:rgw_multi.tests:bucket ejuwhf-11 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.8.5 target= 2021-02-13T18:02:01.061 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.tests.test_object_sync ... FAIL 2021-02-13T18:02:01.062 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=ejuwhf-13 2021-02-13T18:02:01.132 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=ejuwhf-14 2021-02-13T18:02:01.243 INFO:rgw_multi.tests:create bucket zone=test-zone3 name=ejuwhf-15 2021-02-13T18:02:01.503 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:02:01.503 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:02:01.503 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:02:01.607 INFO:teuthology.orchestra.run.gibba025.stderr:No --period given, using current period=138dc4ba-dc02-4957-87c3-e8bf2d80917c 2021-02-13T18:02:01.622 INFO:teuthology.orchestra.run.gibba025.stdout:[{"marker":"1_1613238836.394578_31.1","last_update":"2021-02-13 17:53:56.394578Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613238989.770436_129.1","last_update":"2021-02-13 17:56:29.770436Z"},{"marker":"1_1613239321.305535_49.1","last_update":"2021-02-13 18:02:01.305535Z"}] 2021-02-13T18:02:01.622 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-02-13T18:02:01.622 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:02:01.622 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:02:01.623 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:02:01.707 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"138dc4ba-dc02-4957-87c3-e8bf2d80917c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613238996.608007_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:36.608007Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:02:01.707 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=3 master=1_1613239321.305535_49.1 target=1_1613238996.608007_31.1 2021-02-13T18:02:06.708 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:02:06.709 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:02:06.709 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:02:06.792 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"138dc4ba-dc02-4957-87c3-e8bf2d80917c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613239321.305535_49.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:02:01.305535Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:02:06.792 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-02-13T18:02:06.792 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-02-13T18:02:06.792 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:02:06.792 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:02:06.793 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:02:06.915 INFO:teuthology.orchestra.run.gibba025.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"138dc4ba-dc02-4957-87c3-e8bf2d80917c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613239321.305535_49.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:02:01.305535Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:02:06.915 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-02-13T18:02:06.915 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T18:02:06.915 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:02:06.916 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:02:06.916 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:02:07.130 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"138dc4ba-dc02-4957-87c3-e8bf2d80917c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613239321.305535_49.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:02:01.305535Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:02:07.131 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T18:02:07.131 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-13', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:02:07.131 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-13', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:02:07.131 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ejuwhf-13 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:02:07.223 INFO:teuthology.orchestra.run.gibba025.stdout:{"markers":[{"key":0,"val":"00000000002.4.5"}]} 2021-02-13T18:02:07.223 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=ejuwhf-13 2021-02-13T18:02:07.223 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-13', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:02:07.223 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-13', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:02:07.223 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ejuwhf-13 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:02:07.311 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"myobj","instance":"","ns":""},"count":1},"inc_marker":{"position":"0#00000000002.4.5"}}}] 2021-02-13T18:02:07.312 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=ejuwhf-13 2021-02-13T18:02:07.312 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ejuwhf-13 zones={test-zone2, test-zone1} 2021-02-13T18:02:08.389 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-02-13T18:02:08.395 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2021-02-13T18:02:08.395 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-02-13T18:02:08.443 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2021-02-13T18:02:08.499 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2021-02-13T18:02:08.561 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2021-02-13T18:02:08.681 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2021-02-13T18:02:08.784 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ejuwhf-13 zones={test-zone2, test-zone1} 2021-02-13T18:02:08.784 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-13', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:02:08.784 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-13', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:02:08.784 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ejuwhf-13 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:02:08.868 INFO:teuthology.orchestra.run.gibba025.stdout:{"markers":[{"key":0,"val":"00000000002.4.5"}]} 2021-02-13T18:02:08.869 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=ejuwhf-13 2021-02-13T18:02:08.869 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-13', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:02:08.869 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-13', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:02:08.870 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ejuwhf-13 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:02:08.957 INFO:teuthology.orchestra.run.gibba025.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"myobj","instance":"","ns":""},"count":1},"inc_marker":{"position":"0#00000000002.4.5"}}}] 2021-02-13T18:02:08.957 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=ejuwhf-13 2021-02-13T18:02:08.958 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ejuwhf-13 zones={test-zone3, test-zone1} 2021-02-13T18:02:10.527 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-02-13T18:02:10.533 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2021-02-13T18:02:10.533 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-02-13T18:02:10.579 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2021-02-13T18:02:10.631 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2021-02-13T18:02:10.690 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2021-02-13T18:02:10.799 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2021-02-13T18:02:10.899 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ejuwhf-13 zones={test-zone3, test-zone1} 2021-02-13T18:02:10.900 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-13', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:02:10.900 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-13', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:02:10.900 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ejuwhf-13 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:02:11.026 INFO:teuthology.orchestra.run.gibba025.stdout:{"markers":[{"key":0,"val":"00000000002.4.5"}]} 2021-02-13T18:02:11.026 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone4 source_zone=test-zone1 bucket=ejuwhf-13 2021-02-13T18:02:11.026 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-13', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:02:11.026 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-13', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:02:11.027 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ejuwhf-13 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:02:11.208 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"myobj","instance":"","ns":""},"count":1},"inc_marker":{"position":"0#00000000002.4.5"}}}] 2021-02-13T18:02:11.209 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone4 source_zone=test-zone1 bucket=ejuwhf-13 2021-02-13T18:02:11.209 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:02:11.209 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:02:11.209 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ejuwhf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:02:11.285 INFO:teuthology.orchestra.run.gibba036.stdout:{"markers":[{"key":0,"val":"00000000002.3.5"}]} 2021-02-13T18:02:11.285 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=ejuwhf-14 2021-02-13T18:02:11.285 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:02:11.286 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:02:11.286 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-14 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:02:11.369 INFO:teuthology.orchestra.run.gibba025.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"myobj","instance":"","ns":""},"count":1},"inc_marker":{"position":"0#00000000002.3.5"}}}] 2021-02-13T18:02:11.370 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=ejuwhf-14 2021-02-13T18:02:11.370 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ejuwhf-14 zones={test-zone1, test-zone2} 2021-02-13T18:02:11.740 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-02-13T18:02:11.744 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2021-02-13T18:02:11.745 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-02-13T18:02:11.791 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2021-02-13T18:02:11.847 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2021-02-13T18:02:11.910 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2021-02-13T18:02:12.014 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2021-02-13T18:02:12.119 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ejuwhf-14 zones={test-zone1, test-zone2} 2021-02-13T18:02:12.119 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:02:12.120 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:02:12.120 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ejuwhf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:02:12.244 INFO:teuthology.orchestra.run.gibba036.stdout:{"markers":[{"key":0,"val":"00000000002.3.5"}]} 2021-02-13T18:02:12.244 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone2 bucket=ejuwhf-14 2021-02-13T18:02:12.244 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:02:12.244 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:02:12.245 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-14 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:02:12.341 INFO:teuthology.orchestra.run.gibba025.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"myobj","instance":"","ns":""},"count":1},"inc_marker":{"position":"0#00000000002.3.5"}}}] 2021-02-13T18:02:12.341 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone2 bucket=ejuwhf-14 2021-02-13T18:02:12.341 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ejuwhf-14 zones={test-zone3, test-zone2} 2021-02-13T18:02:12.356 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-02-13T18:02:12.399 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2021-02-13T18:02:12.399 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-02-13T18:02:12.404 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2021-02-13T18:02:12.455 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2021-02-13T18:02:12.516 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2021-02-13T18:02:12.627 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2021-02-13T18:02:12.731 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ejuwhf-14 zones={test-zone3, test-zone2} 2021-02-13T18:02:12.731 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:02:12.731 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:02:12.731 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ejuwhf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:02:12.850 INFO:teuthology.orchestra.run.gibba036.stdout:{"markers":[{"key":0,"val":"00000000002.3.5"}]} 2021-02-13T18:02:12.850 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone4 source_zone=test-zone2 bucket=ejuwhf-14 2021-02-13T18:02:12.850 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:02:12.850 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:02:12.850 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:02:13.022 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:02:13.023 WARNING:rgw_multi.tests:bucket ejuwhf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.3.5 target= 2021-02-13T18:02:18.023 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:02:18.024 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:02:18.024 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:02:18.205 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:02:18.205 WARNING:rgw_multi.tests:bucket ejuwhf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.3.5 target= 2021-02-13T18:02:23.206 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:02:23.207 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:02:23.207 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:02:23.388 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:02:23.388 WARNING:rgw_multi.tests:bucket ejuwhf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.3.5 target= 2021-02-13T18:02:28.389 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:02:28.389 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:02:28.390 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:02:28.573 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:02:28.573 WARNING:rgw_multi.tests:bucket ejuwhf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.3.5 target= 2021-02-13T18:02:33.575 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:02:33.575 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:02:33.575 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:02:33.758 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:02:33.758 WARNING:rgw_multi.tests:bucket ejuwhf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.3.5 target= 2021-02-13T18:02:38.759 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:02:38.759 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:02:38.759 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:02:38.937 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:02:38.938 WARNING:rgw_multi.tests:bucket ejuwhf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.3.5 target= 2021-02-13T18:02:43.939 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:02:43.939 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:02:43.939 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:02:44.119 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:02:44.119 WARNING:rgw_multi.tests:bucket ejuwhf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.3.5 target= 2021-02-13T18:02:49.120 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:02:49.120 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:02:49.120 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:02:49.302 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:02:49.302 WARNING:rgw_multi.tests:bucket ejuwhf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.3.5 target= 2021-02-13T18:02:54.303 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:02:54.303 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:02:54.303 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:02:54.486 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:02:54.486 WARNING:rgw_multi.tests:bucket ejuwhf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.3.5 target= 2021-02-13T18:02:59.487 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:02:59.487 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:02:59.488 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:02:59.671 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:02:59.671 WARNING:rgw_multi.tests:bucket ejuwhf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.3.5 target= 2021-02-13T18:03:04.672 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:03:04.672 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:03:04.673 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:03:04.855 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:03:04.855 WARNING:rgw_multi.tests:bucket ejuwhf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.3.5 target= 2021-02-13T18:03:09.855 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:03:09.856 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:03:09.856 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:03:10.029 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:03:10.029 WARNING:rgw_multi.tests:bucket ejuwhf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.3.5 target= 2021-02-13T18:03:15.030 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:03:15.031 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:03:15.031 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:03:15.209 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:03:15.209 WARNING:rgw_multi.tests:bucket ejuwhf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.3.5 target= 2021-02-13T18:03:20.210 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:03:20.211 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:03:20.211 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:03:20.386 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:03:20.386 WARNING:rgw_multi.tests:bucket ejuwhf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.3.5 target= 2021-02-13T18:03:25.387 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:03:25.387 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:03:25.388 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:03:25.561 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:03:25.562 WARNING:rgw_multi.tests:bucket ejuwhf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.3.5 target= 2021-02-13T18:03:30.563 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:03:30.563 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:03:30.563 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:03:30.739 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:03:30.740 WARNING:rgw_multi.tests:bucket ejuwhf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.3.5 target= 2021-02-13T18:03:35.741 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:03:35.741 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:03:35.742 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:03:35.923 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:03:35.923 WARNING:rgw_multi.tests:bucket ejuwhf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.3.5 target= 2021-02-13T18:03:40.924 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:03:40.924 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:03:40.925 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:03:41.106 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:03:41.106 WARNING:rgw_multi.tests:bucket ejuwhf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.3.5 target= 2021-02-13T18:03:46.107 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:03:46.108 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:03:46.108 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:03:46.288 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:03:46.288 WARNING:rgw_multi.tests:bucket ejuwhf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.3.5 target= 2021-02-13T18:03:51.289 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:03:51.289 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:03:51.290 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:03:51.484 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:03:51.485 WARNING:rgw_multi.tests:bucket ejuwhf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.3.5 target= 2021-02-13T18:03:56.486 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:03:56.486 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:03:56.487 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:03:56.685 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:03:56.686 WARNING:rgw_multi.tests:bucket ejuwhf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.3.5 target= 2021-02-13T18:04:01.687 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:04:01.687 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:04:01.687 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:04:01.868 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:04:01.868 WARNING:rgw_multi.tests:bucket ejuwhf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.3.5 target= 2021-02-13T18:04:06.868 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:04:06.869 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:04:06.869 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:04:07.045 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:04:07.045 WARNING:rgw_multi.tests:bucket ejuwhf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.3.5 target= 2021-02-13T18:04:12.046 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:04:12.046 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:04:12.046 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:04:12.229 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:04:12.229 WARNING:rgw_multi.tests:bucket ejuwhf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.3.5 target= 2021-02-13T18:04:17.230 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:04:17.230 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:04:17.230 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:04:17.406 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:04:17.407 WARNING:rgw_multi.tests:bucket ejuwhf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.3.5 target= 2021-02-13T18:04:22.407 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:04:22.407 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:04:22.408 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:04:22.582 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:04:22.582 WARNING:rgw_multi.tests:bucket ejuwhf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.3.5 target= 2021-02-13T18:04:27.582 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:04:27.583 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:04:27.583 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:04:27.764 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:04:27.765 WARNING:rgw_multi.tests:bucket ejuwhf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.3.5 target= 2021-02-13T18:04:32.766 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:04:32.766 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:04:32.767 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:04:32.942 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:04:32.942 WARNING:rgw_multi.tests:bucket ejuwhf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.3.5 target= 2021-02-13T18:04:37.943 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:04:37.943 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:04:37.943 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:04:38.117 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:04:38.118 WARNING:rgw_multi.tests:bucket ejuwhf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.3.5 target= 2021-02-13T18:04:43.119 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:04:43.120 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:04:43.120 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:04:43.295 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:04:43.296 WARNING:rgw_multi.tests:bucket ejuwhf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.3.5 target= 2021-02-13T18:04:48.296 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:04:48.297 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:04:48.297 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:04:48.479 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:04:48.479 WARNING:rgw_multi.tests:bucket ejuwhf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.3.5 target= 2021-02-13T18:04:53.480 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:04:53.480 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:04:53.480 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:04:53.661 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:04:53.662 WARNING:rgw_multi.tests:bucket ejuwhf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.3.5 target= 2021-02-13T18:04:58.662 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:04:58.663 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:04:58.663 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:04:58.835 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:04:58.836 WARNING:rgw_multi.tests:bucket ejuwhf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.3.5 target= 2021-02-13T18:05:03.836 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:05:03.837 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:05:03.837 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:05:04.015 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:05:04.015 WARNING:rgw_multi.tests:bucket ejuwhf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.3.5 target= 2021-02-13T18:05:09.016 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:05:09.016 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:05:09.016 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:05:09.194 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:05:09.194 WARNING:rgw_multi.tests:bucket ejuwhf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.3.5 target= 2021-02-13T18:05:14.195 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:05:14.195 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:05:14.195 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:05:14.367 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:05:14.368 WARNING:rgw_multi.tests:bucket ejuwhf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.3.5 target= 2021-02-13T18:05:19.369 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:05:19.369 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:05:19.370 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:05:19.551 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:05:19.551 WARNING:rgw_multi.tests:bucket ejuwhf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.3.5 target= 2021-02-13T18:05:24.552 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:05:24.553 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:05:24.553 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:05:24.726 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:05:24.726 WARNING:rgw_multi.tests:bucket ejuwhf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.3.5 target= 2021-02-13T18:05:29.727 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:05:29.727 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:05:29.727 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:05:29.908 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:05:29.908 WARNING:rgw_multi.tests:bucket ejuwhf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.3.5 target= 2021-02-13T18:05:34.909 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:05:34.910 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:05:34.910 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:05:35.087 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:05:35.087 WARNING:rgw_multi.tests:bucket ejuwhf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.3.5 target= 2021-02-13T18:05:40.088 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:05:40.089 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:05:40.089 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:05:40.270 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:05:40.270 WARNING:rgw_multi.tests:bucket ejuwhf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.3.5 target= 2021-02-13T18:05:45.271 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:05:45.272 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:05:45.272 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:05:45.444 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:05:45.445 WARNING:rgw_multi.tests:bucket ejuwhf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.3.5 target= 2021-02-13T18:05:50.445 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:05:50.446 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:05:50.446 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:05:50.625 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:05:50.626 WARNING:rgw_multi.tests:bucket ejuwhf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.3.5 target= 2021-02-13T18:05:55.626 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:05:55.627 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:05:55.627 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:05:55.800 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:05:55.800 WARNING:rgw_multi.tests:bucket ejuwhf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.3.5 target= 2021-02-13T18:06:00.800 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:06:00.801 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:06:00.801 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:06:00.981 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:06:00.981 WARNING:rgw_multi.tests:bucket ejuwhf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.3.5 target= 2021-02-13T18:06:05.982 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:06:05.983 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:06:05.983 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:06:06.166 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:06:06.167 WARNING:rgw_multi.tests:bucket ejuwhf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.3.5 target= 2021-02-13T18:06:11.168 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:06:11.169 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:06:11.169 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:06:11.349 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:06:11.350 WARNING:rgw_multi.tests:bucket ejuwhf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.3.5 target= 2021-02-13T18:06:16.351 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:06:16.351 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:06:16.351 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:06:16.528 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:06:16.528 WARNING:rgw_multi.tests:bucket ejuwhf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.3.5 target= 2021-02-13T18:06:21.529 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:06:21.529 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:06:21.529 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:06:21.706 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:06:21.706 WARNING:rgw_multi.tests:bucket ejuwhf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.3.5 target= 2021-02-13T18:06:26.707 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:06:26.707 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:06:26.707 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:06:26.891 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:06:26.892 WARNING:rgw_multi.tests:bucket ejuwhf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.3.5 target= 2021-02-13T18:06:31.893 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:06:31.894 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:06:31.894 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:06:32.074 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:06:32.074 WARNING:rgw_multi.tests:bucket ejuwhf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.3.5 target= 2021-02-13T18:06:37.075 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:06:37.076 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:06:37.076 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:06:37.254 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:06:37.254 WARNING:rgw_multi.tests:bucket ejuwhf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.3.5 target= 2021-02-13T18:06:42.255 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:06:42.255 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:06:42.256 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:06:42.435 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:06:42.435 WARNING:rgw_multi.tests:bucket ejuwhf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.3.5 target= 2021-02-13T18:06:47.435 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:06:47.436 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:06:47.436 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:06:47.617 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:06:47.617 WARNING:rgw_multi.tests:bucket ejuwhf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.3.5 target= 2021-02-13T18:06:52.618 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:06:52.618 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:06:52.618 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:06:52.799 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:06:52.799 WARNING:rgw_multi.tests:bucket ejuwhf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.3.5 target= 2021-02-13T18:06:57.800 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:06:57.800 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:06:57.801 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:06:57.981 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:06:57.981 WARNING:rgw_multi.tests:bucket ejuwhf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.3.5 target= 2021-02-13T18:07:02.982 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:07:02.983 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:07:02.983 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:07:03.165 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:07:03.165 WARNING:rgw_multi.tests:bucket ejuwhf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.3.5 target= 2021-02-13T18:07:08.167 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:07:08.167 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:07:08.167 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:07:08.348 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:07:08.349 WARNING:rgw_multi.tests:bucket ejuwhf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.3.5 target= 2021-02-13T18:07:13.350 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:07:13.350 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:07:13.351 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:07:13.530 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:07:13.530 WARNING:rgw_multi.tests:bucket ejuwhf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.3.5 target= 2021-02-13T18:07:18.532 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:07:18.532 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:07:18.532 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:07:18.713 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:07:18.713 WARNING:rgw_multi.tests:bucket ejuwhf-14 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.3.5 target= 2021-02-13T18:07:23.715 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.tests.test_object_delete ... FAIL 2021-02-13T18:07:23.716 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=ejuwhf-16 2021-02-13T18:07:23.784 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=ejuwhf-17 2021-02-13T18:07:23.886 INFO:rgw_multi.tests:create bucket zone=test-zone3 name=ejuwhf-18 2021-02-13T18:07:24.087 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:07:24.087 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:07:24.087 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:07:24.182 INFO:teuthology.orchestra.run.gibba025.stderr:No --period given, using current period=138dc4ba-dc02-4957-87c3-e8bf2d80917c 2021-02-13T18:07:24.199 INFO:teuthology.orchestra.run.gibba025.stdout:[{"marker":"1_1613238836.394578_31.1","last_update":"2021-02-13 17:53:56.394578Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613238989.770436_129.1","last_update":"2021-02-13 17:56:29.770436Z"},{"marker":"1_1613239644.070890_76.1","last_update":"2021-02-13 18:07:24.070890Z"}] 2021-02-13T18:07:24.199 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-02-13T18:07:24.199 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:07:24.199 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:07:24.200 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:07:24.285 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"138dc4ba-dc02-4957-87c3-e8bf2d80917c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613239321.305535_49.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:02:01.305535Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:07:24.285 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=3 master=1_1613239644.070890_76.1 target=1_1613239321.305535_49.1 2021-02-13T18:07:29.286 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:07:29.286 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:07:29.287 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:07:29.369 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"138dc4ba-dc02-4957-87c3-e8bf2d80917c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613239644.070890_76.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:07:24.070890Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:07:29.369 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-02-13T18:07:29.369 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-02-13T18:07:29.369 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:07:29.369 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:07:29.370 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:07:29.457 INFO:teuthology.orchestra.run.gibba025.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"138dc4ba-dc02-4957-87c3-e8bf2d80917c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613239644.070890_76.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:07:24.070890Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:07:29.457 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-02-13T18:07:29.457 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T18:07:29.457 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:07:29.457 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:07:29.457 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:07:29.634 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"138dc4ba-dc02-4957-87c3-e8bf2d80917c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613239644.070890_76.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:07:24.070890Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:07:29.635 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T18:07:30.487 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-16', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:07:30.487 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-16', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:07:30.487 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ejuwhf-16 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:07:30.601 INFO:teuthology.orchestra.run.gibba025.stdout:{"markers":[{"key":0,"val":"00000000003.3.10"}]} 2021-02-13T18:07:30.601 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=ejuwhf-16 2021-02-13T18:07:30.601 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-16', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:07:30.601 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-16', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:07:30.602 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ejuwhf-16 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:07:30.691 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:07:30.692 WARNING:rgw_multi.tests:bucket ejuwhf-16 zone test-zone2 behind zone test-zone1: shard=0 master=00000000003.3.10 target= 2021-02-13T18:07:35.693 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-16', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:07:35.693 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-16', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:07:35.694 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ejuwhf-16 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:07:35.816 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"dummy","instance":"OwXZvX17uyGCuOQxoKv5y14.w5llw4D","ns":""},"count":1},"inc_marker":{"position":"00000000006.9.9"}}}] 2021-02-13T18:07:35.816 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=ejuwhf-16 2021-02-13T18:07:35.816 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-16', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:07:35.816 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-16', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:07:35.817 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ejuwhf-16 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:07:35.903 INFO:teuthology.orchestra.run.gibba025.stdout:{"markers":[{"key":0,"val":"00000000006.9.9"}]} 2021-02-13T18:07:35.903 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=ejuwhf-16 2021-02-13T18:07:35.904 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-16', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:07:35.904 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-16', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:07:35.904 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ejuwhf-16 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:07:35.981 INFO:teuthology.orchestra.run.gibba025.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"dummy","instance":"OwXZvX17uyGCuOQxoKv5y14.w5llw4D","ns":""},"count":1},"inc_marker":{"position":"00000000006.9.9"}}}] 2021-02-13T18:07:35.982 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=ejuwhf-16 2021-02-13T18:07:35.982 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-16', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:07:35.982 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-16', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:07:35.982 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ejuwhf-16 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:07:36.072 INFO:teuthology.orchestra.run.gibba025.stdout:{"markers":[{"key":0,"val":"00000000006.9.9"}]} 2021-02-13T18:07:36.073 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone4 source_zone=test-zone1 bucket=ejuwhf-16 2021-02-13T18:07:36.073 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-16', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:07:36.073 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-16', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:07:36.073 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ejuwhf-16 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:07:36.293 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"dummy","instance":"OwXZvX17uyGCuOQxoKv5y14.w5llw4D","ns":""},"count":1},"inc_marker":{"position":"00000000006.9.9"}}}] 2021-02-13T18:07:36.294 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone4 source_zone=test-zone1 bucket=ejuwhf-16 2021-02-13T18:07:37.059 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:07:37.060 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:07:37.060 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ejuwhf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:07:37.175 INFO:teuthology.orchestra.run.gibba036.stdout:{"markers":[{"key":0,"val":"00000000003.8.10"}]} 2021-02-13T18:07:37.176 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=ejuwhf-17 2021-02-13T18:07:37.176 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:07:37.176 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:07:37.176 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-17 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:07:37.264 INFO:teuthology.orchestra.run.gibba025.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:07:37.264 WARNING:rgw_multi.tests:bucket ejuwhf-17 zone test-zone1 behind zone test-zone2: shard=0 master=00000000003.8.10 target= 2021-02-13T18:07:42.265 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:07:42.265 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:07:42.265 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-17 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:07:42.351 INFO:teuthology.orchestra.run.gibba025.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"dummy","instance":"RqXJP.JVbMykD50U1ApJjKXKrlmVnLl","ns":""},"count":1},"inc_marker":{"position":"00000000006.14.9"}}}] 2021-02-13T18:07:42.352 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=ejuwhf-17 2021-02-13T18:07:42.352 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:07:42.352 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:07:42.352 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ejuwhf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:07:42.438 INFO:teuthology.orchestra.run.gibba036.stdout:{"markers":[{"key":0,"val":"00000000006.14.9"}]} 2021-02-13T18:07:42.439 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone2 bucket=ejuwhf-17 2021-02-13T18:07:42.439 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:07:42.439 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:07:42.439 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-17 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:07:42.566 INFO:teuthology.orchestra.run.gibba025.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"dummy","instance":"RqXJP.JVbMykD50U1ApJjKXKrlmVnLl","ns":""},"count":1},"inc_marker":{"position":"00000000006.14.9"}}}] 2021-02-13T18:07:42.567 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone2 bucket=ejuwhf-17 2021-02-13T18:07:42.567 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:07:42.567 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:07:42.567 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ejuwhf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:07:42.650 INFO:teuthology.orchestra.run.gibba036.stdout:{"markers":[{"key":0,"val":"00000000006.14.9"}]} 2021-02-13T18:07:42.650 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone4 source_zone=test-zone2 bucket=ejuwhf-17 2021-02-13T18:07:42.650 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:07:42.650 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:07:42.651 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:07:42.822 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:07:42.822 WARNING:rgw_multi.tests:bucket ejuwhf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000006.14.9 target= 2021-02-13T18:07:47.824 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:07:47.824 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:07:47.824 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:07:48.001 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:07:48.002 WARNING:rgw_multi.tests:bucket ejuwhf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000006.14.9 target= 2021-02-13T18:07:53.003 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:07:53.003 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:07:53.003 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:07:53.175 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:07:53.175 WARNING:rgw_multi.tests:bucket ejuwhf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000006.14.9 target= 2021-02-13T18:07:58.176 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:07:58.176 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:07:58.176 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:07:58.349 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:07:58.349 WARNING:rgw_multi.tests:bucket ejuwhf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000006.14.9 target= 2021-02-13T18:08:03.351 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:08:03.351 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:08:03.351 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:08:03.532 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:08:03.533 WARNING:rgw_multi.tests:bucket ejuwhf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000006.14.9 target= 2021-02-13T18:08:08.534 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:08:08.534 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:08:08.534 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:08:08.709 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:08:08.709 WARNING:rgw_multi.tests:bucket ejuwhf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000006.14.9 target= 2021-02-13T18:08:13.710 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:08:13.710 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:08:13.711 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:08:13.885 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:08:13.886 WARNING:rgw_multi.tests:bucket ejuwhf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000006.14.9 target= 2021-02-13T18:08:18.887 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:08:18.887 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:08:18.887 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:08:19.067 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:08:19.068 WARNING:rgw_multi.tests:bucket ejuwhf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000006.14.9 target= 2021-02-13T18:08:24.069 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:08:24.069 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:08:24.069 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:08:24.243 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:08:24.243 WARNING:rgw_multi.tests:bucket ejuwhf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000006.14.9 target= 2021-02-13T18:08:29.244 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:08:29.244 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:08:29.244 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:08:29.421 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:08:29.422 WARNING:rgw_multi.tests:bucket ejuwhf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000006.14.9 target= 2021-02-13T18:08:34.423 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:08:34.423 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:08:34.423 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:08:34.603 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:08:34.603 WARNING:rgw_multi.tests:bucket ejuwhf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000006.14.9 target= 2021-02-13T18:08:39.604 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:08:39.604 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:08:39.604 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:08:39.779 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:08:39.779 WARNING:rgw_multi.tests:bucket ejuwhf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000006.14.9 target= 2021-02-13T18:08:44.781 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:08:44.781 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:08:44.781 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:08:44.962 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:08:44.962 WARNING:rgw_multi.tests:bucket ejuwhf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000006.14.9 target= 2021-02-13T18:08:49.964 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:08:49.964 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:08:49.964 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:08:50.142 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:08:50.142 WARNING:rgw_multi.tests:bucket ejuwhf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000006.14.9 target= 2021-02-13T18:08:55.143 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:08:55.143 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:08:55.143 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:08:55.319 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:08:55.319 WARNING:rgw_multi.tests:bucket ejuwhf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000006.14.9 target= 2021-02-13T18:09:00.320 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:09:00.321 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:09:00.321 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:09:00.501 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:09:00.501 WARNING:rgw_multi.tests:bucket ejuwhf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000006.14.9 target= 2021-02-13T18:09:05.502 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:09:05.502 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:09:05.502 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:09:05.677 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:09:05.677 WARNING:rgw_multi.tests:bucket ejuwhf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000006.14.9 target= 2021-02-13T18:09:10.678 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:09:10.678 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:09:10.679 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:09:10.859 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:09:10.860 WARNING:rgw_multi.tests:bucket ejuwhf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000006.14.9 target= 2021-02-13T18:09:15.861 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:09:15.861 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:09:15.861 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:09:16.034 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:09:16.034 WARNING:rgw_multi.tests:bucket ejuwhf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000006.14.9 target= 2021-02-13T18:09:21.034 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:09:21.035 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:09:21.035 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:09:21.211 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:09:21.211 WARNING:rgw_multi.tests:bucket ejuwhf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000006.14.9 target= 2021-02-13T18:09:26.212 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:09:26.213 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:09:26.213 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:09:26.394 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:09:26.394 WARNING:rgw_multi.tests:bucket ejuwhf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000006.14.9 target= 2021-02-13T18:09:31.395 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:09:31.395 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:09:31.396 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:09:31.571 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:09:31.571 WARNING:rgw_multi.tests:bucket ejuwhf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000006.14.9 target= 2021-02-13T18:09:36.571 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:09:36.572 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:09:36.572 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:09:36.753 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:09:36.753 WARNING:rgw_multi.tests:bucket ejuwhf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000006.14.9 target= 2021-02-13T18:09:41.754 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:09:41.754 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:09:41.754 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:09:41.936 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:09:41.937 WARNING:rgw_multi.tests:bucket ejuwhf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000006.14.9 target= 2021-02-13T18:09:46.938 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:09:46.938 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:09:46.939 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:09:47.170 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:09:47.170 WARNING:rgw_multi.tests:bucket ejuwhf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000006.14.9 target= 2021-02-13T18:09:52.172 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:09:52.172 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:09:52.172 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:09:52.353 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:09:52.353 WARNING:rgw_multi.tests:bucket ejuwhf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000006.14.9 target= 2021-02-13T18:09:57.355 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:09:57.355 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:09:57.355 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:09:57.536 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:09:57.537 WARNING:rgw_multi.tests:bucket ejuwhf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000006.14.9 target= 2021-02-13T18:10:02.537 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:10:02.538 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:10:02.538 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:10:02.719 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:10:02.719 WARNING:rgw_multi.tests:bucket ejuwhf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000006.14.9 target= 2021-02-13T18:10:07.720 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:10:07.720 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:10:07.720 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:10:07.894 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:10:07.895 WARNING:rgw_multi.tests:bucket ejuwhf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000006.14.9 target= 2021-02-13T18:10:12.896 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:10:12.896 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:10:12.896 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:10:13.066 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:10:13.066 WARNING:rgw_multi.tests:bucket ejuwhf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000006.14.9 target= 2021-02-13T18:10:18.068 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:10:18.068 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:10:18.068 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:10:18.241 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:10:18.241 WARNING:rgw_multi.tests:bucket ejuwhf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000006.14.9 target= 2021-02-13T18:10:23.242 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:10:23.242 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:10:23.243 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:10:23.419 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:10:23.420 WARNING:rgw_multi.tests:bucket ejuwhf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000006.14.9 target= 2021-02-13T18:10:28.421 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:10:28.421 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:10:28.421 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:10:28.601 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:10:28.602 WARNING:rgw_multi.tests:bucket ejuwhf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000006.14.9 target= 2021-02-13T18:10:33.602 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:10:33.602 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:10:33.603 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:10:33.777 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:10:33.777 WARNING:rgw_multi.tests:bucket ejuwhf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000006.14.9 target= 2021-02-13T18:10:38.778 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:10:38.778 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:10:38.778 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:10:38.953 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:10:38.953 WARNING:rgw_multi.tests:bucket ejuwhf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000006.14.9 target= 2021-02-13T18:10:43.954 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:10:43.954 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:10:43.955 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:10:44.136 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:10:44.136 WARNING:rgw_multi.tests:bucket ejuwhf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000006.14.9 target= 2021-02-13T18:10:49.137 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:10:49.137 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:10:49.138 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:10:49.312 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:10:49.312 WARNING:rgw_multi.tests:bucket ejuwhf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000006.14.9 target= 2021-02-13T18:10:54.313 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:10:54.314 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:10:54.314 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:10:54.494 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:10:54.494 WARNING:rgw_multi.tests:bucket ejuwhf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000006.14.9 target= 2021-02-13T18:10:59.496 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:10:59.496 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:10:59.496 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:10:59.678 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:10:59.678 WARNING:rgw_multi.tests:bucket ejuwhf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000006.14.9 target= 2021-02-13T18:11:04.680 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:11:04.680 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:11:04.680 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:11:04.859 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:11:04.860 WARNING:rgw_multi.tests:bucket ejuwhf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000006.14.9 target= 2021-02-13T18:11:09.861 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:11:09.861 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:11:09.861 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:11:10.041 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:11:10.043 WARNING:rgw_multi.tests:bucket ejuwhf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000006.14.9 target= 2021-02-13T18:11:15.044 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:11:15.044 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:11:15.044 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:11:15.228 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:11:15.228 WARNING:rgw_multi.tests:bucket ejuwhf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000006.14.9 target= 2021-02-13T18:11:20.229 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:11:20.229 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:11:20.230 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:11:20.414 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:11:20.414 WARNING:rgw_multi.tests:bucket ejuwhf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000006.14.9 target= 2021-02-13T18:11:25.415 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:11:25.415 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:11:25.416 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:11:25.598 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:11:25.598 WARNING:rgw_multi.tests:bucket ejuwhf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000006.14.9 target= 2021-02-13T18:11:30.599 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:11:30.599 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:11:30.600 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:11:30.774 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:11:30.775 WARNING:rgw_multi.tests:bucket ejuwhf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000006.14.9 target= 2021-02-13T18:11:35.775 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:11:35.776 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:11:35.776 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:11:35.955 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:11:35.956 WARNING:rgw_multi.tests:bucket ejuwhf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000006.14.9 target= 2021-02-13T18:11:40.956 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:11:40.982 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:11:40.982 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:11:41.161 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:11:41.162 WARNING:rgw_multi.tests:bucket ejuwhf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000006.14.9 target= 2021-02-13T18:11:46.163 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:11:46.164 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:11:46.164 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:11:46.341 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:11:46.341 WARNING:rgw_multi.tests:bucket ejuwhf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000006.14.9 target= 2021-02-13T18:11:51.342 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:11:51.342 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:11:51.342 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:11:51.525 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:11:51.526 WARNING:rgw_multi.tests:bucket ejuwhf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000006.14.9 target= 2021-02-13T18:11:56.527 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:11:56.527 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:11:56.528 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:11:56.707 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:11:56.707 WARNING:rgw_multi.tests:bucket ejuwhf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000006.14.9 target= 2021-02-13T18:12:01.708 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:12:01.709 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:12:01.709 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:12:01.889 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:12:01.889 WARNING:rgw_multi.tests:bucket ejuwhf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000006.14.9 target= 2021-02-13T18:12:06.890 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:12:06.890 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:12:06.891 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:12:07.070 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:12:07.071 WARNING:rgw_multi.tests:bucket ejuwhf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000006.14.9 target= 2021-02-13T18:12:12.072 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:12:12.072 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:12:12.072 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:12:12.249 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:12:12.250 WARNING:rgw_multi.tests:bucket ejuwhf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000006.14.9 target= 2021-02-13T18:12:17.251 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:12:17.251 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:12:17.252 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:12:17.430 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:12:17.431 WARNING:rgw_multi.tests:bucket ejuwhf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000006.14.9 target= 2021-02-13T18:12:22.432 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:12:22.432 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:12:22.432 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:12:22.609 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:12:22.609 WARNING:rgw_multi.tests:bucket ejuwhf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000006.14.9 target= 2021-02-13T18:12:27.611 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:12:27.611 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:12:27.611 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:12:27.790 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:12:27.790 WARNING:rgw_multi.tests:bucket ejuwhf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000006.14.9 target= 2021-02-13T18:12:32.792 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:12:32.792 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:12:32.792 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:12:32.974 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:12:32.975 WARNING:rgw_multi.tests:bucket ejuwhf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000006.14.9 target= 2021-02-13T18:12:37.975 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:12:37.975 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:12:37.976 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:12:38.159 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:12:38.159 WARNING:rgw_multi.tests:bucket ejuwhf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000006.14.9 target= 2021-02-13T18:12:43.160 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:12:43.160 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:12:43.161 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:12:43.342 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:12:43.342 WARNING:rgw_multi.tests:bucket ejuwhf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000006.14.9 target= 2021-02-13T18:12:48.343 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:12:48.343 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:12:48.344 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:12:48.526 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:12:48.527 WARNING:rgw_multi.tests:bucket ejuwhf-17 zone test-zone4 behind zone test-zone2: shard=0 master=00000000006.14.9 target= 2021-02-13T18:12:53.529 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.tests.test_versioned_object_incremental_sync ... FAIL 2021-02-13T18:12:53.640 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:12:53.640 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:12:53.641 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:12:53.736 INFO:teuthology.orchestra.run.gibba025.stderr:No --period given, using current period=138dc4ba-dc02-4957-87c3-e8bf2d80917c 2021-02-13T18:12:53.752 INFO:teuthology.orchestra.run.gibba025.stdout:[{"marker":"1_1613238836.394578_31.1","last_update":"2021-02-13 17:53:56.394578Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613238989.770436_129.1","last_update":"2021-02-13 17:56:29.770436Z"},{"marker":"1_1613239973.634814_89.1","last_update":"2021-02-13 18:12:53.634814Z"}] 2021-02-13T18:12:53.752 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-02-13T18:12:53.752 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:12:53.752 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:12:53.752 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:12:53.838 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"138dc4ba-dc02-4957-87c3-e8bf2d80917c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613239644.070890_76.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:07:24.070890Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:12:53.839 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=3 master=1_1613239973.634814_89.1 target=1_1613239644.070890_76.1 2021-02-13T18:12:58.839 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:12:58.840 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:12:58.840 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:12:58.925 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"138dc4ba-dc02-4957-87c3-e8bf2d80917c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613239973.634814_89.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:12:53.634814Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:12:58.926 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-02-13T18:12:58.926 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-02-13T18:12:58.926 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:12:58.926 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:12:58.927 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:12:59.003 INFO:teuthology.orchestra.run.gibba025.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"138dc4ba-dc02-4957-87c3-e8bf2d80917c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613239973.634814_89.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:12:53.634814Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:12:59.004 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-02-13T18:12:59.004 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T18:12:59.004 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:12:59.004 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:12:59.004 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:12:59.219 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"138dc4ba-dc02-4957-87c3-e8bf2d80917c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613239973.634814_89.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:12:53.634814Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:12:59.219 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T18:12:59.911 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-19', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:12:59.911 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-19', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:12:59.912 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ejuwhf-19 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:13:00.029 INFO:teuthology.orchestra.run.gibba025.stdout:{"markers":[{"key":0,"val":"00000000003.3.10"}]} 2021-02-13T18:13:00.029 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=ejuwhf-19 2021-02-13T18:13:00.029 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:13:00.030 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:13:00.030 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ejuwhf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:13:00.114 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:13:00.114 WARNING:rgw_multi.tests:bucket ejuwhf-19 zone test-zone2 behind zone test-zone1: shard=0 master=00000000003.3.10 target= 2021-02-13T18:13:05.115 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:13:05.115 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:13:05.116 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ejuwhf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:13:05.205 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"dummy","instance":"DiUFwWFeb37RSN0f724WDHMpRzI7J86","ns":""},"count":1},"inc_marker":{"position":"00000000007.11.9"}}}] 2021-02-13T18:13:05.206 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=ejuwhf-19 2021-02-13T18:13:05.206 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-19', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:13:05.206 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-19', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:13:05.206 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ejuwhf-19 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:13:05.297 INFO:teuthology.orchestra.run.gibba025.stdout:{"markers":[{"key":0,"val":"00000000007.11.9"}]} 2021-02-13T18:13:05.297 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=ejuwhf-19 2021-02-13T18:13:05.297 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-19', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:13:05.297 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-19', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:13:05.298 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ejuwhf-19 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:13:05.377 INFO:teuthology.orchestra.run.gibba025.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"dummy","instance":"DiUFwWFeb37RSN0f724WDHMpRzI7J86","ns":""},"count":1},"inc_marker":{"position":"00000000007.11.9"}}}] 2021-02-13T18:13:05.377 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=ejuwhf-19 2021-02-13T18:13:05.377 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-19', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:13:05.377 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-19', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:13:05.378 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ejuwhf-19 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:13:05.449 INFO:teuthology.orchestra.run.gibba025.stdout:{"markers":[{"key":0,"val":"00000000007.11.9"}]} 2021-02-13T18:13:05.449 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone4 source_zone=test-zone1 bucket=ejuwhf-19 2021-02-13T18:13:05.449 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:13:05.449 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:13:05.449 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ejuwhf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:13:05.625 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"dummy","instance":"DiUFwWFeb37RSN0f724WDHMpRzI7J86","ns":""},"count":1},"inc_marker":{"position":"00000000007.11.9"}}}] 2021-02-13T18:13:05.626 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone4 source_zone=test-zone1 bucket=ejuwhf-19 2021-02-13T18:13:05.626 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:13:05.626 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:13:05.626 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ejuwhf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:13:05.750 INFO:teuthology.orchestra.run.gibba036.stdout:{"markers":[{"key":0,"val":"00000000005.8.9"}]} 2021-02-13T18:13:05.751 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=ejuwhf-19 2021-02-13T18:13:05.751 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:13:05.751 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:13:05.751 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-19 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:13:05.836 INFO:teuthology.orchestra.run.gibba025.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"dummy","instance":"DiUFwWFeb37RSN0f724WDHMpRzI7J86","ns":""},"count":1},"inc_marker":{"position":"00000000005.8.9"}}}] 2021-02-13T18:13:05.836 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=ejuwhf-19 2021-02-13T18:13:05.837 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:13:05.837 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:13:05.837 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ejuwhf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:13:05.936 INFO:teuthology.orchestra.run.gibba036.stdout:{"markers":[{"key":0,"val":"00000000005.8.9"}]} 2021-02-13T18:13:05.937 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone2 bucket=ejuwhf-19 2021-02-13T18:13:05.937 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:13:05.937 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:13:05.937 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-19 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:13:06.062 INFO:teuthology.orchestra.run.gibba025.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"dummy","instance":"DiUFwWFeb37RSN0f724WDHMpRzI7J86","ns":""},"count":1},"inc_marker":{"position":"00000000005.8.9"}}}] 2021-02-13T18:13:06.062 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone2 bucket=ejuwhf-19 2021-02-13T18:13:06.063 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:13:06.063 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:13:06.063 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ejuwhf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:13:06.183 INFO:teuthology.orchestra.run.gibba036.stdout:{"markers":[{"key":0,"val":"00000000005.8.9"}]} 2021-02-13T18:13:06.183 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone4 source_zone=test-zone2 bucket=ejuwhf-19 2021-02-13T18:13:06.183 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:13:06.184 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:13:06.184 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:13:06.353 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:13:06.353 WARNING:rgw_multi.tests:bucket ejuwhf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T18:13:11.354 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:13:11.354 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:13:11.354 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:13:11.528 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:13:11.528 WARNING:rgw_multi.tests:bucket ejuwhf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T18:13:16.529 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:13:16.529 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:13:16.530 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:13:16.712 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:13:16.712 WARNING:rgw_multi.tests:bucket ejuwhf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T18:13:21.713 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:13:21.714 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:13:21.714 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:13:21.890 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:13:21.890 WARNING:rgw_multi.tests:bucket ejuwhf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T18:13:26.891 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:13:26.891 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:13:26.892 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:13:27.074 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:13:27.074 WARNING:rgw_multi.tests:bucket ejuwhf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T18:13:32.075 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:13:32.075 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:13:32.076 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:13:32.256 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:13:32.257 WARNING:rgw_multi.tests:bucket ejuwhf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T18:13:37.257 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:13:37.257 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:13:37.258 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:13:37.438 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:13:37.438 WARNING:rgw_multi.tests:bucket ejuwhf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T18:13:42.439 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:13:42.439 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:13:42.440 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:13:42.626 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:13:42.626 WARNING:rgw_multi.tests:bucket ejuwhf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T18:13:47.627 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:13:47.627 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:13:47.627 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:13:47.807 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:13:47.808 WARNING:rgw_multi.tests:bucket ejuwhf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T18:13:52.808 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:13:52.809 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:13:52.809 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:13:52.984 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:13:52.984 WARNING:rgw_multi.tests:bucket ejuwhf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T18:13:57.985 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:13:57.985 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:13:57.985 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:13:58.402 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:13:58.402 WARNING:rgw_multi.tests:bucket ejuwhf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T18:14:03.403 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:14:03.403 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:14:03.403 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:14:03.588 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:14:03.588 WARNING:rgw_multi.tests:bucket ejuwhf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T18:14:08.589 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:14:08.590 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:14:08.590 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:14:08.773 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:14:08.774 WARNING:rgw_multi.tests:bucket ejuwhf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T18:14:13.775 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:14:13.775 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:14:13.775 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:14:13.955 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:14:13.956 WARNING:rgw_multi.tests:bucket ejuwhf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T18:14:18.956 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:14:18.956 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:14:18.956 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:14:19.138 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:14:19.138 WARNING:rgw_multi.tests:bucket ejuwhf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T18:14:24.139 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:14:24.139 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:14:24.140 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:14:24.317 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:14:24.318 WARNING:rgw_multi.tests:bucket ejuwhf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T18:14:29.319 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:14:29.319 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:14:29.319 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:14:29.502 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:14:29.502 WARNING:rgw_multi.tests:bucket ejuwhf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T18:14:34.503 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:14:34.503 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:14:34.504 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:14:34.687 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:14:34.688 WARNING:rgw_multi.tests:bucket ejuwhf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T18:14:39.688 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:14:39.688 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:14:39.689 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:14:39.871 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:14:39.871 WARNING:rgw_multi.tests:bucket ejuwhf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T18:14:44.872 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:14:44.872 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:14:44.872 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:14:45.056 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:14:45.056 WARNING:rgw_multi.tests:bucket ejuwhf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T18:14:50.058 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:14:50.058 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:14:50.058 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:14:50.231 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:14:50.231 WARNING:rgw_multi.tests:bucket ejuwhf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T18:14:55.232 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:14:55.232 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:14:55.232 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:14:55.412 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:14:55.412 WARNING:rgw_multi.tests:bucket ejuwhf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T18:15:00.413 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:15:00.414 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:15:00.414 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:15:00.595 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:15:00.596 WARNING:rgw_multi.tests:bucket ejuwhf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T18:15:05.597 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:15:05.597 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:15:05.597 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:15:05.779 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:15:05.779 WARNING:rgw_multi.tests:bucket ejuwhf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T18:15:10.781 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:15:10.781 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:15:10.781 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:15:10.964 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:15:10.964 WARNING:rgw_multi.tests:bucket ejuwhf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T18:15:15.965 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:15:15.965 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:15:15.966 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:15:16.139 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:15:16.140 WARNING:rgw_multi.tests:bucket ejuwhf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T18:15:21.141 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:15:21.141 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:15:21.142 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:15:21.319 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:15:21.319 WARNING:rgw_multi.tests:bucket ejuwhf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T18:15:26.320 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:15:26.320 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:15:26.320 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:15:26.504 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:15:26.504 WARNING:rgw_multi.tests:bucket ejuwhf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T18:15:31.505 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:15:31.505 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:15:31.505 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:15:31.688 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:15:31.688 WARNING:rgw_multi.tests:bucket ejuwhf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T18:15:36.689 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:15:36.689 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:15:36.690 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:15:36.871 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:15:36.871 WARNING:rgw_multi.tests:bucket ejuwhf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T18:15:41.871 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:15:41.872 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:15:41.872 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:15:42.051 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:15:42.051 WARNING:rgw_multi.tests:bucket ejuwhf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T18:15:47.052 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:15:47.052 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:15:47.052 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:15:47.237 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:15:47.238 WARNING:rgw_multi.tests:bucket ejuwhf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T18:15:52.239 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:15:52.239 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:15:52.240 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:15:52.425 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:15:53.235 WARNING:rgw_multi.tests:bucket ejuwhf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T18:15:58.236 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:15:58.236 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:15:58.237 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:15:58.413 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:15:58.414 WARNING:rgw_multi.tests:bucket ejuwhf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T18:16:03.414 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:16:03.415 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:16:03.415 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:16:03.594 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:16:03.594 WARNING:rgw_multi.tests:bucket ejuwhf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T18:16:08.594 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:16:08.595 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:16:08.595 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:16:08.780 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:16:08.780 WARNING:rgw_multi.tests:bucket ejuwhf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T18:16:13.782 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:16:13.782 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:16:13.782 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:16:13.963 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:16:13.963 WARNING:rgw_multi.tests:bucket ejuwhf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T18:16:18.964 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:16:18.964 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:16:18.964 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:16:19.145 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:16:19.145 WARNING:rgw_multi.tests:bucket ejuwhf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T18:16:24.147 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:16:24.147 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:16:24.147 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:16:24.324 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:16:24.325 WARNING:rgw_multi.tests:bucket ejuwhf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T18:16:29.325 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:16:29.325 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:16:29.326 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:16:29.508 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:16:29.509 WARNING:rgw_multi.tests:bucket ejuwhf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T18:16:34.510 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:16:34.510 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:16:34.511 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:16:34.687 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:16:34.687 WARNING:rgw_multi.tests:bucket ejuwhf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T18:16:39.688 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:16:39.688 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:16:39.688 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:16:39.872 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:16:39.873 WARNING:rgw_multi.tests:bucket ejuwhf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T18:16:44.874 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:16:44.874 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:16:44.875 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:16:45.055 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:16:45.055 WARNING:rgw_multi.tests:bucket ejuwhf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T18:16:50.056 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:16:50.057 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:16:50.057 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:16:50.228 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:16:50.228 WARNING:rgw_multi.tests:bucket ejuwhf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T18:16:55.229 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:16:55.230 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:16:55.230 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:16:55.413 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:16:55.413 WARNING:rgw_multi.tests:bucket ejuwhf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T18:17:00.414 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:17:00.414 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:17:00.415 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:17:00.635 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:17:00.636 WARNING:rgw_multi.tests:bucket ejuwhf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T18:17:05.637 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:17:05.637 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:17:05.637 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:17:05.813 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:17:05.814 WARNING:rgw_multi.tests:bucket ejuwhf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T18:17:10.814 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:17:10.815 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:17:10.815 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:17:10.994 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:17:10.995 WARNING:rgw_multi.tests:bucket ejuwhf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T18:17:15.995 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:17:15.996 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:17:15.996 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:17:16.180 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:17:16.180 WARNING:rgw_multi.tests:bucket ejuwhf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T18:17:21.181 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:17:21.182 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:17:21.182 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:17:21.359 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:17:21.359 WARNING:rgw_multi.tests:bucket ejuwhf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T18:17:26.360 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:17:26.360 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:17:26.360 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:17:26.546 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:17:26.547 WARNING:rgw_multi.tests:bucket ejuwhf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T18:17:31.547 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:17:31.548 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:17:31.548 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:17:31.731 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:17:31.731 WARNING:rgw_multi.tests:bucket ejuwhf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T18:17:36.732 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:17:36.732 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:17:36.733 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:17:36.916 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:17:36.917 WARNING:rgw_multi.tests:bucket ejuwhf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T18:17:41.917 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:17:41.917 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:17:41.918 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:17:42.096 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:17:42.096 WARNING:rgw_multi.tests:bucket ejuwhf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T18:17:47.097 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:17:47.097 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:17:47.097 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:17:47.276 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:17:47.276 WARNING:rgw_multi.tests:bucket ejuwhf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T18:17:52.277 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:17:52.277 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:17:52.278 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:17:52.459 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:17:52.459 WARNING:rgw_multi.tests:bucket ejuwhf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T18:17:57.460 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:17:57.461 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:17:57.461 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:17:57.642 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:17:57.643 WARNING:rgw_multi.tests:bucket ejuwhf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T18:18:02.644 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:18:02.644 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:18:02.644 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:18:02.821 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:18:02.822 WARNING:rgw_multi.tests:bucket ejuwhf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T18:18:07.823 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:18:07.823 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:18:07.823 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:18:07.997 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:18:07.998 WARNING:rgw_multi.tests:bucket ejuwhf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T18:18:12.999 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:18:12.999 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-19', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:18:12.999 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-19 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:18:13.180 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:18:13.180 WARNING:rgw_multi.tests:bucket ejuwhf-19 zone test-zone4 behind zone test-zone2: shard=0 master=00000000005.8.9 target= 2021-02-13T18:18:18.183 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.tests.test_concurrent_versioned_object_incremental_sync ... FAIL 2021-02-13T18:18:18.250 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:18:18.250 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:18:18.251 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:18:18.352 INFO:teuthology.orchestra.run.gibba025.stderr:No --period given, using current period=138dc4ba-dc02-4957-87c3-e8bf2d80917c 2021-02-13T18:18:18.368 INFO:teuthology.orchestra.run.gibba025.stdout:[{"marker":"1_1613238836.394578_31.1","last_update":"2021-02-13 17:53:56.394578Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613238989.770436_129.1","last_update":"2021-02-13 17:56:29.770436Z"},{"marker":"1_1613240298.236365_99.1","last_update":"2021-02-13 18:18:18.236365Z"}] 2021-02-13T18:18:18.368 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-02-13T18:18:18.368 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:18:18.368 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:18:18.369 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:18:18.456 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"138dc4ba-dc02-4957-87c3-e8bf2d80917c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613239973.634814_89.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:12:53.634814Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:18:18.456 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=3 master=1_1613240298.236365_99.1 target=1_1613239973.634814_89.1 2021-02-13T18:18:23.457 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:18:23.458 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:18:23.458 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:18:23.543 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"138dc4ba-dc02-4957-87c3-e8bf2d80917c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613240298.236365_99.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:18:18.236365Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:18:23.544 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-02-13T18:18:23.544 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-02-13T18:18:23.544 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:18:23.544 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:18:23.544 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:18:23.627 INFO:teuthology.orchestra.run.gibba025.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"138dc4ba-dc02-4957-87c3-e8bf2d80917c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613240298.236365_99.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:18:18.236365Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:18:23.627 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-02-13T18:18:23.627 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T18:18:23.627 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:18:23.627 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:18:23.628 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:18:23.808 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"138dc4ba-dc02-4957-87c3-e8bf2d80917c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613240298.236365_99.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:18:18.236365Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:18:23.808 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T18:18:24.059 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-20', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:18:24.059 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-20', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:18:24.059 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ejuwhf-20 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:18:24.177 INFO:teuthology.orchestra.run.gibba025.stdout:{"markers":[{"key":0,"val":"00000000002.8.5"}]} 2021-02-13T18:18:24.177 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=ejuwhf-20 2021-02-13T18:18:24.178 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:18:24.178 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:18:24.178 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ejuwhf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:18:24.263 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:18:24.264 WARNING:rgw_multi.tests:bucket ejuwhf-20 zone test-zone2 behind zone test-zone1: shard=0 master=00000000002.8.5 target= 2021-02-13T18:18:29.265 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:18:29.265 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:18:29.265 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ejuwhf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:18:29.353 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj","instance":"","ns":""},"count":1},"inc_marker":{"position":"0#00000000002.8.5"}}}] 2021-02-13T18:18:29.354 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=ejuwhf-20 2021-02-13T18:18:29.354 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-20', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:18:29.354 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-20', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:18:29.354 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ejuwhf-20 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:18:29.440 INFO:teuthology.orchestra.run.gibba025.stdout:{"markers":[{"key":0,"val":"00000000002.8.5"}]} 2021-02-13T18:18:29.441 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=ejuwhf-20 2021-02-13T18:18:29.441 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-20', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:18:29.441 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-20', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:18:29.441 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ejuwhf-20 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:18:29.531 INFO:teuthology.orchestra.run.gibba025.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj","instance":"","ns":""},"count":1},"inc_marker":{"position":"0#00000000002.8.5"}}}] 2021-02-13T18:18:29.532 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=ejuwhf-20 2021-02-13T18:18:29.532 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-20', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:18:29.532 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-20', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:18:29.532 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ejuwhf-20 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:18:29.627 INFO:teuthology.orchestra.run.gibba025.stdout:{"markers":[{"key":0,"val":"00000000002.8.5"}]} 2021-02-13T18:18:29.627 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone4 source_zone=test-zone1 bucket=ejuwhf-20 2021-02-13T18:18:29.627 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:18:29.627 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:18:29.628 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ejuwhf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:18:29.811 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj","instance":"","ns":""},"count":1},"inc_marker":{"position":"0#00000000002.8.5"}}}] 2021-02-13T18:18:29.811 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone4 source_zone=test-zone1 bucket=ejuwhf-20 2021-02-13T18:18:29.811 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:18:29.811 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:18:29.811 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ejuwhf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:18:29.906 INFO:teuthology.orchestra.run.gibba036.stdout:{"markers":[{"key":0,"val":"00000000002.7.5"}]} 2021-02-13T18:18:29.906 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=ejuwhf-20 2021-02-13T18:18:29.907 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:18:29.907 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:18:29.907 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-20 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:18:29.999 INFO:teuthology.orchestra.run.gibba025.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj","instance":"","ns":""},"count":1},"inc_marker":{"position":"0#00000000002.7.5"}}}] 2021-02-13T18:18:30.000 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=ejuwhf-20 2021-02-13T18:18:30.000 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:18:30.000 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:18:30.000 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ejuwhf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:18:30.118 INFO:teuthology.orchestra.run.gibba036.stdout:{"markers":[{"key":0,"val":"00000000002.7.5"}]} 2021-02-13T18:18:30.118 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone2 bucket=ejuwhf-20 2021-02-13T18:18:30.118 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:18:30.118 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:18:30.119 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-20 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:18:30.208 INFO:teuthology.orchestra.run.gibba025.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj","instance":"","ns":""},"count":1},"inc_marker":{"position":"0#00000000002.7.5"}}}] 2021-02-13T18:18:30.208 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone2 bucket=ejuwhf-20 2021-02-13T18:18:30.208 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:18:30.208 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:18:30.208 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ejuwhf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:18:30.328 INFO:teuthology.orchestra.run.gibba036.stdout:{"markers":[{"key":0,"val":"00000000002.7.5"}]} 2021-02-13T18:18:30.328 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone4 source_zone=test-zone2 bucket=ejuwhf-20 2021-02-13T18:18:30.329 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:18:30.329 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:18:30.329 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:18:30.508 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:18:30.508 WARNING:rgw_multi.tests:bucket ejuwhf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.7.5 target= 2021-02-13T18:18:35.508 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:18:35.509 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:18:35.509 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:18:35.693 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:18:35.693 WARNING:rgw_multi.tests:bucket ejuwhf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.7.5 target= 2021-02-13T18:18:40.694 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:18:40.694 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:18:40.695 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:18:40.875 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:18:40.875 WARNING:rgw_multi.tests:bucket ejuwhf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.7.5 target= 2021-02-13T18:18:45.876 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:18:45.876 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:18:45.877 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:18:46.059 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:18:46.060 WARNING:rgw_multi.tests:bucket ejuwhf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.7.5 target= 2021-02-13T18:18:51.061 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:18:51.061 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:18:51.061 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:18:51.246 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:18:51.246 WARNING:rgw_multi.tests:bucket ejuwhf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.7.5 target= 2021-02-13T18:18:56.247 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:18:56.247 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:18:56.247 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:18:56.429 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:18:56.430 WARNING:rgw_multi.tests:bucket ejuwhf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.7.5 target= 2021-02-13T18:19:01.431 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:19:01.432 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:19:01.432 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:19:01.608 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:19:01.608 WARNING:rgw_multi.tests:bucket ejuwhf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.7.5 target= 2021-02-13T18:19:06.610 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:19:06.610 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:19:06.610 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:19:06.786 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:19:06.787 WARNING:rgw_multi.tests:bucket ejuwhf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.7.5 target= 2021-02-13T18:19:11.788 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:19:11.788 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:19:11.788 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:19:11.967 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:19:11.967 WARNING:rgw_multi.tests:bucket ejuwhf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.7.5 target= 2021-02-13T18:19:16.968 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:19:16.968 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:19:16.969 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:19:17.149 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:19:17.149 WARNING:rgw_multi.tests:bucket ejuwhf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.7.5 target= 2021-02-13T18:19:22.149 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:19:22.150 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:19:22.150 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:19:22.333 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:19:22.333 WARNING:rgw_multi.tests:bucket ejuwhf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.7.5 target= 2021-02-13T18:19:27.334 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:19:27.334 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:19:27.335 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:19:27.515 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:19:27.515 WARNING:rgw_multi.tests:bucket ejuwhf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.7.5 target= 2021-02-13T18:19:32.515 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:19:32.516 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:19:32.516 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:19:32.703 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:19:32.703 WARNING:rgw_multi.tests:bucket ejuwhf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.7.5 target= 2021-02-13T18:19:37.704 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:19:37.704 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:19:37.705 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:19:37.890 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:19:37.890 WARNING:rgw_multi.tests:bucket ejuwhf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.7.5 target= 2021-02-13T18:19:42.892 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:19:42.892 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:19:42.892 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:19:43.070 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:19:43.071 WARNING:rgw_multi.tests:bucket ejuwhf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.7.5 target= 2021-02-13T18:19:48.072 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:19:48.072 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:19:48.072 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:19:48.256 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:19:48.256 WARNING:rgw_multi.tests:bucket ejuwhf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.7.5 target= 2021-02-13T18:19:53.257 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:19:53.258 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:19:53.258 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:19:53.441 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:19:53.442 WARNING:rgw_multi.tests:bucket ejuwhf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.7.5 target= 2021-02-13T18:19:58.443 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:19:58.443 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:19:58.443 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:19:58.626 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:19:58.626 WARNING:rgw_multi.tests:bucket ejuwhf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.7.5 target= 2021-02-13T18:20:03.627 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:20:03.628 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:20:03.628 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:20:03.801 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:20:03.802 WARNING:rgw_multi.tests:bucket ejuwhf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.7.5 target= 2021-02-13T18:20:08.803 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:20:08.803 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:20:08.803 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:20:08.986 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:20:08.987 WARNING:rgw_multi.tests:bucket ejuwhf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.7.5 target= 2021-02-13T18:20:13.988 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:20:13.988 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:20:13.988 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:20:14.172 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:20:14.520 WARNING:rgw_multi.tests:bucket ejuwhf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.7.5 target= 2021-02-13T18:20:19.521 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:20:19.522 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:20:19.522 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:20:19.704 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:20:19.704 WARNING:rgw_multi.tests:bucket ejuwhf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.7.5 target= 2021-02-13T18:20:24.706 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:20:24.706 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:20:24.706 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:20:24.888 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:20:24.888 WARNING:rgw_multi.tests:bucket ejuwhf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.7.5 target= 2021-02-13T18:20:29.889 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:20:29.889 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:20:29.890 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:20:30.074 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:20:30.075 WARNING:rgw_multi.tests:bucket ejuwhf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.7.5 target= 2021-02-13T18:20:35.076 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:20:35.076 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:20:35.076 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:20:35.259 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:20:35.259 WARNING:rgw_multi.tests:bucket ejuwhf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.7.5 target= 2021-02-13T18:20:40.260 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:20:40.260 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:20:40.261 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:20:40.436 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:20:40.437 WARNING:rgw_multi.tests:bucket ejuwhf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.7.5 target= 2021-02-13T18:20:45.438 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:20:45.438 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:20:45.439 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:20:45.621 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:20:45.622 WARNING:rgw_multi.tests:bucket ejuwhf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.7.5 target= 2021-02-13T18:20:50.622 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:20:50.623 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:20:50.623 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:20:50.801 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:20:50.802 WARNING:rgw_multi.tests:bucket ejuwhf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.7.5 target= 2021-02-13T18:20:55.803 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:20:55.803 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:20:55.804 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:20:55.985 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:20:55.985 WARNING:rgw_multi.tests:bucket ejuwhf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.7.5 target= 2021-02-13T18:21:00.987 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:21:00.987 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:21:00.988 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:21:01.172 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:21:01.173 WARNING:rgw_multi.tests:bucket ejuwhf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.7.5 target= 2021-02-13T18:21:06.174 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:21:06.174 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:21:06.175 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:21:06.356 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:21:06.356 WARNING:rgw_multi.tests:bucket ejuwhf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.7.5 target= 2021-02-13T18:21:11.357 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:21:11.357 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:21:11.357 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:21:11.540 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:21:11.540 WARNING:rgw_multi.tests:bucket ejuwhf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.7.5 target= 2021-02-13T18:21:16.541 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:21:16.541 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:21:16.541 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:21:16.725 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:21:16.725 WARNING:rgw_multi.tests:bucket ejuwhf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.7.5 target= 2021-02-13T18:21:21.726 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:21:21.726 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:21:21.726 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:21:21.901 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:21:21.901 WARNING:rgw_multi.tests:bucket ejuwhf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.7.5 target= 2021-02-13T18:21:26.902 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:21:26.902 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:21:26.902 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:21:27.080 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:21:27.081 WARNING:rgw_multi.tests:bucket ejuwhf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.7.5 target= 2021-02-13T18:21:32.082 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:21:32.082 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:21:32.083 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:21:32.265 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:21:32.266 WARNING:rgw_multi.tests:bucket ejuwhf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.7.5 target= 2021-02-13T18:21:37.267 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:21:37.267 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:21:37.267 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:21:37.449 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:21:37.450 WARNING:rgw_multi.tests:bucket ejuwhf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.7.5 target= 2021-02-13T18:21:42.451 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:21:42.451 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:21:42.451 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:21:42.627 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:21:42.628 WARNING:rgw_multi.tests:bucket ejuwhf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.7.5 target= 2021-02-13T18:21:47.628 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:21:47.629 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:21:47.629 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:21:47.812 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:21:47.813 WARNING:rgw_multi.tests:bucket ejuwhf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.7.5 target= 2021-02-13T18:21:52.813 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:21:52.814 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:21:52.814 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:21:52.996 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:21:52.997 WARNING:rgw_multi.tests:bucket ejuwhf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.7.5 target= 2021-02-13T18:21:57.998 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:21:57.998 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:21:57.999 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:21:58.183 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:21:58.183 WARNING:rgw_multi.tests:bucket ejuwhf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.7.5 target= 2021-02-13T18:22:03.184 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:22:03.185 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:22:03.185 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:22:03.363 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:22:03.363 WARNING:rgw_multi.tests:bucket ejuwhf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.7.5 target= 2021-02-13T18:22:08.364 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:22:08.364 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:22:08.364 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:22:08.546 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:22:08.546 WARNING:rgw_multi.tests:bucket ejuwhf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.7.5 target= 2021-02-13T18:22:13.547 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:22:13.548 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:22:13.548 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:22:13.733 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:22:13.734 WARNING:rgw_multi.tests:bucket ejuwhf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.7.5 target= 2021-02-13T18:22:18.735 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:22:18.735 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:22:18.735 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:22:18.912 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:22:18.912 WARNING:rgw_multi.tests:bucket ejuwhf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.7.5 target= 2021-02-13T18:22:23.913 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:22:23.913 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:22:23.913 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:22:24.094 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:22:24.094 WARNING:rgw_multi.tests:bucket ejuwhf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.7.5 target= 2021-02-13T18:22:29.095 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:22:29.096 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:22:29.096 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:22:29.278 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:22:29.278 WARNING:rgw_multi.tests:bucket ejuwhf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.7.5 target= 2021-02-13T18:22:34.279 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:22:34.279 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:22:34.279 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:22:34.462 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:22:34.463 WARNING:rgw_multi.tests:bucket ejuwhf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.7.5 target= 2021-02-13T18:22:39.463 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:22:39.463 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:22:39.464 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:22:39.641 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:22:39.642 WARNING:rgw_multi.tests:bucket ejuwhf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.7.5 target= 2021-02-13T18:22:44.643 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:22:44.643 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:22:44.643 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:22:44.823 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:22:44.823 WARNING:rgw_multi.tests:bucket ejuwhf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.7.5 target= 2021-02-13T18:22:49.824 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:22:49.824 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:22:49.824 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:22:50.008 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:22:50.009 WARNING:rgw_multi.tests:bucket ejuwhf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.7.5 target= 2021-02-13T18:22:55.010 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:22:55.010 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:22:55.010 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:22:55.186 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:22:55.187 WARNING:rgw_multi.tests:bucket ejuwhf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.7.5 target= 2021-02-13T18:23:00.187 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:23:00.187 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:23:00.188 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:23:00.369 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:23:00.369 WARNING:rgw_multi.tests:bucket ejuwhf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.7.5 target= 2021-02-13T18:23:05.370 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:23:05.370 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:23:05.370 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:23:05.553 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:23:05.554 WARNING:rgw_multi.tests:bucket ejuwhf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.7.5 target= 2021-02-13T18:23:10.555 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:23:10.555 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:23:10.555 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:23:10.738 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:23:10.738 WARNING:rgw_multi.tests:bucket ejuwhf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.7.5 target= 2021-02-13T18:23:15.739 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:23:15.740 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:23:15.740 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:23:15.922 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:23:15.923 WARNING:rgw_multi.tests:bucket ejuwhf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.7.5 target= 2021-02-13T18:23:20.923 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:23:20.924 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:23:20.924 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:23:21.099 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:23:21.100 WARNING:rgw_multi.tests:bucket ejuwhf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.7.5 target= 2021-02-13T18:23:26.100 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:23:26.101 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:23:26.101 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:23:26.284 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:23:26.284 WARNING:rgw_multi.tests:bucket ejuwhf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.7.5 target= 2021-02-13T18:23:31.285 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:23:31.286 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:23:31.286 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:23:31.459 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:23:31.460 WARNING:rgw_multi.tests:bucket ejuwhf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.7.5 target= 2021-02-13T18:23:36.460 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:23:36.461 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-20', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:23:36.461 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-20 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:23:36.637 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:23:36.638 WARNING:rgw_multi.tests:bucket ejuwhf-20 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.7.5 target= 2021-02-13T18:23:41.640 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.tests.test_version_suspended_incremental_sync ... FAIL 2021-02-13T18:23:41.641 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=ejuwhf-21 2021-02-13T18:23:41.706 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=ejuwhf-22 2021-02-13T18:23:41.823 INFO:rgw_multi.tests:create bucket zone=test-zone3 name=ejuwhf-23 2021-02-13T18:23:42.050 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:23:42.050 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:23:42.051 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:23:42.153 INFO:teuthology.orchestra.run.gibba025.stderr:No --period given, using current period=138dc4ba-dc02-4957-87c3-e8bf2d80917c 2021-02-13T18:23:42.168 INFO:teuthology.orchestra.run.gibba025.stdout:[{"marker":"1_1613238836.394578_31.1","last_update":"2021-02-13 17:53:56.394578Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613238989.770436_129.1","last_update":"2021-02-13 17:56:29.770436Z"},{"marker":"1_1613240622.031550_120.1","last_update":"2021-02-13 18:23:42.031550Z"}] 2021-02-13T18:23:42.169 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-02-13T18:23:42.169 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:23:42.169 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:23:42.169 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:23:42.254 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"138dc4ba-dc02-4957-87c3-e8bf2d80917c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613240298.236365_99.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:18:18.236365Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:23:42.255 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=3 master=1_1613240622.031550_120.1 target=1_1613240298.236365_99.1 2021-02-13T18:23:47.255 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:23:47.256 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:23:47.256 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:23:47.342 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"138dc4ba-dc02-4957-87c3-e8bf2d80917c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613240622.031550_120.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:23:42.031550Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:23:47.342 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-02-13T18:23:47.342 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-02-13T18:23:47.342 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:23:47.342 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:23:47.343 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:23:47.427 INFO:teuthology.orchestra.run.gibba025.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"138dc4ba-dc02-4957-87c3-e8bf2d80917c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613240622.031550_120.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:23:42.031550Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:23:47.427 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-02-13T18:23:47.427 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T18:23:47.427 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:23:47.427 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:23:47.428 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:23:47.608 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"138dc4ba-dc02-4957-87c3-e8bf2d80917c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613240622.031550_120.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:23:42.031550Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:23:47.608 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T18:23:49.822 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-21', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:23:49.822 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-21', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:23:49.823 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ejuwhf-21 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:23:49.926 INFO:teuthology.orchestra.run.gibba025.stdout:{"markers":[{"key":0,"val":"00000000004.5.11"}]} 2021-02-13T18:23:49.927 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=ejuwhf-21 2021-02-13T18:23:49.927 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:23:49.927 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:23:49.927 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ejuwhf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:23:50.046 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj","instance":"ilVInRRmZ0kTkYwpXhmy35h7wdxvCCZ","ns":""},"count":1},"inc_marker":{"position":"0#00000000004.5.11"}}}] 2021-02-13T18:23:50.046 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=ejuwhf-21 2021-02-13T18:23:50.047 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-21', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:23:50.047 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-21', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:23:50.047 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ejuwhf-21 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:23:50.162 INFO:teuthology.orchestra.run.gibba025.stdout:{"markers":[{"key":0,"val":"00000000004.5.11"}]} 2021-02-13T18:23:50.162 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=ejuwhf-21 2021-02-13T18:23:50.162 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-21', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:23:50.163 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-21', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:23:50.163 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ejuwhf-21 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:23:50.241 INFO:teuthology.orchestra.run.gibba025.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj","instance":"ilVInRRmZ0kTkYwpXhmy35h7wdxvCCZ","ns":""},"count":1},"inc_marker":{"position":"0#00000000004.5.11"}}}] 2021-02-13T18:23:50.241 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=ejuwhf-21 2021-02-13T18:23:50.241 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-21', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:23:50.241 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-21', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:23:50.242 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ejuwhf-21 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:23:50.323 INFO:teuthology.orchestra.run.gibba025.stdout:{"markers":[{"key":0,"val":"00000000004.5.11"}]} 2021-02-13T18:23:50.323 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone4 source_zone=test-zone1 bucket=ejuwhf-21 2021-02-13T18:23:50.324 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:23:50.324 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:23:50.324 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ejuwhf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:23:50.536 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj","instance":"ilVInRRmZ0kTkYwpXhmy35h7wdxvCCZ","ns":""},"count":1},"inc_marker":{"position":"0#00000000004.5.11"}}}] 2021-02-13T18:23:50.536 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone4 source_zone=test-zone1 bucket=ejuwhf-21 2021-02-13T18:23:50.537 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:23:50.537 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:23:50.537 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ejuwhf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:23:50.650 INFO:teuthology.orchestra.run.gibba036.stdout:{"markers":[{"key":0,"val":"00000000003.4.5"}]} 2021-02-13T18:23:50.650 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=ejuwhf-21 2021-02-13T18:23:50.650 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:23:50.651 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:23:50.651 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-21 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:23:50.766 INFO:teuthology.orchestra.run.gibba025.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj","instance":"ilVInRRmZ0kTkYwpXhmy35h7wdxvCCZ","ns":""},"count":1},"inc_marker":{"position":"0#00000000003.4.5"}}}] 2021-02-13T18:23:50.766 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=ejuwhf-21 2021-02-13T18:23:50.767 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:23:50.767 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:23:50.767 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ejuwhf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:23:50.881 INFO:teuthology.orchestra.run.gibba036.stdout:{"markers":[{"key":0,"val":"00000000003.4.5"}]} 2021-02-13T18:23:50.882 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone2 bucket=ejuwhf-21 2021-02-13T18:23:50.882 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:23:50.882 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:23:50.882 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-21 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:23:50.955 INFO:teuthology.orchestra.run.gibba025.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj","instance":"ilVInRRmZ0kTkYwpXhmy35h7wdxvCCZ","ns":""},"count":1},"inc_marker":{"position":"0#00000000003.4.5"}}}] 2021-02-13T18:23:50.955 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone2 bucket=ejuwhf-21 2021-02-13T18:23:50.956 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:23:50.956 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:23:50.956 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ejuwhf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:23:51.040 INFO:teuthology.orchestra.run.gibba036.stdout:{"markers":[{"key":0,"val":"00000000003.4.5"}]} 2021-02-13T18:23:51.040 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone4 source_zone=test-zone2 bucket=ejuwhf-21 2021-02-13T18:23:51.040 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:23:51.040 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:23:51.041 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:23:51.206 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:23:51.206 WARNING:rgw_multi.tests:bucket ejuwhf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.4.5 target= 2021-02-13T18:23:56.207 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:23:56.208 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:23:56.208 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:23:56.394 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:23:56.394 WARNING:rgw_multi.tests:bucket ejuwhf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.4.5 target= 2021-02-13T18:24:01.395 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:24:01.395 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:24:01.395 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:24:01.577 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:24:01.577 WARNING:rgw_multi.tests:bucket ejuwhf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.4.5 target= 2021-02-13T18:24:06.579 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:24:06.579 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:24:06.579 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:24:06.762 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:24:06.762 WARNING:rgw_multi.tests:bucket ejuwhf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.4.5 target= 2021-02-13T18:24:11.763 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:24:11.763 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:24:11.763 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:24:11.944 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:24:11.944 WARNING:rgw_multi.tests:bucket ejuwhf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.4.5 target= 2021-02-13T18:24:16.945 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:24:16.945 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:24:16.946 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:24:17.119 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:24:17.120 WARNING:rgw_multi.tests:bucket ejuwhf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.4.5 target= 2021-02-13T18:24:22.120 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:24:22.121 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:24:22.121 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:24:22.306 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:24:22.306 WARNING:rgw_multi.tests:bucket ejuwhf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.4.5 target= 2021-02-13T18:24:27.307 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:24:27.308 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:24:27.308 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:24:27.491 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:24:27.491 WARNING:rgw_multi.tests:bucket ejuwhf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.4.5 target= 2021-02-13T18:24:32.492 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:24:32.492 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:24:32.493 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:24:32.668 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:24:32.668 WARNING:rgw_multi.tests:bucket ejuwhf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.4.5 target= 2021-02-13T18:24:37.669 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:24:37.670 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:24:37.670 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:24:37.847 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:24:37.848 WARNING:rgw_multi.tests:bucket ejuwhf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.4.5 target= 2021-02-13T18:24:42.848 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:24:42.849 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:24:42.849 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:24:43.028 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:24:43.029 WARNING:rgw_multi.tests:bucket ejuwhf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.4.5 target= 2021-02-13T18:24:48.029 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:24:48.030 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:24:48.030 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:24:48.212 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:24:48.212 WARNING:rgw_multi.tests:bucket ejuwhf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.4.5 target= 2021-02-13T18:24:53.214 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:24:53.214 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:24:53.214 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:24:53.395 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:24:53.396 WARNING:rgw_multi.tests:bucket ejuwhf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.4.5 target= 2021-02-13T18:24:58.397 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:24:58.397 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:24:58.397 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:24:58.578 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:24:58.578 WARNING:rgw_multi.tests:bucket ejuwhf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.4.5 target= 2021-02-13T18:25:03.579 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:25:03.579 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:25:03.579 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:25:03.764 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:25:03.764 WARNING:rgw_multi.tests:bucket ejuwhf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.4.5 target= 2021-02-13T18:25:08.765 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:25:08.765 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:25:08.765 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:25:08.947 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:25:08.947 WARNING:rgw_multi.tests:bucket ejuwhf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.4.5 target= 2021-02-13T18:25:13.948 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:25:13.948 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:25:13.949 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:25:14.125 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:25:14.125 WARNING:rgw_multi.tests:bucket ejuwhf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.4.5 target= 2021-02-13T18:25:19.127 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:25:19.127 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:25:19.127 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:25:19.305 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:25:19.305 WARNING:rgw_multi.tests:bucket ejuwhf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.4.5 target= 2021-02-13T18:25:24.307 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:25:24.307 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:25:24.307 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:25:24.490 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:25:24.490 WARNING:rgw_multi.tests:bucket ejuwhf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.4.5 target= 2021-02-13T18:25:29.491 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:25:29.491 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:25:29.492 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:25:29.675 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:25:29.675 WARNING:rgw_multi.tests:bucket ejuwhf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.4.5 target= 2021-02-13T18:25:34.676 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:25:34.676 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:25:34.676 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:25:34.864 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:25:34.864 WARNING:rgw_multi.tests:bucket ejuwhf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.4.5 target= 2021-02-13T18:25:39.865 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:25:39.865 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:25:39.865 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:25:40.042 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:25:40.042 WARNING:rgw_multi.tests:bucket ejuwhf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.4.5 target= 2021-02-13T18:25:45.042 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:25:45.043 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:25:45.043 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:25:45.227 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:25:45.227 WARNING:rgw_multi.tests:bucket ejuwhf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.4.5 target= 2021-02-13T18:25:50.228 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:25:50.228 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:25:50.228 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:25:50.405 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:25:50.405 WARNING:rgw_multi.tests:bucket ejuwhf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.4.5 target= 2021-02-13T18:25:55.406 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:25:55.406 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:25:55.406 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:25:55.593 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:25:55.593 WARNING:rgw_multi.tests:bucket ejuwhf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.4.5 target= 2021-02-13T18:26:00.594 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:26:00.595 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:26:00.595 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:26:00.778 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:26:00.779 WARNING:rgw_multi.tests:bucket ejuwhf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.4.5 target= 2021-02-13T18:26:05.779 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:26:05.780 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:26:05.780 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:26:05.954 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:26:05.955 WARNING:rgw_multi.tests:bucket ejuwhf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.4.5 target= 2021-02-13T18:26:10.956 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:26:10.956 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:26:10.956 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:26:11.139 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:26:11.140 WARNING:rgw_multi.tests:bucket ejuwhf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.4.5 target= 2021-02-13T18:26:16.141 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:26:16.141 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:26:16.141 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:26:16.326 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:26:16.326 WARNING:rgw_multi.tests:bucket ejuwhf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.4.5 target= 2021-02-13T18:26:21.327 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:26:21.327 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:26:21.328 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:26:21.509 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:26:21.510 WARNING:rgw_multi.tests:bucket ejuwhf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.4.5 target= 2021-02-13T18:26:26.510 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:26:26.510 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:26:26.511 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:26:26.694 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:26:26.694 WARNING:rgw_multi.tests:bucket ejuwhf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.4.5 target= 2021-02-13T18:26:31.695 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:26:31.695 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:26:31.695 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:26:31.879 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:26:31.879 WARNING:rgw_multi.tests:bucket ejuwhf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.4.5 target= 2021-02-13T18:26:36.880 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:26:36.880 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:26:36.880 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:26:37.059 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:26:37.059 WARNING:rgw_multi.tests:bucket ejuwhf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.4.5 target= 2021-02-13T18:26:42.060 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:26:42.061 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:26:42.061 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:26:42.243 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:26:42.243 WARNING:rgw_multi.tests:bucket ejuwhf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.4.5 target= 2021-02-13T18:26:47.244 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:26:47.244 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:26:47.245 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:26:47.427 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:26:47.428 WARNING:rgw_multi.tests:bucket ejuwhf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.4.5 target= 2021-02-13T18:26:52.428 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:26:52.428 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:26:52.429 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:26:52.612 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:26:52.612 WARNING:rgw_multi.tests:bucket ejuwhf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.4.5 target= 2021-02-13T18:26:57.613 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:26:57.614 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:26:57.614 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:26:57.796 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:26:57.797 WARNING:rgw_multi.tests:bucket ejuwhf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.4.5 target= 2021-02-13T18:27:02.798 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:27:02.798 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:27:02.798 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:27:02.976 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:27:02.976 WARNING:rgw_multi.tests:bucket ejuwhf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.4.5 target= 2021-02-13T18:27:07.977 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:27:07.977 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:27:07.978 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:27:08.154 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:27:08.154 WARNING:rgw_multi.tests:bucket ejuwhf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.4.5 target= 2021-02-13T18:27:13.155 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:27:13.156 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:27:13.156 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:27:13.335 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:27:13.335 WARNING:rgw_multi.tests:bucket ejuwhf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.4.5 target= 2021-02-13T18:27:18.336 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:27:18.337 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:27:18.337 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:27:18.520 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:27:18.520 WARNING:rgw_multi.tests:bucket ejuwhf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.4.5 target= 2021-02-13T18:27:23.521 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:27:23.522 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:27:23.522 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:27:23.702 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:27:23.703 WARNING:rgw_multi.tests:bucket ejuwhf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.4.5 target= 2021-02-13T18:27:28.704 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:27:28.704 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:27:28.705 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:27:28.925 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:27:28.925 WARNING:rgw_multi.tests:bucket ejuwhf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.4.5 target= 2021-02-13T18:27:33.926 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:27:33.926 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:27:33.927 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:27:34.105 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:27:34.106 WARNING:rgw_multi.tests:bucket ejuwhf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.4.5 target= 2021-02-13T18:27:39.106 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:27:39.107 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:27:39.107 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:27:39.283 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:27:39.283 WARNING:rgw_multi.tests:bucket ejuwhf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.4.5 target= 2021-02-13T18:27:44.285 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:27:44.285 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:27:44.285 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:27:44.466 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:27:44.467 WARNING:rgw_multi.tests:bucket ejuwhf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.4.5 target= 2021-02-13T18:27:49.468 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:27:49.468 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:27:49.468 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:27:49.651 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:27:49.652 WARNING:rgw_multi.tests:bucket ejuwhf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.4.5 target= 2021-02-13T18:27:54.653 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:27:54.653 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:27:54.653 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:27:54.828 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:27:54.829 WARNING:rgw_multi.tests:bucket ejuwhf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.4.5 target= 2021-02-13T18:27:59.830 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:27:59.830 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:27:59.831 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:28:00.010 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:28:00.010 WARNING:rgw_multi.tests:bucket ejuwhf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.4.5 target= 2021-02-13T18:28:05.011 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:05.012 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:05.012 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:28:05.194 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:28:05.194 WARNING:rgw_multi.tests:bucket ejuwhf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.4.5 target= 2021-02-13T18:28:10.195 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:10.195 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:10.195 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:28:10.379 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:28:10.379 WARNING:rgw_multi.tests:bucket ejuwhf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.4.5 target= 2021-02-13T18:28:15.379 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:15.380 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:15.380 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:28:15.558 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:28:15.559 WARNING:rgw_multi.tests:bucket ejuwhf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.4.5 target= 2021-02-13T18:28:20.559 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:20.560 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:20.560 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:28:20.744 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:28:20.744 WARNING:rgw_multi.tests:bucket ejuwhf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.4.5 target= 2021-02-13T18:28:25.745 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:25.745 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:25.746 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:28:25.928 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:28:25.928 WARNING:rgw_multi.tests:bucket ejuwhf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.4.5 target= 2021-02-13T18:28:30.930 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:30.930 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:30.930 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:28:31.114 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:28:31.115 WARNING:rgw_multi.tests:bucket ejuwhf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.4.5 target= 2021-02-13T18:28:36.116 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:36.116 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:36.117 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:28:36.297 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:28:36.297 WARNING:rgw_multi.tests:bucket ejuwhf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.4.5 target= 2021-02-13T18:28:41.297 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:41.298 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:41.298 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:28:41.484 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:28:41.485 WARNING:rgw_multi.tests:bucket ejuwhf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.4.5 target= 2021-02-13T18:28:46.485 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:46.486 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:46.486 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:28:46.662 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:28:46.663 WARNING:rgw_multi.tests:bucket ejuwhf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.4.5 target= 2021-02-13T18:28:51.664 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:51.664 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:51.664 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:28:51.843 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:28:51.843 WARNING:rgw_multi.tests:bucket ejuwhf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.4.5 target= 2021-02-13T18:28:56.844 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:56.844 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-21', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:28:56.844 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-21 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:28:57.024 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:28:57.025 WARNING:rgw_multi.tests:bucket ejuwhf-21 zone test-zone4 behind zone test-zone2: shard=0 master=00000000003.4.5 target= 2021-02-13T18:29:02.029 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.tests.test_delete_marker_full_sync ... FAIL 2021-02-13T18:29:02.030 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=ejuwhf-24 2021-02-13T18:29:02.109 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=ejuwhf-25 2021-02-13T18:29:02.216 INFO:rgw_multi.tests:create bucket zone=test-zone3 name=ejuwhf-26 2021-02-13T18:29:02.533 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:02.533 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:02.533 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:29:02.632 INFO:teuthology.orchestra.run.gibba025.stderr:No --period given, using current period=138dc4ba-dc02-4957-87c3-e8bf2d80917c 2021-02-13T18:29:02.646 INFO:teuthology.orchestra.run.gibba025.stdout:[{"marker":"1_1613238836.394578_31.1","last_update":"2021-02-13 17:53:56.394578Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613238989.770436_129.1","last_update":"2021-02-13 17:56:29.770436Z"},{"marker":"1_1613240942.515439_152.1","last_update":"2021-02-13 18:29:02.515439Z"}] 2021-02-13T18:29:02.647 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-02-13T18:29:02.647 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:02.647 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:02.647 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:29:02.728 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"138dc4ba-dc02-4957-87c3-e8bf2d80917c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613240622.031550_120.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:23:42.031550Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:29:02.728 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=3 master=1_1613240942.515439_152.1 target=1_1613240622.031550_120.1 2021-02-13T18:29:07.729 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:07.729 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:07.730 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:29:07.814 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"138dc4ba-dc02-4957-87c3-e8bf2d80917c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613240942.515439_152.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:29:02.515439Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:29:07.815 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-02-13T18:29:07.815 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-02-13T18:29:07.815 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:07.815 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:07.815 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:29:07.898 INFO:teuthology.orchestra.run.gibba025.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"138dc4ba-dc02-4957-87c3-e8bf2d80917c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613240942.515439_152.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:29:02.515439Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:29:07.899 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-02-13T18:29:07.899 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T18:29:07.899 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:07.899 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:07.900 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:29:08.077 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"138dc4ba-dc02-4957-87c3-e8bf2d80917c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613240942.515439_152.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:29:02.515439Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:29:08.078 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T18:29:09.250 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-24', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:09.250 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-24', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:09.250 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ejuwhf-24 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:29:09.364 INFO:teuthology.orchestra.run.gibba025.stdout:{"markers":[{"key":0,"val":"00000000005.7.6"}]} 2021-02-13T18:29:09.364 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=ejuwhf-24 2021-02-13T18:29:09.364 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:09.364 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:09.365 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ejuwhf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:29:09.453 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:29:09.454 WARNING:rgw_multi.tests:bucket ejuwhf-24 zone test-zone2 behind zone test-zone1: shard=0 master=00000000005.7.6 target= 2021-02-13T18:29:14.455 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:14.456 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:14.456 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ejuwhf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:29:14.549 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj","instance":"null","ns":""},"count":1},"inc_marker":{"position":"0#00000000005.7.6"}}}] 2021-02-13T18:29:14.549 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=ejuwhf-24 2021-02-13T18:29:14.549 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-24', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:14.550 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-24', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:14.550 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ejuwhf-24 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:29:14.632 INFO:teuthology.orchestra.run.gibba025.stdout:{"markers":[{"key":0,"val":"00000000005.7.6"}]} 2021-02-13T18:29:14.632 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=ejuwhf-24 2021-02-13T18:29:14.632 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-24', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:14.633 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-24', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:14.633 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ejuwhf-24 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:29:14.725 INFO:teuthology.orchestra.run.gibba025.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj","instance":"null","ns":""},"count":1},"inc_marker":{"position":"0#00000000005.7.6"}}}] 2021-02-13T18:29:14.725 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=ejuwhf-24 2021-02-13T18:29:14.726 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-24', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:14.726 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-24', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:14.726 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ejuwhf-24 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:29:14.834 INFO:teuthology.orchestra.run.gibba025.stdout:{"markers":[{"key":0,"val":"00000000005.7.6"}]} 2021-02-13T18:29:14.834 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone4 source_zone=test-zone1 bucket=ejuwhf-24 2021-02-13T18:29:14.834 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:14.834 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:14.835 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ejuwhf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:29:15.017 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj","instance":"null","ns":""},"count":1},"inc_marker":{"position":"0#00000000005.7.6"}}}] 2021-02-13T18:29:15.018 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone4 source_zone=test-zone1 bucket=ejuwhf-24 2021-02-13T18:29:15.018 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:15.018 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:15.018 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ejuwhf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:29:15.093 INFO:teuthology.orchestra.run.gibba036.stdout:{"markers":[{"key":0,"val":"00000000001.1.12"}]} 2021-02-13T18:29:15.093 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=ejuwhf-24 2021-02-13T18:29:15.093 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:15.093 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:15.094 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-24 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:29:15.223 INFO:teuthology.orchestra.run.gibba025.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj","instance":"null","ns":""},"count":1},"inc_marker":{"position":"0#00000000001.1.12"}}}] 2021-02-13T18:29:15.223 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=ejuwhf-24 2021-02-13T18:29:15.223 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:15.223 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:15.223 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ejuwhf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:29:15.310 INFO:teuthology.orchestra.run.gibba036.stdout:{"markers":[{"key":0,"val":"00000000001.1.12"}]} 2021-02-13T18:29:15.310 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone2 bucket=ejuwhf-24 2021-02-13T18:29:15.310 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:15.310 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:15.310 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-24 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:29:15.441 INFO:teuthology.orchestra.run.gibba025.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj","instance":"null","ns":""},"count":1},"inc_marker":{"position":"0#00000000001.1.12"}}}] 2021-02-13T18:29:15.441 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone2 bucket=ejuwhf-24 2021-02-13T18:29:15.441 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:15.441 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:15.442 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ejuwhf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:29:15.561 INFO:teuthology.orchestra.run.gibba036.stdout:{"markers":[{"key":0,"val":"00000000001.1.12"}]} 2021-02-13T18:29:15.561 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone4 source_zone=test-zone2 bucket=ejuwhf-24 2021-02-13T18:29:15.561 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:15.562 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:15.562 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:29:15.734 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:29:15.734 WARNING:rgw_multi.tests:bucket ejuwhf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.1.12 target= 2021-02-13T18:29:20.735 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:20.735 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:20.736 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:29:20.913 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:29:20.913 WARNING:rgw_multi.tests:bucket ejuwhf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.1.12 target= 2021-02-13T18:29:25.914 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:25.914 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:25.915 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:29:26.097 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:29:26.098 WARNING:rgw_multi.tests:bucket ejuwhf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.1.12 target= 2021-02-13T18:29:31.099 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:31.099 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:31.099 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:29:31.283 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:29:31.284 WARNING:rgw_multi.tests:bucket ejuwhf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.1.12 target= 2021-02-13T18:29:36.284 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:36.285 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:36.285 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:29:36.467 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:29:36.468 WARNING:rgw_multi.tests:bucket ejuwhf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.1.12 target= 2021-02-13T18:29:41.469 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:41.469 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:41.470 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:29:41.648 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:29:41.648 WARNING:rgw_multi.tests:bucket ejuwhf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.1.12 target= 2021-02-13T18:29:46.649 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:46.649 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:46.649 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:29:46.829 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:29:46.830 WARNING:rgw_multi.tests:bucket ejuwhf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.1.12 target= 2021-02-13T18:29:51.831 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:51.831 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:51.832 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:29:52.016 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:29:52.017 WARNING:rgw_multi.tests:bucket ejuwhf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.1.12 target= 2021-02-13T18:29:57.018 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:57.018 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:29:57.018 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:29:57.201 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:29:57.201 WARNING:rgw_multi.tests:bucket ejuwhf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.1.12 target= 2021-02-13T18:30:02.203 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:02.203 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:02.203 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:30:02.381 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:30:02.381 WARNING:rgw_multi.tests:bucket ejuwhf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.1.12 target= 2021-02-13T18:30:07.383 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:07.383 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:07.383 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:30:07.568 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:30:07.568 WARNING:rgw_multi.tests:bucket ejuwhf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.1.12 target= 2021-02-13T18:30:12.569 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:12.570 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:12.570 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:30:12.746 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:30:12.746 WARNING:rgw_multi.tests:bucket ejuwhf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.1.12 target= 2021-02-13T18:30:17.747 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:17.747 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:17.747 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:30:17.930 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:30:17.930 WARNING:rgw_multi.tests:bucket ejuwhf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.1.12 target= 2021-02-13T18:30:22.931 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:22.931 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:22.932 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:30:23.107 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:30:23.107 WARNING:rgw_multi.tests:bucket ejuwhf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.1.12 target= 2021-02-13T18:30:28.109 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:28.109 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:28.109 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:30:28.290 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:30:28.291 WARNING:rgw_multi.tests:bucket ejuwhf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.1.12 target= 2021-02-13T18:30:33.292 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:33.292 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:33.293 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:30:33.470 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:30:33.470 WARNING:rgw_multi.tests:bucket ejuwhf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.1.12 target= 2021-02-13T18:30:38.471 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:38.471 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:38.471 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:30:38.652 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:30:38.652 WARNING:rgw_multi.tests:bucket ejuwhf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.1.12 target= 2021-02-13T18:30:43.653 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:43.654 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:43.654 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:30:43.835 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:30:43.836 WARNING:rgw_multi.tests:bucket ejuwhf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.1.12 target= 2021-02-13T18:30:48.837 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:48.837 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:48.838 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:30:49.022 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:30:49.022 WARNING:rgw_multi.tests:bucket ejuwhf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.1.12 target= 2021-02-13T18:30:54.024 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:54.024 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:54.024 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:30:54.208 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:30:54.208 WARNING:rgw_multi.tests:bucket ejuwhf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.1.12 target= 2021-02-13T18:30:59.209 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:59.210 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:30:59.210 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:30:59.394 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:30:59.394 WARNING:rgw_multi.tests:bucket ejuwhf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.1.12 target= 2021-02-13T18:31:04.395 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:31:04.396 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:31:04.396 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:31:04.582 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:31:04.583 WARNING:rgw_multi.tests:bucket ejuwhf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.1.12 target= 2021-02-13T18:31:09.584 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:31:09.584 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:31:09.584 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:31:09.769 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:31:09.769 WARNING:rgw_multi.tests:bucket ejuwhf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.1.12 target= 2021-02-13T18:31:14.770 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:31:14.770 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:31:14.771 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:31:14.950 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:31:14.950 WARNING:rgw_multi.tests:bucket ejuwhf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.1.12 target= 2021-02-13T18:31:19.951 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:31:19.951 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:31:19.951 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:31:20.132 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:31:20.133 WARNING:rgw_multi.tests:bucket ejuwhf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.1.12 target= 2021-02-13T18:31:25.134 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:31:25.134 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:31:25.134 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:31:25.319 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:31:25.319 WARNING:rgw_multi.tests:bucket ejuwhf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.1.12 target= 2021-02-13T18:31:30.320 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:31:30.320 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:31:30.321 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:31:30.504 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:31:30.504 WARNING:rgw_multi.tests:bucket ejuwhf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.1.12 target= 2021-02-13T18:31:35.505 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:31:35.506 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:31:35.506 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:31:35.688 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:31:35.688 WARNING:rgw_multi.tests:bucket ejuwhf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.1.12 target= 2021-02-13T18:31:40.689 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:31:40.689 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:31:40.690 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:31:40.874 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:31:40.874 WARNING:rgw_multi.tests:bucket ejuwhf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.1.12 target= 2021-02-13T18:31:45.875 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:31:45.876 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:31:45.876 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:31:46.057 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:31:46.058 WARNING:rgw_multi.tests:bucket ejuwhf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.1.12 target= 2021-02-13T18:31:51.058 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:31:51.059 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:31:51.059 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:31:51.241 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:31:51.242 WARNING:rgw_multi.tests:bucket ejuwhf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.1.12 target= 2021-02-13T18:31:56.243 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:31:56.243 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:31:56.243 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:31:56.426 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:31:56.427 WARNING:rgw_multi.tests:bucket ejuwhf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.1.12 target= 2021-02-13T18:32:01.427 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:32:01.428 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:32:01.428 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:32:01.607 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:32:01.607 WARNING:rgw_multi.tests:bucket ejuwhf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.1.12 target= 2021-02-13T18:32:06.608 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:32:06.609 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:32:06.609 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:32:06.786 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:32:06.787 WARNING:rgw_multi.tests:bucket ejuwhf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.1.12 target= 2021-02-13T18:32:11.787 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:32:11.788 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:32:11.788 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:32:11.973 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:32:11.973 WARNING:rgw_multi.tests:bucket ejuwhf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.1.12 target= 2021-02-13T18:32:16.973 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:32:16.974 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:32:16.974 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:32:17.154 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:32:17.154 WARNING:rgw_multi.tests:bucket ejuwhf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.1.12 target= 2021-02-13T18:32:22.156 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:32:22.156 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:32:22.156 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:32:22.339 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:32:22.339 WARNING:rgw_multi.tests:bucket ejuwhf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.1.12 target= 2021-02-13T18:32:27.340 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:32:27.340 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:32:27.341 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:32:27.521 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:32:27.521 WARNING:rgw_multi.tests:bucket ejuwhf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.1.12 target= 2021-02-13T18:32:32.522 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:32:32.523 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:32:32.523 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:32:32.699 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:32:32.700 WARNING:rgw_multi.tests:bucket ejuwhf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.1.12 target= 2021-02-13T18:32:37.701 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:32:37.701 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:32:37.701 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:32:37.886 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:32:37.886 WARNING:rgw_multi.tests:bucket ejuwhf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.1.12 target= 2021-02-13T18:32:42.887 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:32:42.888 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:32:42.888 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:32:43.073 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:32:43.074 WARNING:rgw_multi.tests:bucket ejuwhf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.1.12 target= 2021-02-13T18:32:48.074 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:32:48.074 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:32:48.075 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:32:48.255 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:32:48.255 WARNING:rgw_multi.tests:bucket ejuwhf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.1.12 target= 2021-02-13T18:32:53.256 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:32:53.256 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:32:53.257 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:32:53.436 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:32:53.437 WARNING:rgw_multi.tests:bucket ejuwhf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.1.12 target= 2021-02-13T18:32:58.437 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:32:58.438 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:32:58.438 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:32:58.626 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:32:58.626 WARNING:rgw_multi.tests:bucket ejuwhf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.1.12 target= 2021-02-13T18:33:03.627 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:33:03.627 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:33:03.628 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:33:03.805 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:33:03.806 WARNING:rgw_multi.tests:bucket ejuwhf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.1.12 target= 2021-02-13T18:33:08.807 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:33:08.807 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:33:08.807 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:33:08.985 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:33:08.986 WARNING:rgw_multi.tests:bucket ejuwhf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.1.12 target= 2021-02-13T18:33:13.987 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:33:13.987 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:33:13.988 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:33:14.166 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:33:14.166 WARNING:rgw_multi.tests:bucket ejuwhf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.1.12 target= 2021-02-13T18:33:19.166 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:33:19.167 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:33:19.167 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:33:19.344 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:33:19.345 WARNING:rgw_multi.tests:bucket ejuwhf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.1.12 target= 2021-02-13T18:33:24.345 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:33:24.346 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:33:24.346 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:33:24.529 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:33:24.529 WARNING:rgw_multi.tests:bucket ejuwhf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.1.12 target= 2021-02-13T18:33:29.531 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:33:29.531 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:33:29.532 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:33:29.715 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:33:29.715 WARNING:rgw_multi.tests:bucket ejuwhf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.1.12 target= 2021-02-13T18:33:34.716 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:33:34.717 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:33:34.717 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:33:34.897 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:33:34.897 WARNING:rgw_multi.tests:bucket ejuwhf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.1.12 target= 2021-02-13T18:33:39.898 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:33:39.899 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:33:39.899 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:33:40.085 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:33:40.086 WARNING:rgw_multi.tests:bucket ejuwhf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.1.12 target= 2021-02-13T18:33:45.086 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:33:45.086 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:33:45.087 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:33:45.273 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:33:45.273 WARNING:rgw_multi.tests:bucket ejuwhf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.1.12 target= 2021-02-13T18:33:50.275 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:33:50.275 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:33:50.275 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:33:50.458 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:33:50.459 WARNING:rgw_multi.tests:bucket ejuwhf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.1.12 target= 2021-02-13T18:33:55.460 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:33:55.460 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:33:55.461 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:33:55.644 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:33:55.644 WARNING:rgw_multi.tests:bucket ejuwhf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.1.12 target= 2021-02-13T18:34:00.646 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:34:00.646 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:34:00.647 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:34:00.829 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:34:00.829 WARNING:rgw_multi.tests:bucket ejuwhf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.1.12 target= 2021-02-13T18:34:05.830 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:34:05.831 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:34:05.831 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:34:06.014 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:34:06.014 WARNING:rgw_multi.tests:bucket ejuwhf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.1.12 target= 2021-02-13T18:34:11.015 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:34:11.016 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:34:11.016 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:34:11.200 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:34:11.200 WARNING:rgw_multi.tests:bucket ejuwhf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.1.12 target= 2021-02-13T18:34:16.201 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:34:16.202 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:34:16.202 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:34:16.380 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:34:16.381 WARNING:rgw_multi.tests:bucket ejuwhf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.1.12 target= 2021-02-13T18:34:21.382 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:34:21.382 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-24', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:34:21.382 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-24 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:34:21.561 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:34:21.562 WARNING:rgw_multi.tests:bucket ejuwhf-24 zone test-zone4 behind zone test-zone2: shard=0 master=00000000001.1.12 target= 2021-02-13T18:34:26.588 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.tests.test_suspended_delete_marker_full_sync ... FAIL 2021-02-13T18:34:26.589 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=ejuwhf-27 2021-02-13T18:34:26.659 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=ejuwhf-28 2021-02-13T18:34:26.771 INFO:rgw_multi.tests:create bucket zone=test-zone3 name=ejuwhf-29 2021-02-13T18:34:27.138 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.tests.test_bucket_versioning ... ok 2021-02-13T18:34:27.139 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=ejuwhf-30 2021-02-13T18:34:27.204 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=ejuwhf-31 2021-02-13T18:34:27.308 INFO:rgw_multi.tests:create bucket zone=test-zone3 name=ejuwhf-32 2021-02-13T18:34:27.699 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.tests.test_bucket_acl ... ok 2021-02-13T18:34:27.699 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=ejuwhf-33 2021-02-13T18:34:27.721 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=ejuwhf-34 2021-02-13T18:34:27.774 INFO:rgw_multi.tests:create bucket zone=test-zone3 name=ejuwhf-35 2021-02-13T18:34:30.507 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.tests.test_bucket_cors ... ok 2021-02-13T18:34:30.507 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=ejuwhf-36 2021-02-13T18:34:30.902 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=ejuwhf-37 2021-02-13T18:34:31.664 INFO:rgw_multi.tests:create bucket zone=test-zone3 name=ejuwhf-38 2021-02-13T18:34:32.190 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:34:32.190 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:34:32.191 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:34:32.295 INFO:teuthology.orchestra.run.gibba025.stderr:No --period given, using current period=138dc4ba-dc02-4957-87c3-e8bf2d80917c 2021-02-13T18:34:32.309 INFO:teuthology.orchestra.run.gibba025.stdout:[{"marker":"1_1613238836.394578_31.1","last_update":"2021-02-13 17:53:56.394578Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613238989.770436_129.1","last_update":"2021-02-13 17:56:29.770436Z"},{"marker":"1_1613241272.144691_226.1","last_update":"2021-02-13 18:34:32.144691Z"}] 2021-02-13T18:34:32.310 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-02-13T18:34:32.310 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:34:32.310 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:34:32.310 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:34:32.400 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"138dc4ba-dc02-4957-87c3-e8bf2d80917c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613241271.624585_222.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:34:31.624585Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:34:32.400 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=3 master=1_1613241272.144691_226.1 target=1_1613241271.624585_222.1 2021-02-13T18:34:37.402 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:34:37.402 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:34:37.402 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:34:37.487 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"138dc4ba-dc02-4957-87c3-e8bf2d80917c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613241272.144691_226.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:34:32.144691Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:34:37.487 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-02-13T18:34:37.487 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-02-13T18:34:37.487 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:34:37.487 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:34:37.488 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:34:37.577 INFO:teuthology.orchestra.run.gibba025.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"138dc4ba-dc02-4957-87c3-e8bf2d80917c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613241272.144691_226.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:34:32.144691Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:34:37.578 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-02-13T18:34:37.578 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T18:34:37.578 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:34:37.579 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:34:37.579 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:34:37.794 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"138dc4ba-dc02-4957-87c3-e8bf2d80917c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613241272.144691_226.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:34:32.144691Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:34:37.794 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T18:34:40.685 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.tests.test_bucket_delete_notempty ... ok 2021-02-13T18:34:40.685 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=ejuwhf-39 2021-02-13T18:34:40.750 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=ejuwhf-40 2021-02-13T18:34:41.692 INFO:rgw_multi.tests:create bucket zone=test-zone3 name=ejuwhf-41 2021-02-13T18:34:41.914 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:34:41.915 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:34:41.915 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:34:42.002 INFO:teuthology.orchestra.run.gibba025.stderr:No --period given, using current period=138dc4ba-dc02-4957-87c3-e8bf2d80917c 2021-02-13T18:34:42.018 INFO:teuthology.orchestra.run.gibba025.stdout:[{"marker":"1_1613238836.394578_31.1","last_update":"2021-02-13 17:53:56.394578Z"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613238989.770436_129.1","last_update":"2021-02-13 17:56:29.770436Z"},{"marker":"1_1613241281.822512_242.1","last_update":"2021-02-13 18:34:41.822512Z"}] 2021-02-13T18:34:42.018 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-02-13T18:34:42.018 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:34:42.018 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:34:42.018 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:34:42.138 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"138dc4ba-dc02-4957-87c3-e8bf2d80917c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613241281.822512_242.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:34:41.822512Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:34:42.139 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-02-13T18:34:42.139 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-02-13T18:34:42.139 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:34:42.139 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:34:42.139 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:34:42.566 INFO:teuthology.orchestra.run.gibba025.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"138dc4ba-dc02-4957-87c3-e8bf2d80917c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613241281.822512_242.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:34:41.822512Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:34:42.566 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-02-13T18:34:42.566 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T18:34:42.566 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:34:42.566 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:34:42.567 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:34:42.746 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"138dc4ba-dc02-4957-87c3-e8bf2d80917c","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613241281.822512_242.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:34:41.822512Z","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:34:42.747 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T18:34:42.747 DEBUG:tasks.rgw.c1.client.1:waiting for process to exit 2021-02-13T18:34:42.747 INFO:teuthology.orchestra.run:waiting for 300 2021-02-13T18:34:42.749 INFO:tasks.rgw.c1.client.1.gibba025.stdout:2021-02-13 18:34:42.740 7f254a6cf700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term radosgw --rgw-frontends civetweb port=8001 -n client.1 --cluster c1 -k /etc/ceph/c1.client.1.keyring --log-file /var/log/ceph/rgw.c1.client.1.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c1.client.1.sock --foreground --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm (PID: 18274) UID: 0 2021-02-13T18:34:42.749 INFO:tasks.rgw.c1.client.1.gibba025.stdout:2021-02-13 18:34:42.740 7f2561016980 -1 shutting down 2021-02-13T18:34:48.849 INFO:tasks.rgw.c1.client.1:Stopped 2021-02-13T18:34:48.850 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'modify', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--master', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T18:34:48.850 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'modify', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--master', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T18:34:48.850 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone modify --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --master --cluster c2 --debug-rgw 0 --debug-ms 0 2021-02-13T18:34:48.896 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 18:34:48.890 7f88d6c9d940 0 NOTICE: overriding master zone: 671230a8-4b04-4e98-83d8-0a04dcd55dc0 2021-02-13T18:34:48.896 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 18:34:48.890 7f88d6c9d940 0 failed reading obj info from .rgw.root:zone_info.671230a8-4b04-4e98-83d8-0a04dcd55dc0: (2) No such file or directory 2021-02-13T18:34:48.897 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 18:34:48.890 7f88d6c9d940 0 WARNING: could not read zone params for zone id=671230a8-4b04-4e98-83d8-0a04dcd55dc0 name=test-zone1 2021-02-13T18:34:48.897 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 18:34:48.890 7f88d6c9d940 0 failed reading obj info from .rgw.root:zone_info.7441352a-0312-41b4-8a2a-b3cee61559db: (2) No such file or directory 2021-02-13T18:34:48.897 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 18:34:48.890 7f88d6c9d940 0 WARNING: could not read zone params for zone id=7441352a-0312-41b4-8a2a-b3cee61559db name=test-zone3 2021-02-13T18:34:48.903 INFO:teuthology.orchestra.run.gibba036.stdout:{"id":"e658a22d-79d5-4296-b285-f122e7115b09","name":"test-zone2","domain_root":"test-zone2.rgw.meta:root","control_pool":"test-zone2.rgw.control","gc_pool":"test-zone2.rgw.log:gc","lc_pool":"test-zone2.rgw.log:lc","log_pool":"test-zone2.rgw.log","intent_log_pool":"test-zone2.rgw.log:intent","usage_log_pool":"test-zone2.rgw.log:usage","reshard_pool":"test-zone2.rgw.log:reshard","user_keys_pool":"test-zone2.rgw.meta:users.keys","user_email_pool":"test-zone2.rgw.meta:users.email","user_swift_pool":"test-zone2.rgw.meta:users.swift","user_uid_pool":"test-zone2.rgw.meta:users.uid","otp_pool":"test-zone2.rgw.otp","system_key":{"access_key":"UVQW931EG3AB4CYL","secret_key":"iSUph5ZNlZA0jRgR14y90OM0mpNVa9gv"},"placement_pools":[{"key":"default-placement","val":{"index_pool":"test-zone2.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"test-zone2.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"test-zone2.rgw.buckets.non-ec","index_type":0}}],"metadata_heap":"","realm_id":"c0c9dba8-b0a7-4e01-b0aa-e4c8b23f42b5"} 2021-02-13T18:34:48.903 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T18:34:48.904 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T18:34:48.904 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 period update --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c2 --debug-rgw 0 --debug-ms 0 2021-02-13T18:34:49.045 INFO:teuthology.orchestra.run.gibba036.stdout:{"id":"87cf2a0e-b653-4b98-b23c-48172347acb4","epoch":1,"predecessor_uuid":"138dc4ba-dc02-4957-87c3-e8bf2d80917c","sync_status":["1_1613238836.394578_31.1","","1_1613238989.770436_129.1","1_1613241281.822512_242.1"],"period_map":{"id":"87cf2a0e-b653-4b98-b23c-48172347acb4","zonegroups":[{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":"true","endpoints":["http://gibba025.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"e658a22d-79d5-4296-b285-f122e7115b09","zones":[{"id":"1bf208ef-d5d9-46b7-8924-f1c8f37c366c","name":"test-zone4","endpoints":["http://gibba036.front.sepia.ceph.com:8001"],"log_meta":"false","log_data":"true","bucket_index_max_shards":0,"read_only":"false","tier_type":"pubsub","sync_from_all":"false","sync_from":["test-zone1"],"redirect_zone":""},{"id":"671230a8-4b04-4e98-83d8-0a04dcd55dc0","name":"test-zone1","endpoints":["http://gibba025.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":0,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"7441352a-0312-41b4-8a2a-b3cee61559db","name":"test-zone3","endpoints":["http://gibba025.front.sepia.ceph.com:8001"],"log_meta":"false","log_data":"true","bucket_index_max_shards":0,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"e658a22d-79d5-4296-b285-f122e7115b09","name":"test-zone2","endpoints":["http://gibba036.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":0,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"c0c9dba8-b0a7-4e01-b0aa-e4c8b23f42b5"}],"short_zone_ids":[{"key":"1bf208ef-d5d9-46b7-8924-f1c8f37c366c","val":1463523823},{"key":"671230a8-4b04-4e98-83d8-0a04dcd55dc0","val":450442592},{"key":"7441352a-0312-41b4-8a2a-b3cee61559db","val":3844419010},{"key":"e658a22d-79d5-4296-b285-f122e7115b09","val":3525659260}]},"master_zonegroup":"test-zonegroup","master_zone":"e658a22d-79d5-4296-b285-f122e7115b09","period_config":{"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}},"realm_id":"c0c9dba8-b0a7-4e01-b0aa-e4c8b23f42b5","realm_name":"test-realm","realm_epoch":3} 2021-02-13T18:34:49.045 INFO:rgw_multi.tests:Set master zone=test-zone2, waiting 60s for reconfiguration.. 2021-02-13T18:35:49.046 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=ejuwhf-42 2021-02-13T18:35:49.120 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=ejuwhf-43 2021-02-13T18:35:49.178 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:35:49.179 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'mdlog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:35:49.179 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 mdlog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:35:49.278 INFO:teuthology.orchestra.run.gibba036.stderr:No --period given, using current period=87cf2a0e-b653-4b98-b23c-48172347acb4 2021-02-13T18:35:49.292 INFO:teuthology.orchestra.run.gibba036.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613241349.167298_97.1","last_update":"2021-02-13 18:35:49.167298Z"}] 2021-02-13T18:35:49.292 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone1 2021-02-13T18:35:49.292 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:35:49.293 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:35:49.293 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:35:49.388 INFO:teuthology.orchestra.run.gibba025.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"87cf2a0e-b653-4b98-b23c-48172347acb4","realm_epoch":3},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":28,"pos":0,"timestamp":"0.000000","realm_epoch":3}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":37,"pos":0,"timestamp":"0.000000","realm_epoch":3}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":15,"pos":0,"timestamp":"0.000000","realm_epoch":3}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":3}}]},"full_sync":{"total":80,"complete":80}} 2021-02-13T18:35:49.388 WARNING:rgw_multi.tests:zone test-zone1 behind master: shard=3 master=1_1613241349.167298_97.1 target= 2021-02-13T18:35:54.389 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:35:54.390 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:35:54.390 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:35:54.476 INFO:teuthology.orchestra.run.gibba025.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"87cf2a0e-b653-4b98-b23c-48172347acb4","realm_epoch":3},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":28,"pos":0,"timestamp":"0.000000","realm_epoch":3}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":37,"pos":0,"timestamp":"0.000000","realm_epoch":3}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":15,"pos":0,"timestamp":"0.000000","realm_epoch":3}},{"key":3,"val":{"state":1,"marker":"1_1613241349.167298_97.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:35:49.167298Z","realm_epoch":3}}]},"full_sync":{"total":80,"complete":80}} 2021-02-13T18:35:54.477 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone1 2021-02-13T18:35:54.477 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zone', 'modify', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--master', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T18:35:54.478 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zone', 'modify', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--master', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T18:35:54.478 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zone modify --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --master --cluster c1 --debug-rgw 0 --debug-ms 0 2021-02-13T18:35:54.512 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 18:35:54.505 7fe9371fe940 0 NOTICE: overriding master zone: e658a22d-79d5-4296-b285-f122e7115b09 2021-02-13T18:35:54.512 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 18:35:54.505 7fe9371fe940 0 failed reading obj info from .rgw.root:zone_info.1bf208ef-d5d9-46b7-8924-f1c8f37c366c: (2) No such file or directory 2021-02-13T18:35:54.512 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 18:35:54.505 7fe9371fe940 0 WARNING: could not read zone params for zone id=1bf208ef-d5d9-46b7-8924-f1c8f37c366c name=test-zone4 2021-02-13T18:35:54.512 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 18:35:54.505 7fe9371fe940 0 failed reading obj info from .rgw.root:zone_info.e658a22d-79d5-4296-b285-f122e7115b09: (2) No such file or directory 2021-02-13T18:35:54.513 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 18:35:54.505 7fe9371fe940 0 WARNING: could not read zone params for zone id=e658a22d-79d5-4296-b285-f122e7115b09 name=test-zone2 2021-02-13T18:35:54.518 INFO:teuthology.orchestra.run.gibba025.stdout:{"id":"671230a8-4b04-4e98-83d8-0a04dcd55dc0","name":"test-zone1","domain_root":"test-zone1.rgw.meta:root","control_pool":"test-zone1.rgw.control","gc_pool":"test-zone1.rgw.log:gc","lc_pool":"test-zone1.rgw.log:lc","log_pool":"test-zone1.rgw.log","intent_log_pool":"test-zone1.rgw.log:intent","usage_log_pool":"test-zone1.rgw.log:usage","reshard_pool":"test-zone1.rgw.log:reshard","user_keys_pool":"test-zone1.rgw.meta:users.keys","user_email_pool":"test-zone1.rgw.meta:users.email","user_swift_pool":"test-zone1.rgw.meta:users.swift","user_uid_pool":"test-zone1.rgw.meta:users.uid","otp_pool":"test-zone1.rgw.otp","system_key":{"access_key":"UVQW931EG3AB4CYL","secret_key":"iSUph5ZNlZA0jRgR14y90OM0mpNVa9gv"},"placement_pools":[{"key":"default-placement","val":{"index_pool":"test-zone1.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"test-zone1.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"test-zone1.rgw.buckets.non-ec","index_type":0}}],"metadata_heap":"","realm_id":"c0c9dba8-b0a7-4e01-b0aa-e4c8b23f42b5"} 2021-02-13T18:35:54.519 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['period', 'update', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T18:35:54.520 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'period', 'update', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T18:35:54.520 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 period update --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c1 --debug-rgw 0 --debug-ms 0 2021-02-13T18:35:54.682 INFO:teuthology.orchestra.run.gibba025.stdout:{"id":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","epoch":1,"predecessor_uuid":"87cf2a0e-b653-4b98-b23c-48172347acb4","sync_status":["","","","1_1613241349.167298_97.1"],"period_map":{"id":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","zonegroups":[{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":"true","endpoints":["http://gibba025.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"671230a8-4b04-4e98-83d8-0a04dcd55dc0","zones":[{"id":"1bf208ef-d5d9-46b7-8924-f1c8f37c366c","name":"test-zone4","endpoints":["http://gibba036.front.sepia.ceph.com:8001"],"log_meta":"false","log_data":"true","bucket_index_max_shards":0,"read_only":"false","tier_type":"pubsub","sync_from_all":"false","sync_from":["test-zone1"],"redirect_zone":""},{"id":"671230a8-4b04-4e98-83d8-0a04dcd55dc0","name":"test-zone1","endpoints":["http://gibba025.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":0,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"7441352a-0312-41b4-8a2a-b3cee61559db","name":"test-zone3","endpoints":["http://gibba025.front.sepia.ceph.com:8001"],"log_meta":"false","log_data":"true","bucket_index_max_shards":0,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"e658a22d-79d5-4296-b285-f122e7115b09","name":"test-zone2","endpoints":["http://gibba036.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":0,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"c0c9dba8-b0a7-4e01-b0aa-e4c8b23f42b5"}],"short_zone_ids":[{"key":"1bf208ef-d5d9-46b7-8924-f1c8f37c366c","val":1463523823},{"key":"671230a8-4b04-4e98-83d8-0a04dcd55dc0","val":450442592},{"key":"7441352a-0312-41b4-8a2a-b3cee61559db","val":3844419010},{"key":"e658a22d-79d5-4296-b285-f122e7115b09","val":3525659260}]},"master_zonegroup":"test-zonegroup","master_zone":"671230a8-4b04-4e98-83d8-0a04dcd55dc0","period_config":{"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}},"realm_id":"c0c9dba8-b0a7-4e01-b0aa-e4c8b23f42b5","realm_name":"test-realm","realm_epoch":4} 2021-02-13T18:35:54.682 INFO:rgw_multi.tests:Set master zone=test-zone1, waiting 60s for reconfiguration.. 2021-02-13T18:36:54.683 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=ejuwhf-44 2021-02-13T18:36:54.771 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=ejuwhf-45 2021-02-13T18:36:54.892 INFO:tasks.rgw.c1.client.1:Restarting daemon 2021-02-13T18:36:54.893 DEBUG:teuthology.orchestra.run.gibba025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'civetweb port=8001' -n client.1 --cluster c1 -k /etc/ceph/c1.client.1.keyring --log-file /var/log/ceph/rgw.c1.client.1.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c1.client.1.sock --foreground --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm | sudo tee /var/log/ceph/rgw.c1.client.1.stdout 2>&1 2021-02-13T18:36:54.896 INFO:tasks.rgw.c1.client.1:Started 2021-02-13T18:36:54.896 DEBUG:teuthology.orchestra.run.gibba025:> curl http://gibba025.front.sepia.ceph.com:8001 2021-02-13T18:36:54.921 INFO:teuthology.orchestra.run.gibba025.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2021-02-13T18:36:54.922 INFO:teuthology.orchestra.run.gibba025.stderr: Dload Upload Total Spent Left Speed 2021-02-13T18:36:54.925 INFO:teuthology.orchestra.run.gibba025.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0curl: (7) Failed to connect to gibba025.front.sepia.ceph.com port 8001: Connection refused 2021-02-13T18:36:54.927 DEBUG:teuthology.orchestra.run:got remote process result: 7 2021-02-13T18:36:55.928 DEBUG:teuthology.orchestra.run.gibba025:> curl http://gibba025.front.sepia.ceph.com:8001 2021-02-13T18:36:55.953 INFO:teuthology.orchestra.run.gibba025.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2021-02-13T18:36:55.953 INFO:teuthology.orchestra.run.gibba025.stderr: Dload Upload Total Spent Left Speed 2021-02-13T18:36:55.962 INFO:teuthology.orchestra.run.gibba025.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 214 0 214 0 0 23777 0 --:--:-- --:--:-- --:--:-- 23777 2021-02-13T18:36:55.963 INFO:teuthology.orchestra.run.gibba025.stdout:anonymous 2021-02-13T18:36:55.964 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:36:55.964 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:36:55.965 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:36:56.109 INFO:teuthology.orchestra.run.gibba025.stderr:No --period given, using current period=c72c9bb6-7372-4355-b488-0f51f8a5cecb 2021-02-13T18:36:56.126 INFO:teuthology.orchestra.run.gibba025.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613241414.844875_206.1","last_update":"2021-02-13 18:36:54.844875Z"}] 2021-02-13T18:36:56.127 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-02-13T18:36:56.127 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:36:56.127 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:36:56.127 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:36:56.247 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613241414.844875_206.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:36:54.844875Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:36:56.247 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-02-13T18:36:56.247 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-02-13T18:36:56.247 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:36:56.247 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:36:56.248 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:36:56.369 INFO:teuthology.orchestra.run.gibba025.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613241414.844875_206.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:36:54.844875Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:36:56.370 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-02-13T18:36:56.370 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T18:36:56.370 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:36:56.370 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:36:56.370 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:36:56.545 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613241414.844875_206.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:36:54.844875Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:36:56.545 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T18:36:56.545 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ejuwhf-39 zones={test-zone2, test-zone1} 2021-02-13T18:36:57.425 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-02-13T18:36:57.435 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-02-13T18:36:57.542 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ejuwhf-39 zones={test-zone2, test-zone1} 2021-02-13T18:36:57.543 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ejuwhf-39 zones={test-zone3, test-zone1} 2021-02-13T18:36:57.581 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-02-13T18:36:57.635 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-02-13T18:36:57.692 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ejuwhf-39 zones={test-zone3, test-zone1} 2021-02-13T18:36:57.692 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ejuwhf-39 zones={test-zone1, test-zone2} 2021-02-13T18:36:57.703 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-02-13T18:36:57.751 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-02-13T18:36:57.807 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ejuwhf-39 zones={test-zone1, test-zone2} 2021-02-13T18:36:57.807 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ejuwhf-39 zones={test-zone3, test-zone2} 2021-02-13T18:36:57.816 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-02-13T18:36:57.863 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-02-13T18:36:57.919 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ejuwhf-39 zones={test-zone3, test-zone2} 2021-02-13T18:36:57.919 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ejuwhf-39 zones={test-zone1, test-zone3} 2021-02-13T18:36:57.930 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-02-13T18:36:57.979 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-02-13T18:36:58.040 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ejuwhf-39 zones={test-zone1, test-zone3} 2021-02-13T18:36:58.040 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ejuwhf-39 zones={test-zone2, test-zone3} 2021-02-13T18:36:58.050 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-02-13T18:36:58.099 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-02-13T18:36:58.159 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ejuwhf-39 zones={test-zone2, test-zone3} 2021-02-13T18:36:58.160 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ejuwhf-40 zones={test-zone2, test-zone1} 2021-02-13T18:36:58.199 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-02-13T18:36:58.247 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-02-13T18:36:58.308 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ejuwhf-40 zones={test-zone2, test-zone1} 2021-02-13T18:36:58.308 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ejuwhf-40 zones={test-zone3, test-zone1} 2021-02-13T18:36:58.329 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-02-13T18:36:58.379 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-02-13T18:36:58.442 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ejuwhf-40 zones={test-zone3, test-zone1} 2021-02-13T18:36:58.442 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ejuwhf-40 zones={test-zone1, test-zone2} 2021-02-13T18:36:58.454 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-02-13T18:36:58.503 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-02-13T18:36:58.560 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ejuwhf-40 zones={test-zone1, test-zone2} 2021-02-13T18:36:58.560 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ejuwhf-40 zones={test-zone3, test-zone2} 2021-02-13T18:36:58.569 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-02-13T18:36:58.615 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-02-13T18:36:58.673 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ejuwhf-40 zones={test-zone3, test-zone2} 2021-02-13T18:36:58.673 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ejuwhf-40 zones={test-zone1, test-zone3} 2021-02-13T18:36:58.683 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-02-13T18:36:58.735 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-02-13T18:36:58.792 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ejuwhf-40 zones={test-zone1, test-zone3} 2021-02-13T18:36:58.792 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ejuwhf-40 zones={test-zone2, test-zone3} 2021-02-13T18:36:58.803 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-02-13T18:36:58.851 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-02-13T18:36:58.907 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ejuwhf-40 zones={test-zone2, test-zone3} 2021-02-13T18:36:58.908 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ejuwhf-41 zones={test-zone2, test-zone1} 2021-02-13T18:36:58.944 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-02-13T18:36:58.995 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-02-13T18:36:59.057 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ejuwhf-41 zones={test-zone2, test-zone1} 2021-02-13T18:36:59.057 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ejuwhf-41 zones={test-zone3, test-zone1} 2021-02-13T18:36:59.077 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-02-13T18:36:59.127 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-02-13T18:36:59.189 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ejuwhf-41 zones={test-zone3, test-zone1} 2021-02-13T18:36:59.189 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ejuwhf-41 zones={test-zone1, test-zone2} 2021-02-13T18:36:59.201 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-02-13T18:36:59.254 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-02-13T18:36:59.311 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ejuwhf-41 zones={test-zone1, test-zone2} 2021-02-13T18:36:59.311 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ejuwhf-41 zones={test-zone3, test-zone2} 2021-02-13T18:36:59.320 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-02-13T18:36:59.367 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-02-13T18:36:59.426 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ejuwhf-41 zones={test-zone3, test-zone2} 2021-02-13T18:36:59.426 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ejuwhf-41 zones={test-zone1, test-zone3} 2021-02-13T18:36:59.436 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-02-13T18:36:59.483 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-02-13T18:36:59.543 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ejuwhf-41 zones={test-zone1, test-zone3} 2021-02-13T18:36:59.543 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ejuwhf-41 zones={test-zone2, test-zone3} 2021-02-13T18:36:59.551 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-02-13T18:36:59.602 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-02-13T18:36:59.660 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ejuwhf-41 zones={test-zone2, test-zone3} 2021-02-13T18:36:59.660 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ejuwhf-42 zones={test-zone2, test-zone1} 2021-02-13T18:36:59.671 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-02-13T18:36:59.719 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-02-13T18:36:59.776 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ejuwhf-42 zones={test-zone2, test-zone1} 2021-02-13T18:36:59.776 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ejuwhf-42 zones={test-zone3, test-zone1} 2021-02-13T18:36:59.786 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-02-13T18:36:59.835 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-02-13T18:36:59.893 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ejuwhf-42 zones={test-zone3, test-zone1} 2021-02-13T18:36:59.893 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ejuwhf-42 zones={test-zone1, test-zone2} 2021-02-13T18:36:59.904 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-02-13T18:36:59.951 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-02-13T18:37:00.007 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ejuwhf-42 zones={test-zone1, test-zone2} 2021-02-13T18:37:00.007 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ejuwhf-42 zones={test-zone3, test-zone2} 2021-02-13T18:37:00.010 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-02-13T18:37:00.055 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-02-13T18:37:00.109 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ejuwhf-42 zones={test-zone3, test-zone2} 2021-02-13T18:37:00.109 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ejuwhf-42 zones={test-zone1, test-zone3} 2021-02-13T18:37:00.113 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-02-13T18:37:00.163 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-02-13T18:37:00.219 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ejuwhf-42 zones={test-zone1, test-zone3} 2021-02-13T18:37:00.219 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ejuwhf-42 zones={test-zone2, test-zone3} 2021-02-13T18:37:00.229 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-02-13T18:37:00.275 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-02-13T18:37:00.331 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ejuwhf-42 zones={test-zone2, test-zone3} 2021-02-13T18:37:00.331 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ejuwhf-43 zones={test-zone2, test-zone1} 2021-02-13T18:37:00.342 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-02-13T18:37:00.391 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-02-13T18:37:00.448 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ejuwhf-43 zones={test-zone2, test-zone1} 2021-02-13T18:37:00.448 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ejuwhf-43 zones={test-zone3, test-zone1} 2021-02-13T18:37:00.457 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-02-13T18:37:00.503 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-02-13T18:37:00.566 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ejuwhf-43 zones={test-zone3, test-zone1} 2021-02-13T18:37:00.566 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ejuwhf-43 zones={test-zone1, test-zone2} 2021-02-13T18:37:00.580 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-02-13T18:37:00.627 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-02-13T18:37:00.687 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ejuwhf-43 zones={test-zone1, test-zone2} 2021-02-13T18:37:00.687 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ejuwhf-43 zones={test-zone3, test-zone2} 2021-02-13T18:37:00.697 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-02-13T18:37:00.743 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-02-13T18:37:00.806 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ejuwhf-43 zones={test-zone3, test-zone2} 2021-02-13T18:37:00.877 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ejuwhf-43 zones={test-zone1, test-zone3} 2021-02-13T18:37:00.891 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-02-13T18:37:00.943 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-02-13T18:37:01.007 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ejuwhf-43 zones={test-zone1, test-zone3} 2021-02-13T18:37:01.007 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ejuwhf-43 zones={test-zone2, test-zone3} 2021-02-13T18:37:01.017 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-02-13T18:37:01.067 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-02-13T18:37:01.119 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ejuwhf-43 zones={test-zone2, test-zone3} 2021-02-13T18:37:01.120 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ejuwhf-44 zones={test-zone2, test-zone1} 2021-02-13T18:37:01.131 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-02-13T18:37:01.183 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-02-13T18:37:01.240 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ejuwhf-44 zones={test-zone2, test-zone1} 2021-02-13T18:37:01.240 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ejuwhf-44 zones={test-zone3, test-zone1} 2021-02-13T18:37:01.249 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-02-13T18:37:01.303 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-02-13T18:37:01.360 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ejuwhf-44 zones={test-zone3, test-zone1} 2021-02-13T18:37:01.360 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ejuwhf-44 zones={test-zone1, test-zone2} 2021-02-13T18:37:01.379 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-02-13T18:37:01.431 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-02-13T18:37:01.491 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ejuwhf-44 zones={test-zone1, test-zone2} 2021-02-13T18:37:01.491 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ejuwhf-44 zones={test-zone3, test-zone2} 2021-02-13T18:37:01.501 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-02-13T18:37:01.547 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-02-13T18:37:01.604 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ejuwhf-44 zones={test-zone3, test-zone2} 2021-02-13T18:37:01.604 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ejuwhf-44 zones={test-zone1, test-zone3} 2021-02-13T18:37:01.614 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-02-13T18:37:01.663 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-02-13T18:37:01.719 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ejuwhf-44 zones={test-zone1, test-zone3} 2021-02-13T18:37:01.719 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ejuwhf-44 zones={test-zone2, test-zone3} 2021-02-13T18:37:01.727 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-02-13T18:37:01.775 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-02-13T18:37:01.831 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ejuwhf-44 zones={test-zone2, test-zone3} 2021-02-13T18:37:01.831 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ejuwhf-45 zones={test-zone2, test-zone1} 2021-02-13T18:37:01.842 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-02-13T18:37:01.891 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-02-13T18:37:01.948 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ejuwhf-45 zones={test-zone2, test-zone1} 2021-02-13T18:37:01.948 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ejuwhf-45 zones={test-zone3, test-zone1} 2021-02-13T18:37:01.958 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-02-13T18:37:02.003 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-02-13T18:37:02.060 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ejuwhf-45 zones={test-zone3, test-zone1} 2021-02-13T18:37:02.060 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ejuwhf-45 zones={test-zone1, test-zone2} 2021-02-13T18:37:02.071 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-02-13T18:37:02.124 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-02-13T18:37:02.185 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ejuwhf-45 zones={test-zone1, test-zone2} 2021-02-13T18:37:02.185 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ejuwhf-45 zones={test-zone3, test-zone2} 2021-02-13T18:37:02.195 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-02-13T18:37:02.242 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-02-13T18:37:02.299 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ejuwhf-45 zones={test-zone3, test-zone2} 2021-02-13T18:37:02.299 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ejuwhf-45 zones={test-zone1, test-zone3} 2021-02-13T18:37:02.310 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-02-13T18:37:02.359 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-02-13T18:37:02.419 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ejuwhf-45 zones={test-zone1, test-zone3} 2021-02-13T18:37:02.419 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ejuwhf-45 zones={test-zone2, test-zone3} 2021-02-13T18:37:02.429 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-02-13T18:37:02.475 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-02-13T18:37:02.531 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ejuwhf-45 zones={test-zone2, test-zone3} 2021-02-13T18:37:02.532 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'list', '--period', '138dc4ba-dc02-4957-87c3-e8bf2d80917c', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:37:02.532 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'list', '--period', '138dc4ba-dc02-4957-87c3-e8bf2d80917c', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:37:02.532 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog list --period 138dc4ba-dc02-4957-87c3-e8bf2d80917c --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:37:02.666 INFO:teuthology.orchestra.run.gibba025.stdout:[{"id":"1_1613238836.390537_30.1","section":"user","name":"rgw-multisite-test-user","timestamp":"2021-02-13 17:53:56.390537712Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_pP6iIiaEGrFvLGsZM7x-OH9","ver":1},"status":{"status":"write"}}},{"id":"1_1613238836.394578_31.1","section":"user","name":"rgw-multisite-test-user","timestamp":"2021-02-13 17:53:56.394578235Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_pP6iIiaEGrFvLGsZM7x-OH9","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238955.574548_34.1","section":"bucket.instance","name":"ejuwhf-1:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.1","timestamp":"2021-02-13 17:55:55.574548718Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_x9-l_GSKepPMI4ZXnkA47yy","ver":1},"status":{"status":"write"}}},{"id":"1_1613238955.577573_35.1","section":"bucket.instance","name":"ejuwhf-1:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.1","timestamp":"2021-02-13 17:55:55.577573029Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_x9-l_GSKepPMI4ZXnkA47yy","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238955.578734_36.1","section":"bucket","name":"ejuwhf-1","timestamp":"2021-02-13 17:55:55.578734260Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_J8joTt2UmmIiOX87U166pOB","ver":1},"status":{"status":"write"}}},{"id":"1_1613238955.582128_37.1","section":"bucket","name":"ejuwhf-1","timestamp":"2021-02-13 17:55:55.582128841Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_J8joTt2UmmIiOX87U166pOB","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238955.598221_38.1","section":"bucket.instance","name":"ejuwhf-2:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.2","timestamp":"2021-02-13 17:55:55.598221635Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_XxLX1rySo-vI8MVX_6lsszw","ver":1},"status":{"status":"write"}}},{"id":"1_1613238955.601565_39.1","section":"bucket.instance","name":"ejuwhf-2:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.2","timestamp":"2021-02-13 17:55:55.601565432Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_XxLX1rySo-vI8MVX_6lsszw","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238955.602725_40.1","section":"bucket","name":"ejuwhf-2","timestamp":"2021-02-13 17:55:55.602725072Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_-17U9gIvg7jYouuMTrIVOEd","ver":1},"status":{"status":"write"}}},{"id":"1_1613238955.606187_41.1","section":"bucket","name":"ejuwhf-2","timestamp":"2021-02-13 17:55:55.606187695Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_-17U9gIvg7jYouuMTrIVOEd","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238956.751602_42.1","section":"bucket.instance","name":"ejuwhf-3:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.3","timestamp":"2021-02-13 17:55:56.751602944Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_lNPGQ7Vy4iyapNXVdS3aLPf","ver":1},"status":{"status":"write"}}},{"id":"1_1613238956.768275_43.1","section":"bucket.instance","name":"ejuwhf-3:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.3","timestamp":"2021-02-13 17:55:56.768275574Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_lNPGQ7Vy4iyapNXVdS3aLPf","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238956.775120_44.1","section":"bucket","name":"ejuwhf-3","timestamp":"2021-02-13 17:55:56.775120953Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_GCZqbJ9H_lfQq60lQ2CTjOd","ver":1},"status":{"status":"write"}}},{"id":"1_1613238956.791138_45.1","section":"bucket","name":"ejuwhf-3","timestamp":"2021-02-13 17:55:56.791138180Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_GCZqbJ9H_lfQq60lQ2CTjOd","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238960.597491_46.1","section":"bucket.instance","name":"ejuwhf-4:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.4","timestamp":"2021-02-13 17:56:00.597491162Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_0QbpwLYGTsIvm_YOZIhcyWS","ver":1},"status":{"status":"write"}}},{"id":"1_1613238960.614238_47.1","section":"bucket.instance","name":"ejuwhf-4:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.4","timestamp":"2021-02-13 17:56:00.614238433Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_0QbpwLYGTsIvm_YOZIhcyWS","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238960.620257_48.1","section":"bucket","name":"ejuwhf-4","timestamp":"2021-02-13 17:56:00.620257808Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_QDWd5t9vsHeGWEiagLoZ4l6","ver":1},"status":{"status":"write"}}},{"id":"1_1613238960.636707_49.1","section":"bucket","name":"ejuwhf-4","timestamp":"2021-02-13 17:56:00.636707536Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_QDWd5t9vsHeGWEiagLoZ4l6","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238960.666464_50.1","section":"bucket.instance","name":"ejuwhf-5:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.5","timestamp":"2021-02-13 17:56:00.666464684Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_HA_YqoBH5yRaCOOmwLHMDu_","ver":1},"status":{"status":"write"}}},{"id":"1_1613238960.682695_51.1","section":"bucket.instance","name":"ejuwhf-5:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.5","timestamp":"2021-02-13 17:56:00.682695337Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_HA_YqoBH5yRaCOOmwLHMDu_","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238960.688294_52.1","section":"bucket","name":"ejuwhf-5","timestamp":"2021-02-13 17:56:00.688294896Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_S2lucmmbUZ62_X47K1y6mSF","ver":1},"status":{"status":"write"}}},{"id":"1_1613238960.704528_53.1","section":"bucket","name":"ejuwhf-5","timestamp":"2021-02-13 17:56:00.704528473Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_S2lucmmbUZ62_X47K1y6mSF","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238960.766449_54.1","section":"bucket.instance","name":"ejuwhf-6:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.6","timestamp":"2021-02-13 17:56:00.766449862Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_4itjl067RN6aZgRRW5-Ukgb","ver":1},"status":{"status":"write"}}},{"id":"1_1613238960.782254_55.1","section":"bucket.instance","name":"ejuwhf-6:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.6","timestamp":"2021-02-13 17:56:00.782254386Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_4itjl067RN6aZgRRW5-Ukgb","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238960.787967_56.1","section":"bucket","name":"ejuwhf-6","timestamp":"2021-02-13 17:56:00.787967808Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"__e1Dsav3WgX_R99k1Kz1phg","ver":1},"status":{"status":"write"}}},{"id":"1_1613238960.804035_57.1","section":"bucket","name":"ejuwhf-6","timestamp":"2021-02-13 17:56:00.804035948Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"__e1Dsav3WgX_R99k1Kz1phg","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238968.578083_58.1","section":"bucket.instance","name":"ejuwhf-4:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.7","timestamp":"2021-02-13 17:56:08.578083676Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_rdxJZW8AbbLkx3Jo3qeZSTL","ver":1},"status":{"status":"write"}}},{"id":"1_1613238968.593717_59.1","section":"bucket.instance","name":"ejuwhf-4:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.7","timestamp":"2021-02-13 17:56:08.593717090Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_rdxJZW8AbbLkx3Jo3qeZSTL","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238968.600220_60.1","section":"bucket","name":"ejuwhf-4","timestamp":"2021-02-13 17:56:08.600220552Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_iCiP82FAKM6s-vHtX5gBzSR","ver":1},"status":{"status":"write"}}},{"id":"1_1613238968.610741_61.1","section":"bucket","name":"ejuwhf-4","timestamp":"2021-02-13 17:56:08.610741110Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_iCiP82FAKM6s-vHtX5gBzSR","ver":1},"status":{"status":"abort"}}},{"id":"1_1613238968.620505_62.1","section":"bucket.instance","name":"ejuwhf-4:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.7","timestamp":"2021-02-13 17:56:08.620505159Z","data":{"read_version":{"tag":"_rdxJZW8AbbLkx3Jo3qeZSTL","ver":1},"write_version":{"tag":"_rdxJZW8AbbLkx3Jo3qeZSTL","ver":2},"status":{"status":"remove"}}},{"id":"1_1613238968.636055_63.1","section":"bucket.instance","name":"ejuwhf-4:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.7","timestamp":"2021-02-13 17:56:08.636055803Z","data":{"read_version":{"tag":"_rdxJZW8AbbLkx3Jo3qeZSTL","ver":1},"write_version":{"tag":"_rdxJZW8AbbLkx3Jo3qeZSTL","ver":2},"status":{"status":"complete"}}},{"id":"1_1613238968.664189_64.1","section":"bucket.instance","name":"ejuwhf-5:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.8","timestamp":"2021-02-13 17:56:08.664189415Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_FcGNUs98T9meCX_-NJVwm_9","ver":1},"status":{"status":"write"}}},{"id":"1_1613238968.679282_65.1","section":"bucket.instance","name":"ejuwhf-5:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.8","timestamp":"2021-02-13 17:56:08.679282375Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_FcGNUs98T9meCX_-NJVwm_9","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238968.685310_66.1","section":"bucket","name":"ejuwhf-5","timestamp":"2021-02-13 17:56:08.685310012Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_waFuBRwm_oVRbc3bCTEK-2Q","ver":1},"status":{"status":"write"}}},{"id":"1_1613238968.695627_67.1","section":"bucket","name":"ejuwhf-5","timestamp":"2021-02-13 17:56:08.695627687Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_waFuBRwm_oVRbc3bCTEK-2Q","ver":1},"status":{"status":"abort"}}},{"id":"1_1613238968.705293_68.1","section":"bucket.instance","name":"ejuwhf-5:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.8","timestamp":"2021-02-13 17:56:08.705293699Z","data":{"read_version":{"tag":"_FcGNUs98T9meCX_-NJVwm_9","ver":1},"write_version":{"tag":"_FcGNUs98T9meCX_-NJVwm_9","ver":2},"status":{"status":"remove"}}},{"id":"1_1613238968.720069_69.1","section":"bucket.instance","name":"ejuwhf-5:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.8","timestamp":"2021-02-13 17:56:08.720069507Z","data":{"read_version":{"tag":"_FcGNUs98T9meCX_-NJVwm_9","ver":1},"write_version":{"tag":"_FcGNUs98T9meCX_-NJVwm_9","ver":2},"status":{"status":"complete"}}},{"id":"1_1613238968.747131_70.1","section":"bucket.instance","name":"ejuwhf-6:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.9","timestamp":"2021-02-13 17:56:08.747131498Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_KgNkkrSI2S7R0wW_SmAxVxt","ver":1},"status":{"status":"write"}}},{"id":"1_1613238968.763036_71.1","section":"bucket.instance","name":"ejuwhf-6:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.9","timestamp":"2021-02-13 17:56:08.763036003Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_KgNkkrSI2S7R0wW_SmAxVxt","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238968.769054_72.1","section":"bucket","name":"ejuwhf-6","timestamp":"2021-02-13 17:56:08.769054237Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_mBw7Ckz7EfNkJ26ASXtA1Qx","ver":1},"status":{"status":"write"}}},{"id":"1_1613238968.780056_73.1","section":"bucket","name":"ejuwhf-6","timestamp":"2021-02-13 17:56:08.780056555Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_mBw7Ckz7EfNkJ26ASXtA1Qx","ver":1},"status":{"status":"abort"}}},{"id":"1_1613238968.790518_74.1","section":"bucket.instance","name":"ejuwhf-6:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.9","timestamp":"2021-02-13 17:56:08.790518321Z","data":{"read_version":{"tag":"_KgNkkrSI2S7R0wW_SmAxVxt","ver":1},"write_version":{"tag":"_KgNkkrSI2S7R0wW_SmAxVxt","ver":2},"status":{"status":"remove"}}},{"id":"1_1613238968.805425_75.1","section":"bucket.instance","name":"ejuwhf-6:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.9","timestamp":"2021-02-13 17:56:08.805425116Z","data":{"read_version":{"tag":"_KgNkkrSI2S7R0wW_SmAxVxt","ver":1},"write_version":{"tag":"_KgNkkrSI2S7R0wW_SmAxVxt","ver":2},"status":{"status":"complete"}}},{"id":"1_1613238968.876119_76.1","section":"bucket.instance","name":"ejuwhf-4:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.10","timestamp":"2021-02-13 17:56:08.876119966Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_C13ny0FEaZhMoqR1eHNrzzo","ver":1},"status":{"status":"write"}}},{"id":"1_1613238968.892593_77.1","section":"bucket.instance","name":"ejuwhf-4:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.10","timestamp":"2021-02-13 17:56:08.892593644Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_C13ny0FEaZhMoqR1eHNrzzo","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238968.898155_78.1","section":"bucket","name":"ejuwhf-4","timestamp":"2021-02-13 17:56:08.898155724Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_S4geTzMH6fpArDdiMUd2Hj6","ver":1},"status":{"status":"write"}}},{"id":"1_1613238968.909527_79.1","section":"bucket","name":"ejuwhf-4","timestamp":"2021-02-13 17:56:08.909527088Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_S4geTzMH6fpArDdiMUd2Hj6","ver":1},"status":{"status":"abort"}}},{"id":"1_1613238968.919849_80.1","section":"bucket.instance","name":"ejuwhf-4:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.10","timestamp":"2021-02-13 17:56:08.919849797Z","data":{"read_version":{"tag":"_C13ny0FEaZhMoqR1eHNrzzo","ver":1},"write_version":{"tag":"_C13ny0FEaZhMoqR1eHNrzzo","ver":2},"status":{"status":"remove"}}},{"id":"1_1613238968.934852_81.1","section":"bucket.instance","name":"ejuwhf-4:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.10","timestamp":"2021-02-13 17:56:08.934852594Z","data":{"read_version":{"tag":"_C13ny0FEaZhMoqR1eHNrzzo","ver":1},"write_version":{"tag":"_C13ny0FEaZhMoqR1eHNrzzo","ver":2},"status":{"status":"complete"}}},{"id":"1_1613238968.997546_82.1","section":"bucket.instance","name":"ejuwhf-5:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.11","timestamp":"2021-02-13 17:56:08.997546443Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_0hI8LEwJXCt77LG_Y8caPyb","ver":1},"status":{"status":"write"}}},{"id":"1_1613238969.013809_83.1","section":"bucket.instance","name":"ejuwhf-5:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.11","timestamp":"2021-02-13 17:56:09.013809353Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_0hI8LEwJXCt77LG_Y8caPyb","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238969.019756_84.1","section":"bucket","name":"ejuwhf-5","timestamp":"2021-02-13 17:56:09.019756087Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_BES52o3jnI5HPCcsJxAGAPJ","ver":1},"status":{"status":"write"}}},{"id":"1_1613238969.031040_85.1","section":"bucket","name":"ejuwhf-5","timestamp":"2021-02-13 17:56:09.031040364Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_BES52o3jnI5HPCcsJxAGAPJ","ver":1},"status":{"status":"abort"}}},{"id":"1_1613238969.041765_86.1","section":"bucket.instance","name":"ejuwhf-5:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.11","timestamp":"2021-02-13 17:56:09.041765351Z","data":{"read_version":{"tag":"_0hI8LEwJXCt77LG_Y8caPyb","ver":1},"write_version":{"tag":"_0hI8LEwJXCt77LG_Y8caPyb","ver":2},"status":{"status":"remove"}}},{"id":"1_1613238969.056811_87.1","section":"bucket.instance","name":"ejuwhf-5:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.11","timestamp":"2021-02-13 17:56:09.056811080Z","data":{"read_version":{"tag":"_0hI8LEwJXCt77LG_Y8caPyb","ver":1},"write_version":{"tag":"_0hI8LEwJXCt77LG_Y8caPyb","ver":2},"status":{"status":"complete"}}},{"id":"1_1613238969.156956_88.1","section":"bucket.instance","name":"ejuwhf-6:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.12","timestamp":"2021-02-13 17:56:09.156956168Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_zCjiECQrQYftP3tksmjEkCi","ver":1},"status":{"status":"write"}}},{"id":"1_1613238969.172609_89.1","section":"bucket.instance","name":"ejuwhf-6:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.12","timestamp":"2021-02-13 17:56:09.172609871Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_zCjiECQrQYftP3tksmjEkCi","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238969.178077_90.1","section":"bucket","name":"ejuwhf-6","timestamp":"2021-02-13 17:56:09.178077356Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_oL1JaCHeOTBFodmq4Vo462S","ver":1},"status":{"status":"write"}}},{"id":"1_1613238969.189167_91.1","section":"bucket","name":"ejuwhf-6","timestamp":"2021-02-13 17:56:09.189167254Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_oL1JaCHeOTBFodmq4Vo462S","ver":1},"status":{"status":"abort"}}},{"id":"1_1613238969.199338_92.1","section":"bucket.instance","name":"ejuwhf-6:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.12","timestamp":"2021-02-13 17:56:09.199338685Z","data":{"read_version":{"tag":"_zCjiECQrQYftP3tksmjEkCi","ver":1},"write_version":{"tag":"_zCjiECQrQYftP3tksmjEkCi","ver":2},"status":{"status":"remove"}}},{"id":"1_1613238969.214181_93.1","section":"bucket.instance","name":"ejuwhf-6:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.12","timestamp":"2021-02-13 17:56:09.214181526Z","data":{"read_version":{"tag":"_zCjiECQrQYftP3tksmjEkCi","ver":1},"write_version":{"tag":"_zCjiECQrQYftP3tksmjEkCi","ver":2},"status":{"status":"complete"}}},{"id":"1_1613238970.008086_94.1","section":"bucket.instance","name":"ejuwhf-4:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.13","timestamp":"2021-02-13 17:56:10.008086848Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_v1tc2RjtPRbgReNqKENKBra","ver":1},"status":{"status":"write"}}},{"id":"1_1613238970.012670_95.1","section":"bucket.instance","name":"ejuwhf-4:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.13","timestamp":"2021-02-13 17:56:10.012670714Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_v1tc2RjtPRbgReNqKENKBra","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238970.014042_96.1","section":"bucket","name":"ejuwhf-4","timestamp":"2021-02-13 17:56:10.014042198Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_jKuSp21Zxke6SyefbVS70eh","ver":1},"status":{"status":"write"}}},{"id":"1_1613238970.016320_97.1","section":"bucket","name":"ejuwhf-4","timestamp":"2021-02-13 17:56:10.016320019Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_jKuSp21Zxke6SyefbVS70eh","ver":1},"status":{"status":"abort"}}},{"id":"1_1613238970.018539_98.1","section":"bucket.instance","name":"ejuwhf-4:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.13","timestamp":"2021-02-13 17:56:10.018539949Z","data":{"read_version":{"tag":"_v1tc2RjtPRbgReNqKENKBra","ver":1},"write_version":{"tag":"_v1tc2RjtPRbgReNqKENKBra","ver":2},"status":{"status":"remove"}}},{"id":"1_1613238970.022074_99.1","section":"bucket.instance","name":"ejuwhf-4:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.13","timestamp":"2021-02-13 17:56:10.022074729Z","data":{"read_version":{"tag":"_v1tc2RjtPRbgReNqKENKBra","ver":1},"write_version":{"tag":"_v1tc2RjtPRbgReNqKENKBra","ver":2},"status":{"status":"complete"}}},{"id":"1_1613238970.038564_100.1","section":"bucket.instance","name":"ejuwhf-5:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.14","timestamp":"2021-02-13 17:56:10.038564464Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Xxy0kA0Wvug2PQ7muelD8wi","ver":1},"status":{"status":"write"}}},{"id":"1_1613238970.043284_101.1","section":"bucket.instance","name":"ejuwhf-5:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.14","timestamp":"2021-02-13 17:56:10.043284541Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Xxy0kA0Wvug2PQ7muelD8wi","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238970.045447_102.1","section":"bucket","name":"ejuwhf-5","timestamp":"2021-02-13 17:56:10.045447439Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_4o9pGwW2NxyPbqj-tJaLONx","ver":1},"status":{"status":"write"}}},{"id":"1_1613238970.049722_103.1","section":"bucket","name":"ejuwhf-5","timestamp":"2021-02-13 17:56:10.049722714Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_4o9pGwW2NxyPbqj-tJaLONx","ver":1},"status":{"status":"abort"}}},{"id":"1_1613238970.053833_104.1","section":"bucket.instance","name":"ejuwhf-5:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.14","timestamp":"2021-02-13 17:56:10.053833249Z","data":{"read_version":{"tag":"_Xxy0kA0Wvug2PQ7muelD8wi","ver":1},"write_version":{"tag":"_Xxy0kA0Wvug2PQ7muelD8wi","ver":2},"status":{"status":"remove"}}},{"id":"1_1613238970.060705_105.1","section":"bucket.instance","name":"ejuwhf-5:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.14","timestamp":"2021-02-13 17:56:10.060705344Z","data":{"read_version":{"tag":"_Xxy0kA0Wvug2PQ7muelD8wi","ver":1},"write_version":{"tag":"_Xxy0kA0Wvug2PQ7muelD8wi","ver":2},"status":{"status":"complete"}}},{"id":"1_1613238970.135374_106.1","section":"bucket.instance","name":"ejuwhf-6:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.15","timestamp":"2021-02-13 17:56:10.135374943Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_eq-mn_enn9JS0uzsAd-kc3u","ver":1},"status":{"status":"write"}}},{"id":"1_1613238970.138703_107.1","section":"bucket.instance","name":"ejuwhf-6:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.15","timestamp":"2021-02-13 17:56:10.138703651Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_eq-mn_enn9JS0uzsAd-kc3u","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238970.140040_108.1","section":"bucket","name":"ejuwhf-6","timestamp":"2021-02-13 17:56:10.140040095Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_wcze0QNXW6OpN55syVKmWYX","ver":1},"status":{"status":"write"}}},{"id":"1_1613238970.143082_109.1","section":"bucket","name":"ejuwhf-6","timestamp":"2021-02-13 17:56:10.143082486Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_wcze0QNXW6OpN55syVKmWYX","ver":1},"status":{"status":"abort"}}},{"id":"1_1613238970.145487_110.1","section":"bucket.instance","name":"ejuwhf-6:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.15","timestamp":"2021-02-13 17:56:10.145487685Z","data":{"read_version":{"tag":"_eq-mn_enn9JS0uzsAd-kc3u","ver":1},"write_version":{"tag":"_eq-mn_enn9JS0uzsAd-kc3u","ver":2},"status":{"status":"remove"}}},{"id":"1_1613238970.149013_111.1","section":"bucket.instance","name":"ejuwhf-6:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.15","timestamp":"2021-02-13 17:56:10.149013694Z","data":{"read_version":{"tag":"_eq-mn_enn9JS0uzsAd-kc3u","ver":1},"write_version":{"tag":"_eq-mn_enn9JS0uzsAd-kc3u","ver":2},"status":{"status":"complete"}}},{"id":"1_1613238983.138841_112.1","section":"bucket.instance","name":"ejuwhf-7:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.16","timestamp":"2021-02-13 17:56:23.138841633Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_6gToYEDMo15odl3q3-L3Vdk","ver":1},"status":{"status":"write"}}},{"id":"1_1613238983.154116_113.1","section":"bucket.instance","name":"ejuwhf-7:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.16","timestamp":"2021-02-13 17:56:23.154116996Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_6gToYEDMo15odl3q3-L3Vdk","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238983.159663_114.1","section":"bucket","name":"ejuwhf-7","timestamp":"2021-02-13 17:56:23.159663722Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_vMCydHAxj_7QuSB-qm9iUeu","ver":1},"status":{"status":"write"}}},{"id":"1_1613238983.175427_115.1","section":"bucket","name":"ejuwhf-7","timestamp":"2021-02-13 17:56:23.175427702Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_vMCydHAxj_7QuSB-qm9iUeu","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238983.204618_116.1","section":"bucket.instance","name":"ejuwhf-8:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.17","timestamp":"2021-02-13 17:56:23.204618338Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Hdp3JF03_d_n4JjDXpJzu0M","ver":1},"status":{"status":"write"}}},{"id":"1_1613238983.219872_117.1","section":"bucket.instance","name":"ejuwhf-8:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.17","timestamp":"2021-02-13 17:56:23.219872258Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Hdp3JF03_d_n4JjDXpJzu0M","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238983.225498_118.1","section":"bucket","name":"ejuwhf-8","timestamp":"2021-02-13 17:56:23.225498137Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_MGOREBZ0hisc7Gbu7eA5JrS","ver":1},"status":{"status":"write"}}},{"id":"1_1613238983.241003_119.1","section":"bucket","name":"ejuwhf-8","timestamp":"2021-02-13 17:56:23.241003542Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_MGOREBZ0hisc7Gbu7eA5JrS","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238983.303585_120.1","section":"bucket.instance","name":"ejuwhf-9:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.18","timestamp":"2021-02-13 17:56:23.303585683Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_jRCaQz5FozM4nex7-DOl0kP","ver":1},"status":{"status":"write"}}},{"id":"1_1613238983.318865_121.1","section":"bucket.instance","name":"ejuwhf-9:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.18","timestamp":"2021-02-13 17:56:23.318865612Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_jRCaQz5FozM4nex7-DOl0kP","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238983.325660_122.1","section":"bucket","name":"ejuwhf-9","timestamp":"2021-02-13 17:56:23.325660323Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_YYkgNX9vj3hntComaoMK5U7","ver":1},"status":{"status":"write"}}},{"id":"1_1613238983.341158_123.1","section":"bucket","name":"ejuwhf-9","timestamp":"2021-02-13 17:56:23.341158692Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_YYkgNX9vj3hntComaoMK5U7","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238989.616147_124.1","section":"bucket","name":"ejuwhf-7","timestamp":"2021-02-13 17:56:29.616147126Z","data":{"read_version":{"tag":"_vMCydHAxj_7QuSB-qm9iUeu","ver":1},"write_version":{"tag":"_vMCydHAxj_7QuSB-qm9iUeu","ver":2},"status":{"status":"remove"}}},{"id":"1_1613238989.631574_125.1","section":"bucket","name":"ejuwhf-7","timestamp":"2021-02-13 17:56:29.631574106Z","data":{"read_version":{"tag":"_vMCydHAxj_7QuSB-qm9iUeu","ver":1},"write_version":{"tag":"_vMCydHAxj_7QuSB-qm9iUeu","ver":2},"status":{"status":"complete"}}},{"id":"1_1613238989.670248_126.1","section":"bucket","name":"ejuwhf-8","timestamp":"2021-02-13 17:56:29.670248409Z","data":{"read_version":{"tag":"_MGOREBZ0hisc7Gbu7eA5JrS","ver":1},"write_version":{"tag":"_MGOREBZ0hisc7Gbu7eA5JrS","ver":2},"status":{"status":"remove"}}},{"id":"1_1613238989.685454_127.1","section":"bucket","name":"ejuwhf-8","timestamp":"2021-02-13 17:56:29.685454067Z","data":{"read_version":{"tag":"_MGOREBZ0hisc7Gbu7eA5JrS","ver":1},"write_version":{"tag":"_MGOREBZ0hisc7Gbu7eA5JrS","ver":2},"status":{"status":"complete"}}},{"id":"1_1613238989.754736_128.1","section":"bucket","name":"ejuwhf-9","timestamp":"2021-02-13 17:56:29.754736933Z","data":{"read_version":{"tag":"_YYkgNX9vj3hntComaoMK5U7","ver":1},"write_version":{"tag":"_YYkgNX9vj3hntComaoMK5U7","ver":2},"status":{"status":"remove"}}},{"id":"1_1613238989.770436_129.1","section":"bucket","name":"ejuwhf-9","timestamp":"2021-02-13 17:56:29.770436155Z","data":{"read_version":{"tag":"_YYkgNX9vj3hntComaoMK5U7","ver":1},"write_version":{"tag":"_YYkgNX9vj3hntComaoMK5U7","ver":2},"status":{"status":"complete"}}},{"id":"1_1613238996.408432_20.1","section":"bucket.instance","name":"ejuwhf-10:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.19","timestamp":"2021-02-13 17:56:36.408432478Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_4l67hELsPgMja42xS8A6UhZ","ver":1},"status":{"status":"write"}}},{"id":"1_1613238996.425111_21.1","section":"bucket.instance","name":"ejuwhf-10:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.19","timestamp":"2021-02-13 17:56:36.425111236Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_4l67hELsPgMja42xS8A6UhZ","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238996.431060_22.1","section":"bucket","name":"ejuwhf-10","timestamp":"2021-02-13 17:56:36.431060604Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_xJby3h3bIk5vujQVV2pSTI-","ver":1},"status":{"status":"write"}}},{"id":"1_1613238996.446399_23.1","section":"bucket","name":"ejuwhf-10","timestamp":"2021-02-13 17:56:36.446399505Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_xJby3h3bIk5vujQVV2pSTI-","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238996.476122_24.1","section":"bucket.instance","name":"ejuwhf-11:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.20","timestamp":"2021-02-13 17:56:36.476122639Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_BCqsB66WxEPsrV6oYaSn_X-","ver":1},"status":{"status":"write"}}},{"id":"1_1613238996.491357_25.1","section":"bucket.instance","name":"ejuwhf-11:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.20","timestamp":"2021-02-13 17:56:36.491357838Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_BCqsB66WxEPsrV6oYaSn_X-","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238996.497273_26.1","section":"bucket","name":"ejuwhf-11","timestamp":"2021-02-13 17:56:36.497273035Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ojdkozIRvVsoWlCTyPLaGvj","ver":1},"status":{"status":"write"}}},{"id":"1_1613238996.512730_27.1","section":"bucket","name":"ejuwhf-11","timestamp":"2021-02-13 17:56:36.512730394Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ojdkozIRvVsoWlCTyPLaGvj","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238996.571112_28.1","section":"bucket.instance","name":"ejuwhf-12:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.21","timestamp":"2021-02-13 17:56:36.571112397Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_r6gSqSaTmTbReYf0uGy8_aC","ver":1},"status":{"status":"write"}}},{"id":"1_1613238996.586525_29.1","section":"bucket.instance","name":"ejuwhf-12:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.21","timestamp":"2021-02-13 17:56:36.586525109Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_r6gSqSaTmTbReYf0uGy8_aC","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238996.592228_30.1","section":"bucket","name":"ejuwhf-12","timestamp":"2021-02-13 17:56:36.592228025Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_--CaWqDYGbvQ4rZIucE1e-K","ver":1},"status":{"status":"write"}}},{"id":"1_1613238996.608007_31.1","section":"bucket","name":"ejuwhf-12","timestamp":"2021-02-13 17:56:36.608007431Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_--CaWqDYGbvQ4rZIucE1e-K","ver":1},"status":{"status":"complete"}}},{"id":"1_1613239321.080300_38.1","section":"bucket.instance","name":"ejuwhf-13:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.22","timestamp":"2021-02-13 18:02:01.080300919Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_78_uv7fHwaN7Qq4cyWhHLJz","ver":1},"status":{"status":"write"}}},{"id":"1_1613239321.097646_39.1","section":"bucket.instance","name":"ejuwhf-13:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.22","timestamp":"2021-02-13 18:02:01.097646161Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_78_uv7fHwaN7Qq4cyWhHLJz","ver":1},"status":{"status":"complete"}}},{"id":"1_1613239321.103822_40.1","section":"bucket","name":"ejuwhf-13","timestamp":"2021-02-13 18:02:01.103822896Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_lALUDndfu0TuP5K39wzC8in","ver":1},"status":{"status":"write"}}},{"id":"1_1613239321.120036_41.1","section":"bucket","name":"ejuwhf-13","timestamp":"2021-02-13 18:02:01.120036765Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_lALUDndfu0TuP5K39wzC8in","ver":1},"status":{"status":"complete"}}},{"id":"1_1613239321.157244_42.1","section":"bucket.instance","name":"ejuwhf-14:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.23","timestamp":"2021-02-13 18:02:01.157244195Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_fjpp4stMsyB7r2vHCXiSEql","ver":1},"status":{"status":"write"}}},{"id":"1_1613239321.173727_43.1","section":"bucket.instance","name":"ejuwhf-14:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.23","timestamp":"2021-02-13 18:02:01.173727725Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_fjpp4stMsyB7r2vHCXiSEql","ver":1},"status":{"status":"complete"}}},{"id":"1_1613239321.180183_44.1","section":"bucket","name":"ejuwhf-14","timestamp":"2021-02-13 18:02:01.180183919Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_lw1mkbLyJ3o-_DlonZo1SDZ","ver":1},"status":{"status":"write"}}},{"id":"1_1613239321.196368_45.1","section":"bucket","name":"ejuwhf-14","timestamp":"2021-02-13 18:02:01.196368937Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_lw1mkbLyJ3o-_DlonZo1SDZ","ver":1},"status":{"status":"complete"}}},{"id":"1_1613239321.265331_46.1","section":"bucket.instance","name":"ejuwhf-15:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.24","timestamp":"2021-02-13 18:02:01.265331350Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_uR_U3DJvBMRDbNsj1s38fR9","ver":1},"status":{"status":"write"}}},{"id":"1_1613239321.281670_47.1","section":"bucket.instance","name":"ejuwhf-15:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.24","timestamp":"2021-02-13 18:02:01.281670891Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_uR_U3DJvBMRDbNsj1s38fR9","ver":1},"status":{"status":"complete"}}},{"id":"1_1613239321.288543_48.1","section":"bucket","name":"ejuwhf-15","timestamp":"2021-02-13 18:02:01.288543122Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_k0PgphUQ7BAgCgZzpBUzBNN","ver":1},"status":{"status":"write"}}},{"id":"1_1613239321.305535_49.1","section":"bucket","name":"ejuwhf-15","timestamp":"2021-02-13 18:02:01.305535796Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_k0PgphUQ7BAgCgZzpBUzBNN","ver":1},"status":{"status":"complete"}}},{"id":"1_1613239643.733725_59.1","section":"bucket.instance","name":"ejuwhf-16:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.25","timestamp":"2021-02-13 18:07:23.733725000Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_nrprWx7VCq8YBJvRP_pJfT4","ver":1},"status":{"status":"write"}}},{"id":"1_1613239643.749943_60.1","section":"bucket.instance","name":"ejuwhf-16:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.25","timestamp":"2021-02-13 18:07:23.749943843Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_nrprWx7VCq8YBJvRP_pJfT4","ver":1},"status":{"status":"complete"}}},{"id":"1_1613239643.755418_61.1","section":"bucket","name":"ejuwhf-16","timestamp":"2021-02-13 18:07:23.755418869Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_LBYOapPliGlX3yh25unm84s","ver":1},"status":{"status":"write"}}},{"id":"1_1613239643.771083_62.1","section":"bucket","name":"ejuwhf-16","timestamp":"2021-02-13 18:07:23.771083206Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_LBYOapPliGlX3yh25unm84s","ver":1},"status":{"status":"complete"}}},{"id":"1_1613239643.806893_63.1","section":"bucket.instance","name":"ejuwhf-17:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.26","timestamp":"2021-02-13 18:07:23.806893724Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_8ovGbH1o6FvQnTtXB8s_UQm","ver":1},"status":{"status":"write"}}},{"id":"1_1613239643.822147_64.1","section":"bucket.instance","name":"ejuwhf-17:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.26","timestamp":"2021-02-13 18:07:23.822147852Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_8ovGbH1o6FvQnTtXB8s_UQm","ver":1},"status":{"status":"complete"}}},{"id":"1_1613239643.828619_65.1","section":"bucket","name":"ejuwhf-17","timestamp":"2021-02-13 18:07:23.828619399Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_h5MGnGsOEE9cFxGphgLOG3x","ver":1},"status":{"status":"write"}}},{"id":"1_1613239643.843279_66.1","section":"bucket","name":"ejuwhf-17","timestamp":"2021-02-13 18:07:23.843279069Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_h5MGnGsOEE9cFxGphgLOG3x","ver":1},"status":{"status":"complete"}}},{"id":"1_1613239643.906536_67.1","section":"bucket.instance","name":"ejuwhf-18:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.27","timestamp":"2021-02-13 18:07:23.906536499Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_YkOje16YwjBiAb0w6q8pqfO","ver":1},"status":{"status":"write"}}},{"id":"1_1613239643.922078_68.1","section":"bucket.instance","name":"ejuwhf-18:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.27","timestamp":"2021-02-13 18:07:23.922078168Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_YkOje16YwjBiAb0w6q8pqfO","ver":1},"status":{"status":"complete"}}},{"id":"1_1613239643.928111_69.1","section":"bucket","name":"ejuwhf-18","timestamp":"2021-02-13 18:07:23.928111593Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_2fiWbEVMEWvujFO3XL_4NjI","ver":1},"status":{"status":"write"}}},{"id":"1_1613239643.944698_70.1","section":"bucket","name":"ejuwhf-18","timestamp":"2021-02-13 18:07:23.944698661Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_2fiWbEVMEWvujFO3XL_4NjI","ver":1},"status":{"status":"complete"}}},{"id":"1_1613239643.992830_71.1","section":"bucket.instance","name":"ejuwhf-16:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.25","timestamp":"2021-02-13 18:07:23.992830606Z","data":{"read_version":{"tag":"_nrprWx7VCq8YBJvRP_pJfT4","ver":1},"write_version":{"tag":"_nrprWx7VCq8YBJvRP_pJfT4","ver":2},"status":{"status":"write"}}},{"id":"1_1613239644.009885_72.1","section":"bucket.instance","name":"ejuwhf-16:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.25","timestamp":"2021-02-13 18:07:24.009885261Z","data":{"read_version":{"tag":"_nrprWx7VCq8YBJvRP_pJfT4","ver":1},"write_version":{"tag":"_nrprWx7VCq8YBJvRP_pJfT4","ver":2},"status":{"status":"complete"}}},{"id":"1_1613239644.020434_73.1","section":"bucket.instance","name":"ejuwhf-17:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.26","timestamp":"2021-02-13 18:07:24.020434444Z","data":{"read_version":{"tag":"_8ovGbH1o6FvQnTtXB8s_UQm","ver":1},"write_version":{"tag":"_8ovGbH1o6FvQnTtXB8s_UQm","ver":2},"status":{"status":"write"}}},{"id":"1_1613239644.036282_74.1","section":"bucket.instance","name":"ejuwhf-17:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.26","timestamp":"2021-02-13 18:07:24.036282947Z","data":{"read_version":{"tag":"_8ovGbH1o6FvQnTtXB8s_UQm","ver":1},"write_version":{"tag":"_8ovGbH1o6FvQnTtXB8s_UQm","ver":2},"status":{"status":"complete"}}},{"id":"1_1613239644.055423_75.1","section":"bucket.instance","name":"ejuwhf-18:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.27","timestamp":"2021-02-13 18:07:24.055423607Z","data":{"read_version":{"tag":"_YkOje16YwjBiAb0w6q8pqfO","ver":1},"write_version":{"tag":"_YkOje16YwjBiAb0w6q8pqfO","ver":2},"status":{"status":"write"}}},{"id":"1_1613239644.070890_76.1","section":"bucket.instance","name":"ejuwhf-18:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.27","timestamp":"2021-02-13 18:07:24.070890569Z","data":{"read_version":{"tag":"_YkOje16YwjBiAb0w6q8pqfO","ver":1},"write_version":{"tag":"_YkOje16YwjBiAb0w6q8pqfO","ver":2},"status":{"status":"complete"}}},{"id":"1_1613239973.558856_84.1","section":"bucket.instance","name":"ejuwhf-19:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.28","timestamp":"2021-02-13 18:12:53.558856802Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_QLbnfIoGGaZIt0rwcmk-qti","ver":1},"status":{"status":"write"}}},{"id":"1_1613239973.575588_85.1","section":"bucket.instance","name":"ejuwhf-19:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.28","timestamp":"2021-02-13 18:12:53.575588311Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_QLbnfIoGGaZIt0rwcmk-qti","ver":1},"status":{"status":"complete"}}},{"id":"1_1613239973.581642_86.1","section":"bucket","name":"ejuwhf-19","timestamp":"2021-02-13 18:12:53.581642872Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_6FRUK8ncgnwrL2ZLGpRvips","ver":1},"status":{"status":"write"}}},{"id":"1_1613239973.597791_87.1","section":"bucket","name":"ejuwhf-19","timestamp":"2021-02-13 18:12:53.597791408Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_6FRUK8ncgnwrL2ZLGpRvips","ver":1},"status":{"status":"complete"}}},{"id":"1_1613239973.618317_88.1","section":"bucket.instance","name":"ejuwhf-19:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.28","timestamp":"2021-02-13 18:12:53.618317926Z","data":{"read_version":{"tag":"_QLbnfIoGGaZIt0rwcmk-qti","ver":1},"write_version":{"tag":"_QLbnfIoGGaZIt0rwcmk-qti","ver":2},"status":{"status":"write"}}},{"id":"1_1613239973.634814_89.1","section":"bucket.instance","name":"ejuwhf-19:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.28","timestamp":"2021-02-13 18:12:53.634814126Z","data":{"read_version":{"tag":"_QLbnfIoGGaZIt0rwcmk-qti","ver":1},"write_version":{"tag":"_QLbnfIoGGaZIt0rwcmk-qti","ver":2},"status":{"status":"complete"}}},{"id":"1_1613240298.200387_96.1","section":"bucket.instance","name":"ejuwhf-20:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.29","timestamp":"2021-02-13 18:18:18.200387564Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_zG-4FJP4lrTan5vmKfxkgxY","ver":1},"status":{"status":"write"}}},{"id":"1_1613240298.216338_97.1","section":"bucket.instance","name":"ejuwhf-20:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.29","timestamp":"2021-02-13 18:18:18.216338639Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_zG-4FJP4lrTan5vmKfxkgxY","ver":1},"status":{"status":"complete"}}},{"id":"1_1613240298.221718_98.1","section":"bucket","name":"ejuwhf-20","timestamp":"2021-02-13 18:18:18.221718896Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_hjd9VzRPYHn39EeVUieezBi","ver":1},"status":{"status":"write"}}},{"id":"1_1613240298.236365_99.1","section":"bucket","name":"ejuwhf-20","timestamp":"2021-02-13 18:18:18.236365179Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_hjd9VzRPYHn39EeVUieezBi","ver":1},"status":{"status":"complete"}}},{"id":"1_1613240621.656212_103.1","section":"bucket.instance","name":"ejuwhf-21:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.30","timestamp":"2021-02-13 18:23:41.656212918Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_PI91VmrZ-dDN5s_JIZJAPOu","ver":1},"status":{"status":"write"}}},{"id":"1_1613240621.672322_104.1","section":"bucket.instance","name":"ejuwhf-21:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.30","timestamp":"2021-02-13 18:23:41.672322312Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_PI91VmrZ-dDN5s_JIZJAPOu","ver":1},"status":{"status":"complete"}}},{"id":"1_1613240621.678630_105.1","section":"bucket","name":"ejuwhf-21","timestamp":"2021-02-13 18:23:41.678630564Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_QJCL0oRPCaZnOLc3FqHRPYX","ver":1},"status":{"status":"write"}}},{"id":"1_1613240621.693560_106.1","section":"bucket","name":"ejuwhf-21","timestamp":"2021-02-13 18:23:41.693560697Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_QJCL0oRPCaZnOLc3FqHRPYX","ver":1},"status":{"status":"complete"}}},{"id":"1_1613240621.741301_107.1","section":"bucket.instance","name":"ejuwhf-22:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.31","timestamp":"2021-02-13 18:23:41.741301484Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_hl5-x8kVDYpS5w-oh53bPCW","ver":1},"status":{"status":"write"}}},{"id":"1_1613240621.757529_108.1","section":"bucket.instance","name":"ejuwhf-22:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.31","timestamp":"2021-02-13 18:23:41.757529664Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_hl5-x8kVDYpS5w-oh53bPCW","ver":1},"status":{"status":"complete"}}},{"id":"1_1613240621.762982_109.1","section":"bucket","name":"ejuwhf-22","timestamp":"2021-02-13 18:23:41.762982204Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_qyPb-YYouea6Artq7SRkTtW","ver":1},"status":{"status":"write"}}},{"id":"1_1613240621.778531_110.1","section":"bucket","name":"ejuwhf-22","timestamp":"2021-02-13 18:23:41.778531566Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_qyPb-YYouea6Artq7SRkTtW","ver":1},"status":{"status":"complete"}}},{"id":"1_1613240621.852919_111.1","section":"bucket.instance","name":"ejuwhf-23:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.32","timestamp":"2021-02-13 18:23:41.852919112Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Zi3cYMrdm4uEttRZYVVoHN6","ver":1},"status":{"status":"write"}}},{"id":"1_1613240621.869034_112.1","section":"bucket.instance","name":"ejuwhf-23:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.32","timestamp":"2021-02-13 18:23:41.869034552Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Zi3cYMrdm4uEttRZYVVoHN6","ver":1},"status":{"status":"complete"}}},{"id":"1_1613240621.874580_113.1","section":"bucket","name":"ejuwhf-23","timestamp":"2021-02-13 18:23:41.874580193Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_HU3tbDLtK_l1Ht1UbiwZmmt","ver":1},"status":{"status":"write"}}},{"id":"1_1613240621.889892_114.1","section":"bucket","name":"ejuwhf-23","timestamp":"2021-02-13 18:23:41.889892437Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_HU3tbDLtK_l1Ht1UbiwZmmt","ver":1},"status":{"status":"complete"}}},{"id":"1_1613240621.938311_115.1","section":"bucket.instance","name":"ejuwhf-21:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.30","timestamp":"2021-02-13 18:23:41.938311534Z","data":{"read_version":{"tag":"_PI91VmrZ-dDN5s_JIZJAPOu","ver":1},"write_version":{"tag":"_PI91VmrZ-dDN5s_JIZJAPOu","ver":2},"status":{"status":"write"}}},{"id":"1_1613240621.954359_116.1","section":"bucket.instance","name":"ejuwhf-21:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.30","timestamp":"2021-02-13 18:23:41.954359504Z","data":{"read_version":{"tag":"_PI91VmrZ-dDN5s_JIZJAPOu","ver":1},"write_version":{"tag":"_PI91VmrZ-dDN5s_JIZJAPOu","ver":2},"status":{"status":"complete"}}},{"id":"1_1613240621.972224_117.1","section":"bucket.instance","name":"ejuwhf-22:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.31","timestamp":"2021-02-13 18:23:41.972224734Z","data":{"read_version":{"tag":"_hl5-x8kVDYpS5w-oh53bPCW","ver":1},"write_version":{"tag":"_hl5-x8kVDYpS5w-oh53bPCW","ver":2},"status":{"status":"write"}}},{"id":"1_1613240621.988926_118.1","section":"bucket.instance","name":"ejuwhf-22:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.31","timestamp":"2021-02-13 18:23:41.988926707Z","data":{"read_version":{"tag":"_hl5-x8kVDYpS5w-oh53bPCW","ver":1},"write_version":{"tag":"_hl5-x8kVDYpS5w-oh53bPCW","ver":2},"status":{"status":"complete"}}},{"id":"1_1613240622.014812_119.1","section":"bucket.instance","name":"ejuwhf-23:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.32","timestamp":"2021-02-13 18:23:42.014812172Z","data":{"read_version":{"tag":"_Zi3cYMrdm4uEttRZYVVoHN6","ver":1},"write_version":{"tag":"_Zi3cYMrdm4uEttRZYVVoHN6","ver":2},"status":{"status":"write"}}},{"id":"1_1613240622.031550_120.1","section":"bucket.instance","name":"ejuwhf-23:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.32","timestamp":"2021-02-13 18:23:42.031550983Z","data":{"read_version":{"tag":"_Zi3cYMrdm4uEttRZYVVoHN6","ver":1},"write_version":{"tag":"_Zi3cYMrdm4uEttRZYVVoHN6","ver":2},"status":{"status":"complete"}}},{"id":"1_1613240942.057496_129.1","section":"bucket.instance","name":"ejuwhf-24:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.33","timestamp":"2021-02-13 18:29:02.057496314Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Mymfhn6ginn73AnD7ml29g5","ver":1},"status":{"status":"write"}}},{"id":"1_1613240942.074249_130.1","section":"bucket.instance","name":"ejuwhf-24:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.33","timestamp":"2021-02-13 18:29:02.074249549Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Mymfhn6ginn73AnD7ml29g5","ver":1},"status":{"status":"complete"}}},{"id":"1_1613240942.080340_131.1","section":"bucket","name":"ejuwhf-24","timestamp":"2021-02-13 18:29:02.080340488Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_LXwSzpg4EyuMmTpiPZjf1cc","ver":1},"status":{"status":"write"}}},{"id":"1_1613240942.096212_132.1","section":"bucket","name":"ejuwhf-24","timestamp":"2021-02-13 18:29:02.096212692Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_LXwSzpg4EyuMmTpiPZjf1cc","ver":1},"status":{"status":"complete"}}},{"id":"1_1613240942.132341_133.1","section":"bucket.instance","name":"ejuwhf-25:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.34","timestamp":"2021-02-13 18:29:02.132341526Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_uMJzQ5xiX1YlCrcj1HBDDd1","ver":1},"status":{"status":"write"}}},{"id":"1_1613240942.147778_134.1","section":"bucket.instance","name":"ejuwhf-25:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.34","timestamp":"2021-02-13 18:29:02.147778756Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_uMJzQ5xiX1YlCrcj1HBDDd1","ver":1},"status":{"status":"complete"}}},{"id":"1_1613240942.153287_135.1","section":"bucket","name":"ejuwhf-25","timestamp":"2021-02-13 18:29:02.153287603Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_A3dK8rBY3svnWMIeKILt9Z_","ver":1},"status":{"status":"write"}}},{"id":"1_1613240942.168281_136.1","section":"bucket","name":"ejuwhf-25","timestamp":"2021-02-13 18:29:02.168281459Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_A3dK8rBY3svnWMIeKILt9Z_","ver":1},"status":{"status":"complete"}}},{"id":"1_1613240942.238318_137.1","section":"bucket.instance","name":"ejuwhf-26:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.35","timestamp":"2021-02-13 18:29:02.238318066Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_L3Z-v3OBQisJH8Y-dXJplsy","ver":1},"status":{"status":"write"}}},{"id":"1_1613240942.254572_138.1","section":"bucket.instance","name":"ejuwhf-26:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.35","timestamp":"2021-02-13 18:29:02.254572785Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_L3Z-v3OBQisJH8Y-dXJplsy","ver":1},"status":{"status":"complete"}}},{"id":"1_1613240942.260239_139.1","section":"bucket","name":"ejuwhf-26","timestamp":"2021-02-13 18:29:02.260239723Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_cPHMuqLQT9Fp0sttVt7JMgo","ver":1},"status":{"status":"write"}}},{"id":"1_1613240942.275753_140.1","section":"bucket","name":"ejuwhf-26","timestamp":"2021-02-13 18:29:02.275753150Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_cPHMuqLQT9Fp0sttVt7JMgo","ver":1},"status":{"status":"complete"}}},{"id":"1_1613240942.328657_141.1","section":"bucket.instance","name":"ejuwhf-24:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.33","timestamp":"2021-02-13 18:29:02.328657731Z","data":{"read_version":{"tag":"_Mymfhn6ginn73AnD7ml29g5","ver":1},"write_version":{"tag":"_Mymfhn6ginn73AnD7ml29g5","ver":2},"status":{"status":"write"}}},{"id":"1_1613240942.344935_142.1","section":"bucket.instance","name":"ejuwhf-24:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.33","timestamp":"2021-02-13 18:29:02.344935201Z","data":{"read_version":{"tag":"_Mymfhn6ginn73AnD7ml29g5","ver":1},"write_version":{"tag":"_Mymfhn6ginn73AnD7ml29g5","ver":2},"status":{"status":"complete"}}},{"id":"1_1613240942.353878_143.1","section":"bucket.instance","name":"ejuwhf-24:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.33","timestamp":"2021-02-13 18:29:02.353878692Z","data":{"read_version":{"tag":"_Mymfhn6ginn73AnD7ml29g5","ver":2},"write_version":{"tag":"_Mymfhn6ginn73AnD7ml29g5","ver":3},"status":{"status":"write"}}},{"id":"1_1613240942.370130_144.1","section":"bucket.instance","name":"ejuwhf-24:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.33","timestamp":"2021-02-13 18:29:02.370130831Z","data":{"read_version":{"tag":"_Mymfhn6ginn73AnD7ml29g5","ver":2},"write_version":{"tag":"_Mymfhn6ginn73AnD7ml29g5","ver":3},"status":{"status":"complete"}}},{"id":"1_1613240942.382481_145.1","section":"bucket.instance","name":"ejuwhf-25:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.34","timestamp":"2021-02-13 18:29:02.382481780Z","data":{"read_version":{"tag":"_uMJzQ5xiX1YlCrcj1HBDDd1","ver":1},"write_version":{"tag":"_uMJzQ5xiX1YlCrcj1HBDDd1","ver":2},"status":{"status":"write"}}},{"id":"1_1613240942.399166_146.1","section":"bucket.instance","name":"ejuwhf-25:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.34","timestamp":"2021-02-13 18:29:02.399166568Z","data":{"read_version":{"tag":"_uMJzQ5xiX1YlCrcj1HBDDd1","ver":1},"write_version":{"tag":"_uMJzQ5xiX1YlCrcj1HBDDd1","ver":2},"status":{"status":"complete"}}},{"id":"1_1613240942.421493_147.1","section":"bucket.instance","name":"ejuwhf-25:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.34","timestamp":"2021-02-13 18:29:02.421493448Z","data":{"read_version":{"tag":"_uMJzQ5xiX1YlCrcj1HBDDd1","ver":2},"write_version":{"tag":"_uMJzQ5xiX1YlCrcj1HBDDd1","ver":3},"status":{"status":"write"}}},{"id":"1_1613240942.437705_148.1","section":"bucket.instance","name":"ejuwhf-25:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.34","timestamp":"2021-02-13 18:29:02.437705406Z","data":{"read_version":{"tag":"_uMJzQ5xiX1YlCrcj1HBDDd1","ver":2},"write_version":{"tag":"_uMJzQ5xiX1YlCrcj1HBDDd1","ver":3},"status":{"status":"complete"}}},{"id":"1_1613240942.459839_149.1","section":"bucket.instance","name":"ejuwhf-26:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.35","timestamp":"2021-02-13 18:29:02.459839291Z","data":{"read_version":{"tag":"_L3Z-v3OBQisJH8Y-dXJplsy","ver":1},"write_version":{"tag":"_L3Z-v3OBQisJH8Y-dXJplsy","ver":2},"status":{"status":"write"}}},{"id":"1_1613240942.476918_150.1","section":"bucket.instance","name":"ejuwhf-26:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.35","timestamp":"2021-02-13 18:29:02.476918779Z","data":{"read_version":{"tag":"_L3Z-v3OBQisJH8Y-dXJplsy","ver":1},"write_version":{"tag":"_L3Z-v3OBQisJH8Y-dXJplsy","ver":2},"status":{"status":"complete"}}},{"id":"1_1613240942.499769_151.1","section":"bucket.instance","name":"ejuwhf-26:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.35","timestamp":"2021-02-13 18:29:02.499769496Z","data":{"read_version":{"tag":"_L3Z-v3OBQisJH8Y-dXJplsy","ver":2},"write_version":{"tag":"_L3Z-v3OBQisJH8Y-dXJplsy","ver":3},"status":{"status":"write"}}},{"id":"1_1613240942.515439_152.1","section":"bucket.instance","name":"ejuwhf-26:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.35","timestamp":"2021-02-13 18:29:02.515439820Z","data":{"read_version":{"tag":"_L3Z-v3OBQisJH8Y-dXJplsy","ver":2},"write_version":{"tag":"_L3Z-v3OBQisJH8Y-dXJplsy","ver":3},"status":{"status":"complete"}}},{"id":"1_1613241266.605637_161.1","section":"bucket.instance","name":"ejuwhf-27:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.36","timestamp":"2021-02-13 18:34:26.605637643Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_buhEDK5wV_BTZ1BfBOjuCtv","ver":1},"status":{"status":"write"}}},{"id":"1_1613241266.622739_162.1","section":"bucket.instance","name":"ejuwhf-27:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.36","timestamp":"2021-02-13 18:34:26.622739396Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_buhEDK5wV_BTZ1BfBOjuCtv","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241266.628411_163.1","section":"bucket","name":"ejuwhf-27","timestamp":"2021-02-13 18:34:26.628411671Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_cv0hC47mr82631TFimW_DVd","ver":1},"status":{"status":"write"}}},{"id":"1_1613241266.644465_164.1","section":"bucket","name":"ejuwhf-27","timestamp":"2021-02-13 18:34:26.644465762Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_cv0hC47mr82631TFimW_DVd","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241266.684520_165.1","section":"bucket.instance","name":"ejuwhf-28:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.37","timestamp":"2021-02-13 18:34:26.684520705Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Xd4FRhFK5zkknydU2nFa9wM","ver":1},"status":{"status":"write"}}},{"id":"1_1613241266.701308_166.1","section":"bucket.instance","name":"ejuwhf-28:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.37","timestamp":"2021-02-13 18:34:26.701308256Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Xd4FRhFK5zkknydU2nFa9wM","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241266.707762_167.1","section":"bucket","name":"ejuwhf-28","timestamp":"2021-02-13 18:34:26.707762712Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_fwmE9vPx54C_GLabnD2pr6O","ver":1},"status":{"status":"write"}}},{"id":"1_1613241266.723793_168.1","section":"bucket","name":"ejuwhf-28","timestamp":"2021-02-13 18:34:26.723793662Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_fwmE9vPx54C_GLabnD2pr6O","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241266.793975_169.1","section":"bucket.instance","name":"ejuwhf-29:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.38","timestamp":"2021-02-13 18:34:26.793975407Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_OYTb8fo0cI6eTvGgrw7zDVl","ver":1},"status":{"status":"write"}}},{"id":"1_1613241266.810889_170.1","section":"bucket.instance","name":"ejuwhf-29:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.38","timestamp":"2021-02-13 18:34:26.810889667Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_OYTb8fo0cI6eTvGgrw7zDVl","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241266.817391_171.1","section":"bucket","name":"ejuwhf-29","timestamp":"2021-02-13 18:34:26.817391051Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_8f7U215eIbZcyAN-0Ty-CHS","ver":1},"status":{"status":"write"}}},{"id":"1_1613241266.833518_172.1","section":"bucket","name":"ejuwhf-29","timestamp":"2021-02-13 18:34:26.833518174Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_8f7U215eIbZcyAN-0Ty-CHS","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241266.890012_173.1","section":"bucket.instance","name":"ejuwhf-27:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.36","timestamp":"2021-02-13 18:34:26.890012595Z","data":{"read_version":{"tag":"_buhEDK5wV_BTZ1BfBOjuCtv","ver":1},"write_version":{"tag":"_buhEDK5wV_BTZ1BfBOjuCtv","ver":2},"status":{"status":"write"}}},{"id":"1_1613241266.906758_174.1","section":"bucket.instance","name":"ejuwhf-27:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.36","timestamp":"2021-02-13 18:34:26.906758267Z","data":{"read_version":{"tag":"_buhEDK5wV_BTZ1BfBOjuCtv","ver":1},"write_version":{"tag":"_buhEDK5wV_BTZ1BfBOjuCtv","ver":2},"status":{"status":"complete"}}},{"id":"1_1613241266.965553_175.1","section":"bucket.instance","name":"ejuwhf-28:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.37","timestamp":"2021-02-13 18:34:26.965553236Z","data":{"read_version":{"tag":"_Xd4FRhFK5zkknydU2nFa9wM","ver":1},"write_version":{"tag":"_Xd4FRhFK5zkknydU2nFa9wM","ver":2},"status":{"status":"write"}}},{"id":"1_1613241266.983302_176.1","section":"bucket.instance","name":"ejuwhf-28:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.37","timestamp":"2021-02-13 18:34:26.983302909Z","data":{"read_version":{"tag":"_Xd4FRhFK5zkknydU2nFa9wM","ver":1},"write_version":{"tag":"_Xd4FRhFK5zkknydU2nFa9wM","ver":2},"status":{"status":"complete"}}},{"id":"1_1613241267.056149_177.1","section":"bucket.instance","name":"ejuwhf-29:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.38","timestamp":"2021-02-13 18:34:27.056149375Z","data":{"read_version":{"tag":"_OYTb8fo0cI6eTvGgrw7zDVl","ver":1},"write_version":{"tag":"_OYTb8fo0cI6eTvGgrw7zDVl","ver":2},"status":{"status":"write"}}},{"id":"1_1613241267.073356_178.1","section":"bucket.instance","name":"ejuwhf-29:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.38","timestamp":"2021-02-13 18:34:27.073356371Z","data":{"read_version":{"tag":"_OYTb8fo0cI6eTvGgrw7zDVl","ver":1},"write_version":{"tag":"_OYTb8fo0cI6eTvGgrw7zDVl","ver":2},"status":{"status":"complete"}}},{"id":"1_1613241267.151605_179.1","section":"bucket.instance","name":"ejuwhf-30:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.39","timestamp":"2021-02-13 18:34:27.151605712Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_xOOIxE04nsc05E_DBE8Tl4c","ver":1},"status":{"status":"write"}}},{"id":"1_1613241267.168752_180.1","section":"bucket.instance","name":"ejuwhf-30:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.39","timestamp":"2021-02-13 18:34:27.168752478Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_xOOIxE04nsc05E_DBE8Tl4c","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241267.174869_181.1","section":"bucket","name":"ejuwhf-30","timestamp":"2021-02-13 18:34:27.174869113Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_fXNqCzc4CG0kd9VOzBG9Q7P","ver":1},"status":{"status":"write"}}},{"id":"1_1613241267.190845_182.1","section":"bucket","name":"ejuwhf-30","timestamp":"2021-02-13 18:34:27.190845919Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_fXNqCzc4CG0kd9VOzBG9Q7P","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241267.225373_183.1","section":"bucket.instance","name":"ejuwhf-31:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.40","timestamp":"2021-02-13 18:34:27.225373782Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_vq-PbUFwVQj7aAfQtnD_3EU","ver":1},"status":{"status":"write"}}},{"id":"1_1613241267.242435_184.1","section":"bucket.instance","name":"ejuwhf-31:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.40","timestamp":"2021-02-13 18:34:27.242435556Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_vq-PbUFwVQj7aAfQtnD_3EU","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241267.248007_185.1","section":"bucket","name":"ejuwhf-31","timestamp":"2021-02-13 18:34:27.248007585Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_KctrzUTN-Z2qNoPxtPlfK8y","ver":1},"status":{"status":"write"}}},{"id":"1_1613241267.263145_186.1","section":"bucket","name":"ejuwhf-31","timestamp":"2021-02-13 18:34:27.263145093Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_KctrzUTN-Z2qNoPxtPlfK8y","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241267.328171_187.1","section":"bucket.instance","name":"ejuwhf-32:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.41","timestamp":"2021-02-13 18:34:27.328171763Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_pMTJ0sdLLeifyII2MXvLxTT","ver":1},"status":{"status":"write"}}},{"id":"1_1613241267.345082_188.1","section":"bucket.instance","name":"ejuwhf-32:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.41","timestamp":"2021-02-13 18:34:27.345082724Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_pMTJ0sdLLeifyII2MXvLxTT","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241267.350511_189.1","section":"bucket","name":"ejuwhf-32","timestamp":"2021-02-13 18:34:27.350511022Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ZBwWS6lgLvXfPlIIuMt3AtT","ver":1},"status":{"status":"write"}}},{"id":"1_1613241267.365375_190.1","section":"bucket","name":"ejuwhf-32","timestamp":"2021-02-13 18:34:27.365375654Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ZBwWS6lgLvXfPlIIuMt3AtT","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241267.427546_191.1","section":"bucket.instance","name":"ejuwhf-30:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.39","timestamp":"2021-02-13 18:34:27.427546507Z","data":{"read_version":{"tag":"_xOOIxE04nsc05E_DBE8Tl4c","ver":1},"write_version":{"tag":"_xOOIxE04nsc05E_DBE8Tl4c","ver":2},"status":{"status":"write"}}},{"id":"1_1613241267.443747_192.1","section":"bucket.instance","name":"ejuwhf-30:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.39","timestamp":"2021-02-13 18:34:27.443747325Z","data":{"read_version":{"tag":"_xOOIxE04nsc05E_DBE8Tl4c","ver":1},"write_version":{"tag":"_xOOIxE04nsc05E_DBE8Tl4c","ver":2},"status":{"status":"complete"}}},{"id":"1_1613241267.515491_193.1","section":"bucket.instance","name":"ejuwhf-31:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.40","timestamp":"2021-02-13 18:34:27.515491775Z","data":{"read_version":{"tag":"_vq-PbUFwVQj7aAfQtnD_3EU","ver":1},"write_version":{"tag":"_vq-PbUFwVQj7aAfQtnD_3EU","ver":2},"status":{"status":"write"}}},{"id":"1_1613241267.532248_194.1","section":"bucket.instance","name":"ejuwhf-31:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.40","timestamp":"2021-02-13 18:34:27.532248179Z","data":{"read_version":{"tag":"_vq-PbUFwVQj7aAfQtnD_3EU","ver":1},"write_version":{"tag":"_vq-PbUFwVQj7aAfQtnD_3EU","ver":2},"status":{"status":"complete"}}},{"id":"1_1613241267.614493_195.1","section":"bucket.instance","name":"ejuwhf-32:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.41","timestamp":"2021-02-13 18:34:27.614493922Z","data":{"read_version":{"tag":"_pMTJ0sdLLeifyII2MXvLxTT","ver":1},"write_version":{"tag":"_pMTJ0sdLLeifyII2MXvLxTT","ver":2},"status":{"status":"write"}}},{"id":"1_1613241267.631169_196.1","section":"bucket.instance","name":"ejuwhf-32:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.41","timestamp":"2021-02-13 18:34:27.631169929Z","data":{"read_version":{"tag":"_pMTJ0sdLLeifyII2MXvLxTT","ver":1},"write_version":{"tag":"_pMTJ0sdLLeifyII2MXvLxTT","ver":2},"status":{"status":"complete"}}},{"id":"1_1613241267.703455_197.1","section":"bucket.instance","name":"ejuwhf-33:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.42","timestamp":"2021-02-13 18:34:27.703455821Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_H8xnpAZEzqUOed9D6o8b0E0","ver":1},"status":{"status":"write"}}},{"id":"1_1613241267.709061_198.1","section":"bucket.instance","name":"ejuwhf-33:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.42","timestamp":"2021-02-13 18:34:27.709061094Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_H8xnpAZEzqUOed9D6o8b0E0","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241267.710918_199.1","section":"bucket","name":"ejuwhf-33","timestamp":"2021-02-13 18:34:27.710918130Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_5d9OIM7k69p0P0uAysQiRdG","ver":1},"status":{"status":"write"}}},{"id":"1_1613241267.716192_200.1","section":"bucket","name":"ejuwhf-33","timestamp":"2021-02-13 18:34:27.716192524Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_5d9OIM7k69p0P0uAysQiRdG","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241267.728031_201.1","section":"bucket.instance","name":"ejuwhf-34:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.43","timestamp":"2021-02-13 18:34:27.728031465Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_CRJvAYGaC5ssXc3dJv7KEk4","ver":1},"status":{"status":"write"}}},{"id":"1_1613241267.733121_202.1","section":"bucket.instance","name":"ejuwhf-34:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.43","timestamp":"2021-02-13 18:34:27.733121606Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_CRJvAYGaC5ssXc3dJv7KEk4","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241267.735002_203.1","section":"bucket","name":"ejuwhf-34","timestamp":"2021-02-13 18:34:27.735002139Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ro68eUWJTFM6zc_B6pTLzxQ","ver":1},"status":{"status":"write"}}},{"id":"1_1613241267.739821_204.1","section":"bucket","name":"ejuwhf-34","timestamp":"2021-02-13 18:34:27.739821981Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ro68eUWJTFM6zc_B6pTLzxQ","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241267.788853_205.1","section":"bucket.instance","name":"ejuwhf-35:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.44","timestamp":"2021-02-13 18:34:27.788853889Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_W0CjPxEhZ84WmkTK-IJS63R","ver":1},"status":{"status":"write"}}},{"id":"1_1613241267.805812_206.1","section":"bucket.instance","name":"ejuwhf-35:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.44","timestamp":"2021-02-13 18:34:27.805812011Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_W0CjPxEhZ84WmkTK-IJS63R","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241267.812537_207.1","section":"bucket","name":"ejuwhf-35","timestamp":"2021-02-13 18:34:27.812537791Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_3BdK8ESSfyzlLsuvW_K1IJj","ver":1},"status":{"status":"write"}}},{"id":"1_1613241267.829128_208.1","section":"bucket","name":"ejuwhf-35","timestamp":"2021-02-13 18:34:27.829128246Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_3BdK8ESSfyzlLsuvW_K1IJj","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241267.880158_209.1","section":"bucket.instance","name":"ejuwhf-33:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.42","timestamp":"2021-02-13 18:34:27.880158053Z","data":{"read_version":{"tag":"_H8xnpAZEzqUOed9D6o8b0E0","ver":1},"write_version":{"tag":"_H8xnpAZEzqUOed9D6o8b0E0","ver":2},"status":{"status":"write"}}},{"id":"1_1613241267.897939_210.1","section":"bucket.instance","name":"ejuwhf-33:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.42","timestamp":"2021-02-13 18:34:27.897939577Z","data":{"read_version":{"tag":"_H8xnpAZEzqUOed9D6o8b0E0","ver":1},"write_version":{"tag":"_H8xnpAZEzqUOed9D6o8b0E0","ver":2},"status":{"status":"complete"}}},{"id":"1_1613241268.960288_211.1","section":"bucket.instance","name":"ejuwhf-34:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.43","timestamp":"2021-02-13 18:34:28.960288660Z","data":{"read_version":{"tag":"_CRJvAYGaC5ssXc3dJv7KEk4","ver":1},"write_version":{"tag":"_CRJvAYGaC5ssXc3dJv7KEk4","ver":2},"status":{"status":"write"}}},{"id":"1_1613241268.978013_212.1","section":"bucket.instance","name":"ejuwhf-34:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.43","timestamp":"2021-02-13 18:34:28.978013262Z","data":{"read_version":{"tag":"_CRJvAYGaC5ssXc3dJv7KEk4","ver":1},"write_version":{"tag":"_CRJvAYGaC5ssXc3dJv7KEk4","ver":2},"status":{"status":"complete"}}},{"id":"1_1613241270.429647_213.1","section":"bucket.instance","name":"ejuwhf-35:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.44","timestamp":"2021-02-13 18:34:30.429647701Z","data":{"read_version":{"tag":"_W0CjPxEhZ84WmkTK-IJS63R","ver":1},"write_version":{"tag":"_W0CjPxEhZ84WmkTK-IJS63R","ver":2},"status":{"status":"write"}}},{"id":"1_1613241270.446438_214.1","section":"bucket.instance","name":"ejuwhf-35:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.44","timestamp":"2021-02-13 18:34:30.446438646Z","data":{"read_version":{"tag":"_W0CjPxEhZ84WmkTK-IJS63R","ver":1},"write_version":{"tag":"_W0CjPxEhZ84WmkTK-IJS63R","ver":2},"status":{"status":"complete"}}},{"id":"1_1613241270.850432_215.1","section":"bucket.instance","name":"ejuwhf-36:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.45","timestamp":"2021-02-13 18:34:30.850432491Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_9UmWS9ftBX75KSmck3AaoP3","ver":1},"status":{"status":"write"}}},{"id":"1_1613241270.866532_216.1","section":"bucket.instance","name":"ejuwhf-36:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.45","timestamp":"2021-02-13 18:34:30.866532637Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_9UmWS9ftBX75KSmck3AaoP3","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241270.872542_217.1","section":"bucket","name":"ejuwhf-36","timestamp":"2021-02-13 18:34:30.872542707Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_73boIkO_FojWkXyFQw7oy7A","ver":1},"status":{"status":"write"}}},{"id":"1_1613241270.888203_218.1","section":"bucket","name":"ejuwhf-36","timestamp":"2021-02-13 18:34:30.888203891Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_73boIkO_FojWkXyFQw7oy7A","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241271.585572_219.1","section":"bucket.instance","name":"ejuwhf-37:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.46","timestamp":"2021-02-13 18:34:31.585572280Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_mDbnQaV5gAjZL8anNAScPB9","ver":1},"status":{"status":"write"}}},{"id":"1_1613241271.603089_220.1","section":"bucket.instance","name":"ejuwhf-37:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.46","timestamp":"2021-02-13 18:34:31.603089265Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_mDbnQaV5gAjZL8anNAScPB9","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241271.608951_221.1","section":"bucket","name":"ejuwhf-37","timestamp":"2021-02-13 18:34:31.608951157Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_s74zFZJJ4NFsgBcob2jXayP","ver":1},"status":{"status":"write"}}},{"id":"1_1613241271.624585_222.1","section":"bucket","name":"ejuwhf-37","timestamp":"2021-02-13 18:34:31.624585936Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_s74zFZJJ4NFsgBcob2jXayP","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241272.105214_223.1","section":"bucket.instance","name":"ejuwhf-38:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.47","timestamp":"2021-02-13 18:34:32.105214877Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_hOR-x810TeuF27wCR96Wty1","ver":1},"status":{"status":"write"}}},{"id":"1_1613241272.122415_224.1","section":"bucket.instance","name":"ejuwhf-38:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.47","timestamp":"2021-02-13 18:34:32.122415123Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_hOR-x810TeuF27wCR96Wty1","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241272.128464_225.1","section":"bucket","name":"ejuwhf-38","timestamp":"2021-02-13 18:34:32.128464434Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_3IUloz0JebNxZ4oJtAH1uGt","ver":1},"status":{"status":"write"}}},{"id":"1_1613241272.144691_226.1","section":"bucket","name":"ejuwhf-38","timestamp":"2021-02-13 18:34:32.144691215Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_3IUloz0JebNxZ4oJtAH1uGt","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241280.698617_230.1","section":"bucket.instance","name":"ejuwhf-39:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.48","timestamp":"2021-02-13 18:34:40.698617098Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_eYhw6M1Kq9Fsl1gXEYBZ6tb","ver":1},"status":{"status":"write"}}},{"id":"1_1613241280.714973_231.1","section":"bucket.instance","name":"ejuwhf-39:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.48","timestamp":"2021-02-13 18:34:40.714973292Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_eYhw6M1Kq9Fsl1gXEYBZ6tb","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241280.720530_232.1","section":"bucket","name":"ejuwhf-39","timestamp":"2021-02-13 18:34:40.720530128Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_3SHNqKcm35n77170DwwQ5uP","ver":1},"status":{"status":"write"}}},{"id":"1_1613241280.736452_233.1","section":"bucket","name":"ejuwhf-39","timestamp":"2021-02-13 18:34:40.736452448Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_3SHNqKcm35n77170DwwQ5uP","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241281.607686_235.1","section":"bucket.instance","name":"ejuwhf-40:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.49","timestamp":"2021-02-13 18:34:41.607686289Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ET7-100GAjHcWvb6dmSd471","ver":1},"status":{"status":"write"}}},{"id":"1_1613241281.623808_236.1","section":"bucket.instance","name":"ejuwhf-40:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.49","timestamp":"2021-02-13 18:34:41.623808900Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ET7-100GAjHcWvb6dmSd471","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241281.629531_237.1","section":"bucket","name":"ejuwhf-40","timestamp":"2021-02-13 18:34:41.629531463Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_YLtkbjHvhAUvE3rtVFYlkKS","ver":1},"status":{"status":"write"}}},{"id":"1_1613241281.645755_238.1","section":"bucket","name":"ejuwhf-40","timestamp":"2021-02-13 18:34:41.645755376Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_YLtkbjHvhAUvE3rtVFYlkKS","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241281.785892_239.1","section":"bucket.instance","name":"ejuwhf-41:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.50","timestamp":"2021-02-13 18:34:41.785892843Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_A4tdGeJPy82CSxfrGu7y2YU","ver":1},"status":{"status":"write"}}},{"id":"1_1613241281.802707_240.1","section":"bucket.instance","name":"ejuwhf-41:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.50","timestamp":"2021-02-13 18:34:41.802707356Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_A4tdGeJPy82CSxfrGu7y2YU","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241281.808203_241.1","section":"bucket","name":"ejuwhf-41","timestamp":"2021-02-13 18:34:41.808203156Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_-Tx8KzgTMRgfsqe1Lj-5EOH","ver":1},"status":{"status":"write"}}},{"id":"1_1613241281.822512_242.1","section":"bucket","name":"ejuwhf-41","timestamp":"2021-02-13 18:34:41.822512374Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_-Tx8KzgTMRgfsqe1Lj-5EOH","ver":1},"status":{"status":"complete"}}}] 2021-02-13T18:37:02.669 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['mdlog', 'list', '--period', '138dc4ba-dc02-4957-87c3-e8bf2d80917c', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:37:02.669 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'mdlog', 'list', '--period', '138dc4ba-dc02-4957-87c3-e8bf2d80917c', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:37:02.669 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 mdlog list --period 138dc4ba-dc02-4957-87c3-e8bf2d80917c --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:37:02.763 INFO:teuthology.orchestra.run.gibba036.stdout:[{"id":"1_1613238836.390537_30.1","section":"user","name":"rgw-multisite-test-user","timestamp":"2021-02-13 17:53:56.390537712Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_pP6iIiaEGrFvLGsZM7x-OH9","ver":1},"status":{"status":"write"}}},{"id":"1_1613238836.394578_31.1","section":"user","name":"rgw-multisite-test-user","timestamp":"2021-02-13 17:53:56.394578235Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_pP6iIiaEGrFvLGsZM7x-OH9","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238955.574548_34.1","section":"bucket.instance","name":"ejuwhf-1:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.1","timestamp":"2021-02-13 17:55:55.574548718Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_x9-l_GSKepPMI4ZXnkA47yy","ver":1},"status":{"status":"write"}}},{"id":"1_1613238955.577573_35.1","section":"bucket.instance","name":"ejuwhf-1:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.1","timestamp":"2021-02-13 17:55:55.577573029Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_x9-l_GSKepPMI4ZXnkA47yy","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238955.578734_36.1","section":"bucket","name":"ejuwhf-1","timestamp":"2021-02-13 17:55:55.578734260Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_J8joTt2UmmIiOX87U166pOB","ver":1},"status":{"status":"write"}}},{"id":"1_1613238955.582128_37.1","section":"bucket","name":"ejuwhf-1","timestamp":"2021-02-13 17:55:55.582128841Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_J8joTt2UmmIiOX87U166pOB","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238955.598221_38.1","section":"bucket.instance","name":"ejuwhf-2:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.2","timestamp":"2021-02-13 17:55:55.598221635Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_XxLX1rySo-vI8MVX_6lsszw","ver":1},"status":{"status":"write"}}},{"id":"1_1613238955.601565_39.1","section":"bucket.instance","name":"ejuwhf-2:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.2","timestamp":"2021-02-13 17:55:55.601565432Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_XxLX1rySo-vI8MVX_6lsszw","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238955.602725_40.1","section":"bucket","name":"ejuwhf-2","timestamp":"2021-02-13 17:55:55.602725072Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_-17U9gIvg7jYouuMTrIVOEd","ver":1},"status":{"status":"write"}}},{"id":"1_1613238955.606187_41.1","section":"bucket","name":"ejuwhf-2","timestamp":"2021-02-13 17:55:55.606187695Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_-17U9gIvg7jYouuMTrIVOEd","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238956.751602_42.1","section":"bucket.instance","name":"ejuwhf-3:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.3","timestamp":"2021-02-13 17:55:56.751602944Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_lNPGQ7Vy4iyapNXVdS3aLPf","ver":1},"status":{"status":"write"}}},{"id":"1_1613238956.768275_43.1","section":"bucket.instance","name":"ejuwhf-3:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.3","timestamp":"2021-02-13 17:55:56.768275574Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_lNPGQ7Vy4iyapNXVdS3aLPf","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238956.775120_44.1","section":"bucket","name":"ejuwhf-3","timestamp":"2021-02-13 17:55:56.775120953Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_GCZqbJ9H_lfQq60lQ2CTjOd","ver":1},"status":{"status":"write"}}},{"id":"1_1613238956.791138_45.1","section":"bucket","name":"ejuwhf-3","timestamp":"2021-02-13 17:55:56.791138180Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_GCZqbJ9H_lfQq60lQ2CTjOd","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238960.597491_46.1","section":"bucket.instance","name":"ejuwhf-4:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.4","timestamp":"2021-02-13 17:56:00.597491162Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_0QbpwLYGTsIvm_YOZIhcyWS","ver":1},"status":{"status":"write"}}},{"id":"1_1613238960.614238_47.1","section":"bucket.instance","name":"ejuwhf-4:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.4","timestamp":"2021-02-13 17:56:00.614238433Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_0QbpwLYGTsIvm_YOZIhcyWS","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238960.620257_48.1","section":"bucket","name":"ejuwhf-4","timestamp":"2021-02-13 17:56:00.620257808Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_QDWd5t9vsHeGWEiagLoZ4l6","ver":1},"status":{"status":"write"}}},{"id":"1_1613238960.636707_49.1","section":"bucket","name":"ejuwhf-4","timestamp":"2021-02-13 17:56:00.636707536Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_QDWd5t9vsHeGWEiagLoZ4l6","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238960.666464_50.1","section":"bucket.instance","name":"ejuwhf-5:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.5","timestamp":"2021-02-13 17:56:00.666464684Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_HA_YqoBH5yRaCOOmwLHMDu_","ver":1},"status":{"status":"write"}}},{"id":"1_1613238960.682695_51.1","section":"bucket.instance","name":"ejuwhf-5:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.5","timestamp":"2021-02-13 17:56:00.682695337Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_HA_YqoBH5yRaCOOmwLHMDu_","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238960.688294_52.1","section":"bucket","name":"ejuwhf-5","timestamp":"2021-02-13 17:56:00.688294896Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_S2lucmmbUZ62_X47K1y6mSF","ver":1},"status":{"status":"write"}}},{"id":"1_1613238960.704528_53.1","section":"bucket","name":"ejuwhf-5","timestamp":"2021-02-13 17:56:00.704528473Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_S2lucmmbUZ62_X47K1y6mSF","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238960.766449_54.1","section":"bucket.instance","name":"ejuwhf-6:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.6","timestamp":"2021-02-13 17:56:00.766449862Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_4itjl067RN6aZgRRW5-Ukgb","ver":1},"status":{"status":"write"}}},{"id":"1_1613238960.782254_55.1","section":"bucket.instance","name":"ejuwhf-6:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.6","timestamp":"2021-02-13 17:56:00.782254386Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_4itjl067RN6aZgRRW5-Ukgb","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238960.787967_56.1","section":"bucket","name":"ejuwhf-6","timestamp":"2021-02-13 17:56:00.787967808Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"__e1Dsav3WgX_R99k1Kz1phg","ver":1},"status":{"status":"write"}}},{"id":"1_1613238960.804035_57.1","section":"bucket","name":"ejuwhf-6","timestamp":"2021-02-13 17:56:00.804035948Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"__e1Dsav3WgX_R99k1Kz1phg","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238968.578083_58.1","section":"bucket.instance","name":"ejuwhf-4:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.7","timestamp":"2021-02-13 17:56:08.578083676Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_rdxJZW8AbbLkx3Jo3qeZSTL","ver":1},"status":{"status":"write"}}},{"id":"1_1613238968.593717_59.1","section":"bucket.instance","name":"ejuwhf-4:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.7","timestamp":"2021-02-13 17:56:08.593717090Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_rdxJZW8AbbLkx3Jo3qeZSTL","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238968.600220_60.1","section":"bucket","name":"ejuwhf-4","timestamp":"2021-02-13 17:56:08.600220552Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_iCiP82FAKM6s-vHtX5gBzSR","ver":1},"status":{"status":"write"}}},{"id":"1_1613238968.610741_61.1","section":"bucket","name":"ejuwhf-4","timestamp":"2021-02-13 17:56:08.610741110Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_iCiP82FAKM6s-vHtX5gBzSR","ver":1},"status":{"status":"abort"}}},{"id":"1_1613238968.620505_62.1","section":"bucket.instance","name":"ejuwhf-4:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.7","timestamp":"2021-02-13 17:56:08.620505159Z","data":{"read_version":{"tag":"_rdxJZW8AbbLkx3Jo3qeZSTL","ver":1},"write_version":{"tag":"_rdxJZW8AbbLkx3Jo3qeZSTL","ver":2},"status":{"status":"remove"}}},{"id":"1_1613238968.636055_63.1","section":"bucket.instance","name":"ejuwhf-4:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.7","timestamp":"2021-02-13 17:56:08.636055803Z","data":{"read_version":{"tag":"_rdxJZW8AbbLkx3Jo3qeZSTL","ver":1},"write_version":{"tag":"_rdxJZW8AbbLkx3Jo3qeZSTL","ver":2},"status":{"status":"complete"}}},{"id":"1_1613238968.664189_64.1","section":"bucket.instance","name":"ejuwhf-5:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.8","timestamp":"2021-02-13 17:56:08.664189415Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_FcGNUs98T9meCX_-NJVwm_9","ver":1},"status":{"status":"write"}}},{"id":"1_1613238968.679282_65.1","section":"bucket.instance","name":"ejuwhf-5:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.8","timestamp":"2021-02-13 17:56:08.679282375Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_FcGNUs98T9meCX_-NJVwm_9","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238968.685310_66.1","section":"bucket","name":"ejuwhf-5","timestamp":"2021-02-13 17:56:08.685310012Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_waFuBRwm_oVRbc3bCTEK-2Q","ver":1},"status":{"status":"write"}}},{"id":"1_1613238968.695627_67.1","section":"bucket","name":"ejuwhf-5","timestamp":"2021-02-13 17:56:08.695627687Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_waFuBRwm_oVRbc3bCTEK-2Q","ver":1},"status":{"status":"abort"}}},{"id":"1_1613238968.705293_68.1","section":"bucket.instance","name":"ejuwhf-5:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.8","timestamp":"2021-02-13 17:56:08.705293699Z","data":{"read_version":{"tag":"_FcGNUs98T9meCX_-NJVwm_9","ver":1},"write_version":{"tag":"_FcGNUs98T9meCX_-NJVwm_9","ver":2},"status":{"status":"remove"}}},{"id":"1_1613238968.720069_69.1","section":"bucket.instance","name":"ejuwhf-5:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.8","timestamp":"2021-02-13 17:56:08.720069507Z","data":{"read_version":{"tag":"_FcGNUs98T9meCX_-NJVwm_9","ver":1},"write_version":{"tag":"_FcGNUs98T9meCX_-NJVwm_9","ver":2},"status":{"status":"complete"}}},{"id":"1_1613238968.747131_70.1","section":"bucket.instance","name":"ejuwhf-6:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.9","timestamp":"2021-02-13 17:56:08.747131498Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_KgNkkrSI2S7R0wW_SmAxVxt","ver":1},"status":{"status":"write"}}},{"id":"1_1613238968.763036_71.1","section":"bucket.instance","name":"ejuwhf-6:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.9","timestamp":"2021-02-13 17:56:08.763036003Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_KgNkkrSI2S7R0wW_SmAxVxt","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238968.769054_72.1","section":"bucket","name":"ejuwhf-6","timestamp":"2021-02-13 17:56:08.769054237Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_mBw7Ckz7EfNkJ26ASXtA1Qx","ver":1},"status":{"status":"write"}}},{"id":"1_1613238968.780056_73.1","section":"bucket","name":"ejuwhf-6","timestamp":"2021-02-13 17:56:08.780056555Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_mBw7Ckz7EfNkJ26ASXtA1Qx","ver":1},"status":{"status":"abort"}}},{"id":"1_1613238968.790518_74.1","section":"bucket.instance","name":"ejuwhf-6:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.9","timestamp":"2021-02-13 17:56:08.790518321Z","data":{"read_version":{"tag":"_KgNkkrSI2S7R0wW_SmAxVxt","ver":1},"write_version":{"tag":"_KgNkkrSI2S7R0wW_SmAxVxt","ver":2},"status":{"status":"remove"}}},{"id":"1_1613238968.805425_75.1","section":"bucket.instance","name":"ejuwhf-6:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.9","timestamp":"2021-02-13 17:56:08.805425116Z","data":{"read_version":{"tag":"_KgNkkrSI2S7R0wW_SmAxVxt","ver":1},"write_version":{"tag":"_KgNkkrSI2S7R0wW_SmAxVxt","ver":2},"status":{"status":"complete"}}},{"id":"1_1613238968.876119_76.1","section":"bucket.instance","name":"ejuwhf-4:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.10","timestamp":"2021-02-13 17:56:08.876119966Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_C13ny0FEaZhMoqR1eHNrzzo","ver":1},"status":{"status":"write"}}},{"id":"1_1613238968.892593_77.1","section":"bucket.instance","name":"ejuwhf-4:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.10","timestamp":"2021-02-13 17:56:08.892593644Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_C13ny0FEaZhMoqR1eHNrzzo","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238968.898155_78.1","section":"bucket","name":"ejuwhf-4","timestamp":"2021-02-13 17:56:08.898155724Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_S4geTzMH6fpArDdiMUd2Hj6","ver":1},"status":{"status":"write"}}},{"id":"1_1613238968.909527_79.1","section":"bucket","name":"ejuwhf-4","timestamp":"2021-02-13 17:56:08.909527088Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_S4geTzMH6fpArDdiMUd2Hj6","ver":1},"status":{"status":"abort"}}},{"id":"1_1613238968.919849_80.1","section":"bucket.instance","name":"ejuwhf-4:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.10","timestamp":"2021-02-13 17:56:08.919849797Z","data":{"read_version":{"tag":"_C13ny0FEaZhMoqR1eHNrzzo","ver":1},"write_version":{"tag":"_C13ny0FEaZhMoqR1eHNrzzo","ver":2},"status":{"status":"remove"}}},{"id":"1_1613238968.934852_81.1","section":"bucket.instance","name":"ejuwhf-4:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.10","timestamp":"2021-02-13 17:56:08.934852594Z","data":{"read_version":{"tag":"_C13ny0FEaZhMoqR1eHNrzzo","ver":1},"write_version":{"tag":"_C13ny0FEaZhMoqR1eHNrzzo","ver":2},"status":{"status":"complete"}}},{"id":"1_1613238968.997546_82.1","section":"bucket.instance","name":"ejuwhf-5:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.11","timestamp":"2021-02-13 17:56:08.997546443Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_0hI8LEwJXCt77LG_Y8caPyb","ver":1},"status":{"status":"write"}}},{"id":"1_1613238969.013809_83.1","section":"bucket.instance","name":"ejuwhf-5:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.11","timestamp":"2021-02-13 17:56:09.013809353Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_0hI8LEwJXCt77LG_Y8caPyb","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238969.019756_84.1","section":"bucket","name":"ejuwhf-5","timestamp":"2021-02-13 17:56:09.019756087Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_BES52o3jnI5HPCcsJxAGAPJ","ver":1},"status":{"status":"write"}}},{"id":"1_1613238969.031040_85.1","section":"bucket","name":"ejuwhf-5","timestamp":"2021-02-13 17:56:09.031040364Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_BES52o3jnI5HPCcsJxAGAPJ","ver":1},"status":{"status":"abort"}}},{"id":"1_1613238969.041765_86.1","section":"bucket.instance","name":"ejuwhf-5:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.11","timestamp":"2021-02-13 17:56:09.041765351Z","data":{"read_version":{"tag":"_0hI8LEwJXCt77LG_Y8caPyb","ver":1},"write_version":{"tag":"_0hI8LEwJXCt77LG_Y8caPyb","ver":2},"status":{"status":"remove"}}},{"id":"1_1613238969.056811_87.1","section":"bucket.instance","name":"ejuwhf-5:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.11","timestamp":"2021-02-13 17:56:09.056811080Z","data":{"read_version":{"tag":"_0hI8LEwJXCt77LG_Y8caPyb","ver":1},"write_version":{"tag":"_0hI8LEwJXCt77LG_Y8caPyb","ver":2},"status":{"status":"complete"}}},{"id":"1_1613238969.156956_88.1","section":"bucket.instance","name":"ejuwhf-6:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.12","timestamp":"2021-02-13 17:56:09.156956168Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_zCjiECQrQYftP3tksmjEkCi","ver":1},"status":{"status":"write"}}},{"id":"1_1613238969.172609_89.1","section":"bucket.instance","name":"ejuwhf-6:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.12","timestamp":"2021-02-13 17:56:09.172609871Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_zCjiECQrQYftP3tksmjEkCi","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238969.178077_90.1","section":"bucket","name":"ejuwhf-6","timestamp":"2021-02-13 17:56:09.178077356Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_oL1JaCHeOTBFodmq4Vo462S","ver":1},"status":{"status":"write"}}},{"id":"1_1613238969.189167_91.1","section":"bucket","name":"ejuwhf-6","timestamp":"2021-02-13 17:56:09.189167254Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_oL1JaCHeOTBFodmq4Vo462S","ver":1},"status":{"status":"abort"}}},{"id":"1_1613238969.199338_92.1","section":"bucket.instance","name":"ejuwhf-6:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.12","timestamp":"2021-02-13 17:56:09.199338685Z","data":{"read_version":{"tag":"_zCjiECQrQYftP3tksmjEkCi","ver":1},"write_version":{"tag":"_zCjiECQrQYftP3tksmjEkCi","ver":2},"status":{"status":"remove"}}},{"id":"1_1613238969.214181_93.1","section":"bucket.instance","name":"ejuwhf-6:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.12","timestamp":"2021-02-13 17:56:09.214181526Z","data":{"read_version":{"tag":"_zCjiECQrQYftP3tksmjEkCi","ver":1},"write_version":{"tag":"_zCjiECQrQYftP3tksmjEkCi","ver":2},"status":{"status":"complete"}}},{"id":"1_1613238970.008086_94.1","section":"bucket.instance","name":"ejuwhf-4:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.13","timestamp":"2021-02-13 17:56:10.008086848Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_v1tc2RjtPRbgReNqKENKBra","ver":1},"status":{"status":"write"}}},{"id":"1_1613238970.012670_95.1","section":"bucket.instance","name":"ejuwhf-4:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.13","timestamp":"2021-02-13 17:56:10.012670714Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_v1tc2RjtPRbgReNqKENKBra","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238970.014042_96.1","section":"bucket","name":"ejuwhf-4","timestamp":"2021-02-13 17:56:10.014042198Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_jKuSp21Zxke6SyefbVS70eh","ver":1},"status":{"status":"write"}}},{"id":"1_1613238970.016320_97.1","section":"bucket","name":"ejuwhf-4","timestamp":"2021-02-13 17:56:10.016320019Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_jKuSp21Zxke6SyefbVS70eh","ver":1},"status":{"status":"abort"}}},{"id":"1_1613238970.018539_98.1","section":"bucket.instance","name":"ejuwhf-4:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.13","timestamp":"2021-02-13 17:56:10.018539949Z","data":{"read_version":{"tag":"_v1tc2RjtPRbgReNqKENKBra","ver":1},"write_version":{"tag":"_v1tc2RjtPRbgReNqKENKBra","ver":2},"status":{"status":"remove"}}},{"id":"1_1613238970.022074_99.1","section":"bucket.instance","name":"ejuwhf-4:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.13","timestamp":"2021-02-13 17:56:10.022074729Z","data":{"read_version":{"tag":"_v1tc2RjtPRbgReNqKENKBra","ver":1},"write_version":{"tag":"_v1tc2RjtPRbgReNqKENKBra","ver":2},"status":{"status":"complete"}}},{"id":"1_1613238970.038564_100.1","section":"bucket.instance","name":"ejuwhf-5:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.14","timestamp":"2021-02-13 17:56:10.038564464Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Xxy0kA0Wvug2PQ7muelD8wi","ver":1},"status":{"status":"write"}}},{"id":"1_1613238970.043284_101.1","section":"bucket.instance","name":"ejuwhf-5:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.14","timestamp":"2021-02-13 17:56:10.043284541Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Xxy0kA0Wvug2PQ7muelD8wi","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238970.045447_102.1","section":"bucket","name":"ejuwhf-5","timestamp":"2021-02-13 17:56:10.045447439Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_4o9pGwW2NxyPbqj-tJaLONx","ver":1},"status":{"status":"write"}}},{"id":"1_1613238970.049722_103.1","section":"bucket","name":"ejuwhf-5","timestamp":"2021-02-13 17:56:10.049722714Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_4o9pGwW2NxyPbqj-tJaLONx","ver":1},"status":{"status":"abort"}}},{"id":"1_1613238970.053833_104.1","section":"bucket.instance","name":"ejuwhf-5:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.14","timestamp":"2021-02-13 17:56:10.053833249Z","data":{"read_version":{"tag":"_Xxy0kA0Wvug2PQ7muelD8wi","ver":1},"write_version":{"tag":"_Xxy0kA0Wvug2PQ7muelD8wi","ver":2},"status":{"status":"remove"}}},{"id":"1_1613238970.060705_105.1","section":"bucket.instance","name":"ejuwhf-5:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.14","timestamp":"2021-02-13 17:56:10.060705344Z","data":{"read_version":{"tag":"_Xxy0kA0Wvug2PQ7muelD8wi","ver":1},"write_version":{"tag":"_Xxy0kA0Wvug2PQ7muelD8wi","ver":2},"status":{"status":"complete"}}},{"id":"1_1613238970.135374_106.1","section":"bucket.instance","name":"ejuwhf-6:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.15","timestamp":"2021-02-13 17:56:10.135374943Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_eq-mn_enn9JS0uzsAd-kc3u","ver":1},"status":{"status":"write"}}},{"id":"1_1613238970.138703_107.1","section":"bucket.instance","name":"ejuwhf-6:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.15","timestamp":"2021-02-13 17:56:10.138703651Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_eq-mn_enn9JS0uzsAd-kc3u","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238970.140040_108.1","section":"bucket","name":"ejuwhf-6","timestamp":"2021-02-13 17:56:10.140040095Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_wcze0QNXW6OpN55syVKmWYX","ver":1},"status":{"status":"write"}}},{"id":"1_1613238970.143082_109.1","section":"bucket","name":"ejuwhf-6","timestamp":"2021-02-13 17:56:10.143082486Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_wcze0QNXW6OpN55syVKmWYX","ver":1},"status":{"status":"abort"}}},{"id":"1_1613238970.145487_110.1","section":"bucket.instance","name":"ejuwhf-6:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.15","timestamp":"2021-02-13 17:56:10.145487685Z","data":{"read_version":{"tag":"_eq-mn_enn9JS0uzsAd-kc3u","ver":1},"write_version":{"tag":"_eq-mn_enn9JS0uzsAd-kc3u","ver":2},"status":{"status":"remove"}}},{"id":"1_1613238970.149013_111.1","section":"bucket.instance","name":"ejuwhf-6:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.15","timestamp":"2021-02-13 17:56:10.149013694Z","data":{"read_version":{"tag":"_eq-mn_enn9JS0uzsAd-kc3u","ver":1},"write_version":{"tag":"_eq-mn_enn9JS0uzsAd-kc3u","ver":2},"status":{"status":"complete"}}},{"id":"1_1613238983.138841_112.1","section":"bucket.instance","name":"ejuwhf-7:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.16","timestamp":"2021-02-13 17:56:23.138841633Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_6gToYEDMo15odl3q3-L3Vdk","ver":1},"status":{"status":"write"}}},{"id":"1_1613238983.154116_113.1","section":"bucket.instance","name":"ejuwhf-7:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.16","timestamp":"2021-02-13 17:56:23.154116996Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_6gToYEDMo15odl3q3-L3Vdk","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238983.159663_114.1","section":"bucket","name":"ejuwhf-7","timestamp":"2021-02-13 17:56:23.159663722Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_vMCydHAxj_7QuSB-qm9iUeu","ver":1},"status":{"status":"write"}}},{"id":"1_1613238983.175427_115.1","section":"bucket","name":"ejuwhf-7","timestamp":"2021-02-13 17:56:23.175427702Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_vMCydHAxj_7QuSB-qm9iUeu","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238983.204618_116.1","section":"bucket.instance","name":"ejuwhf-8:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.17","timestamp":"2021-02-13 17:56:23.204618338Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Hdp3JF03_d_n4JjDXpJzu0M","ver":1},"status":{"status":"write"}}},{"id":"1_1613238983.219872_117.1","section":"bucket.instance","name":"ejuwhf-8:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.17","timestamp":"2021-02-13 17:56:23.219872258Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Hdp3JF03_d_n4JjDXpJzu0M","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238983.225498_118.1","section":"bucket","name":"ejuwhf-8","timestamp":"2021-02-13 17:56:23.225498137Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_MGOREBZ0hisc7Gbu7eA5JrS","ver":1},"status":{"status":"write"}}},{"id":"1_1613238983.241003_119.1","section":"bucket","name":"ejuwhf-8","timestamp":"2021-02-13 17:56:23.241003542Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_MGOREBZ0hisc7Gbu7eA5JrS","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238983.303585_120.1","section":"bucket.instance","name":"ejuwhf-9:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.18","timestamp":"2021-02-13 17:56:23.303585683Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_jRCaQz5FozM4nex7-DOl0kP","ver":1},"status":{"status":"write"}}},{"id":"1_1613238983.318865_121.1","section":"bucket.instance","name":"ejuwhf-9:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.18","timestamp":"2021-02-13 17:56:23.318865612Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_jRCaQz5FozM4nex7-DOl0kP","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238983.325660_122.1","section":"bucket","name":"ejuwhf-9","timestamp":"2021-02-13 17:56:23.325660323Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_YYkgNX9vj3hntComaoMK5U7","ver":1},"status":{"status":"write"}}},{"id":"1_1613238983.341158_123.1","section":"bucket","name":"ejuwhf-9","timestamp":"2021-02-13 17:56:23.341158692Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_YYkgNX9vj3hntComaoMK5U7","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238989.616147_124.1","section":"bucket","name":"ejuwhf-7","timestamp":"2021-02-13 17:56:29.616147126Z","data":{"read_version":{"tag":"_vMCydHAxj_7QuSB-qm9iUeu","ver":1},"write_version":{"tag":"_vMCydHAxj_7QuSB-qm9iUeu","ver":2},"status":{"status":"remove"}}},{"id":"1_1613238989.631574_125.1","section":"bucket","name":"ejuwhf-7","timestamp":"2021-02-13 17:56:29.631574106Z","data":{"read_version":{"tag":"_vMCydHAxj_7QuSB-qm9iUeu","ver":1},"write_version":{"tag":"_vMCydHAxj_7QuSB-qm9iUeu","ver":2},"status":{"status":"complete"}}},{"id":"1_1613238989.670248_126.1","section":"bucket","name":"ejuwhf-8","timestamp":"2021-02-13 17:56:29.670248409Z","data":{"read_version":{"tag":"_MGOREBZ0hisc7Gbu7eA5JrS","ver":1},"write_version":{"tag":"_MGOREBZ0hisc7Gbu7eA5JrS","ver":2},"status":{"status":"remove"}}},{"id":"1_1613238989.685454_127.1","section":"bucket","name":"ejuwhf-8","timestamp":"2021-02-13 17:56:29.685454067Z","data":{"read_version":{"tag":"_MGOREBZ0hisc7Gbu7eA5JrS","ver":1},"write_version":{"tag":"_MGOREBZ0hisc7Gbu7eA5JrS","ver":2},"status":{"status":"complete"}}},{"id":"1_1613238989.754736_128.1","section":"bucket","name":"ejuwhf-9","timestamp":"2021-02-13 17:56:29.754736933Z","data":{"read_version":{"tag":"_YYkgNX9vj3hntComaoMK5U7","ver":1},"write_version":{"tag":"_YYkgNX9vj3hntComaoMK5U7","ver":2},"status":{"status":"remove"}}},{"id":"1_1613238989.770436_129.1","section":"bucket","name":"ejuwhf-9","timestamp":"2021-02-13 17:56:29.770436155Z","data":{"read_version":{"tag":"_YYkgNX9vj3hntComaoMK5U7","ver":1},"write_version":{"tag":"_YYkgNX9vj3hntComaoMK5U7","ver":2},"status":{"status":"complete"}}},{"id":"1_1613238996.408432_20.1","section":"bucket.instance","name":"ejuwhf-10:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.19","timestamp":"2021-02-13 17:56:36.408432478Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_4l67hELsPgMja42xS8A6UhZ","ver":1},"status":{"status":"write"}}},{"id":"1_1613238996.425111_21.1","section":"bucket.instance","name":"ejuwhf-10:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.19","timestamp":"2021-02-13 17:56:36.425111236Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_4l67hELsPgMja42xS8A6UhZ","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238996.431060_22.1","section":"bucket","name":"ejuwhf-10","timestamp":"2021-02-13 17:56:36.431060604Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_xJby3h3bIk5vujQVV2pSTI-","ver":1},"status":{"status":"write"}}},{"id":"1_1613238996.446399_23.1","section":"bucket","name":"ejuwhf-10","timestamp":"2021-02-13 17:56:36.446399505Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_xJby3h3bIk5vujQVV2pSTI-","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238996.476122_24.1","section":"bucket.instance","name":"ejuwhf-11:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.20","timestamp":"2021-02-13 17:56:36.476122639Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_BCqsB66WxEPsrV6oYaSn_X-","ver":1},"status":{"status":"write"}}},{"id":"1_1613238996.491357_25.1","section":"bucket.instance","name":"ejuwhf-11:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.20","timestamp":"2021-02-13 17:56:36.491357838Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_BCqsB66WxEPsrV6oYaSn_X-","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238996.497273_26.1","section":"bucket","name":"ejuwhf-11","timestamp":"2021-02-13 17:56:36.497273035Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ojdkozIRvVsoWlCTyPLaGvj","ver":1},"status":{"status":"write"}}},{"id":"1_1613238996.512730_27.1","section":"bucket","name":"ejuwhf-11","timestamp":"2021-02-13 17:56:36.512730394Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ojdkozIRvVsoWlCTyPLaGvj","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238996.571112_28.1","section":"bucket.instance","name":"ejuwhf-12:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.21","timestamp":"2021-02-13 17:56:36.571112397Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_r6gSqSaTmTbReYf0uGy8_aC","ver":1},"status":{"status":"write"}}},{"id":"1_1613238996.586525_29.1","section":"bucket.instance","name":"ejuwhf-12:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.21","timestamp":"2021-02-13 17:56:36.586525109Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_r6gSqSaTmTbReYf0uGy8_aC","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238996.592228_30.1","section":"bucket","name":"ejuwhf-12","timestamp":"2021-02-13 17:56:36.592228025Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_--CaWqDYGbvQ4rZIucE1e-K","ver":1},"status":{"status":"write"}}},{"id":"1_1613238996.608007_31.1","section":"bucket","name":"ejuwhf-12","timestamp":"2021-02-13 17:56:36.608007431Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_--CaWqDYGbvQ4rZIucE1e-K","ver":1},"status":{"status":"complete"}}},{"id":"1_1613239321.080300_38.1","section":"bucket.instance","name":"ejuwhf-13:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.22","timestamp":"2021-02-13 18:02:01.080300919Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_78_uv7fHwaN7Qq4cyWhHLJz","ver":1},"status":{"status":"write"}}},{"id":"1_1613239321.097646_39.1","section":"bucket.instance","name":"ejuwhf-13:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.22","timestamp":"2021-02-13 18:02:01.097646161Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_78_uv7fHwaN7Qq4cyWhHLJz","ver":1},"status":{"status":"complete"}}},{"id":"1_1613239321.103822_40.1","section":"bucket","name":"ejuwhf-13","timestamp":"2021-02-13 18:02:01.103822896Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_lALUDndfu0TuP5K39wzC8in","ver":1},"status":{"status":"write"}}},{"id":"1_1613239321.120036_41.1","section":"bucket","name":"ejuwhf-13","timestamp":"2021-02-13 18:02:01.120036765Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_lALUDndfu0TuP5K39wzC8in","ver":1},"status":{"status":"complete"}}},{"id":"1_1613239321.157244_42.1","section":"bucket.instance","name":"ejuwhf-14:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.23","timestamp":"2021-02-13 18:02:01.157244195Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_fjpp4stMsyB7r2vHCXiSEql","ver":1},"status":{"status":"write"}}},{"id":"1_1613239321.173727_43.1","section":"bucket.instance","name":"ejuwhf-14:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.23","timestamp":"2021-02-13 18:02:01.173727725Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_fjpp4stMsyB7r2vHCXiSEql","ver":1},"status":{"status":"complete"}}},{"id":"1_1613239321.180183_44.1","section":"bucket","name":"ejuwhf-14","timestamp":"2021-02-13 18:02:01.180183919Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_lw1mkbLyJ3o-_DlonZo1SDZ","ver":1},"status":{"status":"write"}}},{"id":"1_1613239321.196368_45.1","section":"bucket","name":"ejuwhf-14","timestamp":"2021-02-13 18:02:01.196368937Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_lw1mkbLyJ3o-_DlonZo1SDZ","ver":1},"status":{"status":"complete"}}},{"id":"1_1613239321.265331_46.1","section":"bucket.instance","name":"ejuwhf-15:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.24","timestamp":"2021-02-13 18:02:01.265331350Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_uR_U3DJvBMRDbNsj1s38fR9","ver":1},"status":{"status":"write"}}},{"id":"1_1613239321.281670_47.1","section":"bucket.instance","name":"ejuwhf-15:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.24","timestamp":"2021-02-13 18:02:01.281670891Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_uR_U3DJvBMRDbNsj1s38fR9","ver":1},"status":{"status":"complete"}}},{"id":"1_1613239321.288543_48.1","section":"bucket","name":"ejuwhf-15","timestamp":"2021-02-13 18:02:01.288543122Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_k0PgphUQ7BAgCgZzpBUzBNN","ver":1},"status":{"status":"write"}}},{"id":"1_1613239321.305535_49.1","section":"bucket","name":"ejuwhf-15","timestamp":"2021-02-13 18:02:01.305535796Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_k0PgphUQ7BAgCgZzpBUzBNN","ver":1},"status":{"status":"complete"}}},{"id":"1_1613239643.733725_59.1","section":"bucket.instance","name":"ejuwhf-16:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.25","timestamp":"2021-02-13 18:07:23.733725000Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_nrprWx7VCq8YBJvRP_pJfT4","ver":1},"status":{"status":"write"}}},{"id":"1_1613239643.749943_60.1","section":"bucket.instance","name":"ejuwhf-16:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.25","timestamp":"2021-02-13 18:07:23.749943843Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_nrprWx7VCq8YBJvRP_pJfT4","ver":1},"status":{"status":"complete"}}},{"id":"1_1613239643.755418_61.1","section":"bucket","name":"ejuwhf-16","timestamp":"2021-02-13 18:07:23.755418869Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_LBYOapPliGlX3yh25unm84s","ver":1},"status":{"status":"write"}}},{"id":"1_1613239643.771083_62.1","section":"bucket","name":"ejuwhf-16","timestamp":"2021-02-13 18:07:23.771083206Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_LBYOapPliGlX3yh25unm84s","ver":1},"status":{"status":"complete"}}},{"id":"1_1613239643.806893_63.1","section":"bucket.instance","name":"ejuwhf-17:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.26","timestamp":"2021-02-13 18:07:23.806893724Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_8ovGbH1o6FvQnTtXB8s_UQm","ver":1},"status":{"status":"write"}}},{"id":"1_1613239643.822147_64.1","section":"bucket.instance","name":"ejuwhf-17:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.26","timestamp":"2021-02-13 18:07:23.822147852Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_8ovGbH1o6FvQnTtXB8s_UQm","ver":1},"status":{"status":"complete"}}},{"id":"1_1613239643.828619_65.1","section":"bucket","name":"ejuwhf-17","timestamp":"2021-02-13 18:07:23.828619399Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_h5MGnGsOEE9cFxGphgLOG3x","ver":1},"status":{"status":"write"}}},{"id":"1_1613239643.843279_66.1","section":"bucket","name":"ejuwhf-17","timestamp":"2021-02-13 18:07:23.843279069Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_h5MGnGsOEE9cFxGphgLOG3x","ver":1},"status":{"status":"complete"}}},{"id":"1_1613239643.906536_67.1","section":"bucket.instance","name":"ejuwhf-18:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.27","timestamp":"2021-02-13 18:07:23.906536499Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_YkOje16YwjBiAb0w6q8pqfO","ver":1},"status":{"status":"write"}}},{"id":"1_1613239643.922078_68.1","section":"bucket.instance","name":"ejuwhf-18:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.27","timestamp":"2021-02-13 18:07:23.922078168Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_YkOje16YwjBiAb0w6q8pqfO","ver":1},"status":{"status":"complete"}}},{"id":"1_1613239643.928111_69.1","section":"bucket","name":"ejuwhf-18","timestamp":"2021-02-13 18:07:23.928111593Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_2fiWbEVMEWvujFO3XL_4NjI","ver":1},"status":{"status":"write"}}},{"id":"1_1613239643.944698_70.1","section":"bucket","name":"ejuwhf-18","timestamp":"2021-02-13 18:07:23.944698661Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_2fiWbEVMEWvujFO3XL_4NjI","ver":1},"status":{"status":"complete"}}},{"id":"1_1613239643.992830_71.1","section":"bucket.instance","name":"ejuwhf-16:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.25","timestamp":"2021-02-13 18:07:23.992830606Z","data":{"read_version":{"tag":"_nrprWx7VCq8YBJvRP_pJfT4","ver":1},"write_version":{"tag":"_nrprWx7VCq8YBJvRP_pJfT4","ver":2},"status":{"status":"write"}}},{"id":"1_1613239644.009885_72.1","section":"bucket.instance","name":"ejuwhf-16:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.25","timestamp":"2021-02-13 18:07:24.009885261Z","data":{"read_version":{"tag":"_nrprWx7VCq8YBJvRP_pJfT4","ver":1},"write_version":{"tag":"_nrprWx7VCq8YBJvRP_pJfT4","ver":2},"status":{"status":"complete"}}},{"id":"1_1613239644.020434_73.1","section":"bucket.instance","name":"ejuwhf-17:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.26","timestamp":"2021-02-13 18:07:24.020434444Z","data":{"read_version":{"tag":"_8ovGbH1o6FvQnTtXB8s_UQm","ver":1},"write_version":{"tag":"_8ovGbH1o6FvQnTtXB8s_UQm","ver":2},"status":{"status":"write"}}},{"id":"1_1613239644.036282_74.1","section":"bucket.instance","name":"ejuwhf-17:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.26","timestamp":"2021-02-13 18:07:24.036282947Z","data":{"read_version":{"tag":"_8ovGbH1o6FvQnTtXB8s_UQm","ver":1},"write_version":{"tag":"_8ovGbH1o6FvQnTtXB8s_UQm","ver":2},"status":{"status":"complete"}}},{"id":"1_1613239644.055423_75.1","section":"bucket.instance","name":"ejuwhf-18:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.27","timestamp":"2021-02-13 18:07:24.055423607Z","data":{"read_version":{"tag":"_YkOje16YwjBiAb0w6q8pqfO","ver":1},"write_version":{"tag":"_YkOje16YwjBiAb0w6q8pqfO","ver":2},"status":{"status":"write"}}},{"id":"1_1613239644.070890_76.1","section":"bucket.instance","name":"ejuwhf-18:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.27","timestamp":"2021-02-13 18:07:24.070890569Z","data":{"read_version":{"tag":"_YkOje16YwjBiAb0w6q8pqfO","ver":1},"write_version":{"tag":"_YkOje16YwjBiAb0w6q8pqfO","ver":2},"status":{"status":"complete"}}},{"id":"1_1613239973.558856_84.1","section":"bucket.instance","name":"ejuwhf-19:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.28","timestamp":"2021-02-13 18:12:53.558856802Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_QLbnfIoGGaZIt0rwcmk-qti","ver":1},"status":{"status":"write"}}},{"id":"1_1613239973.575588_85.1","section":"bucket.instance","name":"ejuwhf-19:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.28","timestamp":"2021-02-13 18:12:53.575588311Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_QLbnfIoGGaZIt0rwcmk-qti","ver":1},"status":{"status":"complete"}}},{"id":"1_1613239973.581642_86.1","section":"bucket","name":"ejuwhf-19","timestamp":"2021-02-13 18:12:53.581642872Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_6FRUK8ncgnwrL2ZLGpRvips","ver":1},"status":{"status":"write"}}},{"id":"1_1613239973.597791_87.1","section":"bucket","name":"ejuwhf-19","timestamp":"2021-02-13 18:12:53.597791408Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_6FRUK8ncgnwrL2ZLGpRvips","ver":1},"status":{"status":"complete"}}},{"id":"1_1613239973.618317_88.1","section":"bucket.instance","name":"ejuwhf-19:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.28","timestamp":"2021-02-13 18:12:53.618317926Z","data":{"read_version":{"tag":"_QLbnfIoGGaZIt0rwcmk-qti","ver":1},"write_version":{"tag":"_QLbnfIoGGaZIt0rwcmk-qti","ver":2},"status":{"status":"write"}}},{"id":"1_1613239973.634814_89.1","section":"bucket.instance","name":"ejuwhf-19:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.28","timestamp":"2021-02-13 18:12:53.634814126Z","data":{"read_version":{"tag":"_QLbnfIoGGaZIt0rwcmk-qti","ver":1},"write_version":{"tag":"_QLbnfIoGGaZIt0rwcmk-qti","ver":2},"status":{"status":"complete"}}},{"id":"1_1613240298.200387_96.1","section":"bucket.instance","name":"ejuwhf-20:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.29","timestamp":"2021-02-13 18:18:18.200387564Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_zG-4FJP4lrTan5vmKfxkgxY","ver":1},"status":{"status":"write"}}},{"id":"1_1613240298.216338_97.1","section":"bucket.instance","name":"ejuwhf-20:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.29","timestamp":"2021-02-13 18:18:18.216338639Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_zG-4FJP4lrTan5vmKfxkgxY","ver":1},"status":{"status":"complete"}}},{"id":"1_1613240298.221718_98.1","section":"bucket","name":"ejuwhf-20","timestamp":"2021-02-13 18:18:18.221718896Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_hjd9VzRPYHn39EeVUieezBi","ver":1},"status":{"status":"write"}}},{"id":"1_1613240298.236365_99.1","section":"bucket","name":"ejuwhf-20","timestamp":"2021-02-13 18:18:18.236365179Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_hjd9VzRPYHn39EeVUieezBi","ver":1},"status":{"status":"complete"}}},{"id":"1_1613240621.656212_103.1","section":"bucket.instance","name":"ejuwhf-21:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.30","timestamp":"2021-02-13 18:23:41.656212918Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_PI91VmrZ-dDN5s_JIZJAPOu","ver":1},"status":{"status":"write"}}},{"id":"1_1613240621.672322_104.1","section":"bucket.instance","name":"ejuwhf-21:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.30","timestamp":"2021-02-13 18:23:41.672322312Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_PI91VmrZ-dDN5s_JIZJAPOu","ver":1},"status":{"status":"complete"}}},{"id":"1_1613240621.678630_105.1","section":"bucket","name":"ejuwhf-21","timestamp":"2021-02-13 18:23:41.678630564Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_QJCL0oRPCaZnOLc3FqHRPYX","ver":1},"status":{"status":"write"}}},{"id":"1_1613240621.693560_106.1","section":"bucket","name":"ejuwhf-21","timestamp":"2021-02-13 18:23:41.693560697Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_QJCL0oRPCaZnOLc3FqHRPYX","ver":1},"status":{"status":"complete"}}},{"id":"1_1613240621.741301_107.1","section":"bucket.instance","name":"ejuwhf-22:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.31","timestamp":"2021-02-13 18:23:41.741301484Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_hl5-x8kVDYpS5w-oh53bPCW","ver":1},"status":{"status":"write"}}},{"id":"1_1613240621.757529_108.1","section":"bucket.instance","name":"ejuwhf-22:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.31","timestamp":"2021-02-13 18:23:41.757529664Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_hl5-x8kVDYpS5w-oh53bPCW","ver":1},"status":{"status":"complete"}}},{"id":"1_1613240621.762982_109.1","section":"bucket","name":"ejuwhf-22","timestamp":"2021-02-13 18:23:41.762982204Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_qyPb-YYouea6Artq7SRkTtW","ver":1},"status":{"status":"write"}}},{"id":"1_1613240621.778531_110.1","section":"bucket","name":"ejuwhf-22","timestamp":"2021-02-13 18:23:41.778531566Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_qyPb-YYouea6Artq7SRkTtW","ver":1},"status":{"status":"complete"}}},{"id":"1_1613240621.852919_111.1","section":"bucket.instance","name":"ejuwhf-23:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.32","timestamp":"2021-02-13 18:23:41.852919112Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Zi3cYMrdm4uEttRZYVVoHN6","ver":1},"status":{"status":"write"}}},{"id":"1_1613240621.869034_112.1","section":"bucket.instance","name":"ejuwhf-23:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.32","timestamp":"2021-02-13 18:23:41.869034552Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Zi3cYMrdm4uEttRZYVVoHN6","ver":1},"status":{"status":"complete"}}},{"id":"1_1613240621.874580_113.1","section":"bucket","name":"ejuwhf-23","timestamp":"2021-02-13 18:23:41.874580193Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_HU3tbDLtK_l1Ht1UbiwZmmt","ver":1},"status":{"status":"write"}}},{"id":"1_1613240621.889892_114.1","section":"bucket","name":"ejuwhf-23","timestamp":"2021-02-13 18:23:41.889892437Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_HU3tbDLtK_l1Ht1UbiwZmmt","ver":1},"status":{"status":"complete"}}},{"id":"1_1613240621.938311_115.1","section":"bucket.instance","name":"ejuwhf-21:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.30","timestamp":"2021-02-13 18:23:41.938311534Z","data":{"read_version":{"tag":"_PI91VmrZ-dDN5s_JIZJAPOu","ver":1},"write_version":{"tag":"_PI91VmrZ-dDN5s_JIZJAPOu","ver":2},"status":{"status":"write"}}},{"id":"1_1613240621.954359_116.1","section":"bucket.instance","name":"ejuwhf-21:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.30","timestamp":"2021-02-13 18:23:41.954359504Z","data":{"read_version":{"tag":"_PI91VmrZ-dDN5s_JIZJAPOu","ver":1},"write_version":{"tag":"_PI91VmrZ-dDN5s_JIZJAPOu","ver":2},"status":{"status":"complete"}}},{"id":"1_1613240621.972224_117.1","section":"bucket.instance","name":"ejuwhf-22:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.31","timestamp":"2021-02-13 18:23:41.972224734Z","data":{"read_version":{"tag":"_hl5-x8kVDYpS5w-oh53bPCW","ver":1},"write_version":{"tag":"_hl5-x8kVDYpS5w-oh53bPCW","ver":2},"status":{"status":"write"}}},{"id":"1_1613240621.988926_118.1","section":"bucket.instance","name":"ejuwhf-22:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.31","timestamp":"2021-02-13 18:23:41.988926707Z","data":{"read_version":{"tag":"_hl5-x8kVDYpS5w-oh53bPCW","ver":1},"write_version":{"tag":"_hl5-x8kVDYpS5w-oh53bPCW","ver":2},"status":{"status":"complete"}}},{"id":"1_1613240622.014812_119.1","section":"bucket.instance","name":"ejuwhf-23:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.32","timestamp":"2021-02-13 18:23:42.014812172Z","data":{"read_version":{"tag":"_Zi3cYMrdm4uEttRZYVVoHN6","ver":1},"write_version":{"tag":"_Zi3cYMrdm4uEttRZYVVoHN6","ver":2},"status":{"status":"write"}}},{"id":"1_1613240622.031550_120.1","section":"bucket.instance","name":"ejuwhf-23:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.32","timestamp":"2021-02-13 18:23:42.031550983Z","data":{"read_version":{"tag":"_Zi3cYMrdm4uEttRZYVVoHN6","ver":1},"write_version":{"tag":"_Zi3cYMrdm4uEttRZYVVoHN6","ver":2},"status":{"status":"complete"}}},{"id":"1_1613240942.057496_129.1","section":"bucket.instance","name":"ejuwhf-24:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.33","timestamp":"2021-02-13 18:29:02.057496314Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Mymfhn6ginn73AnD7ml29g5","ver":1},"status":{"status":"write"}}},{"id":"1_1613240942.074249_130.1","section":"bucket.instance","name":"ejuwhf-24:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.33","timestamp":"2021-02-13 18:29:02.074249549Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Mymfhn6ginn73AnD7ml29g5","ver":1},"status":{"status":"complete"}}},{"id":"1_1613240942.080340_131.1","section":"bucket","name":"ejuwhf-24","timestamp":"2021-02-13 18:29:02.080340488Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_LXwSzpg4EyuMmTpiPZjf1cc","ver":1},"status":{"status":"write"}}},{"id":"1_1613240942.096212_132.1","section":"bucket","name":"ejuwhf-24","timestamp":"2021-02-13 18:29:02.096212692Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_LXwSzpg4EyuMmTpiPZjf1cc","ver":1},"status":{"status":"complete"}}},{"id":"1_1613240942.132341_133.1","section":"bucket.instance","name":"ejuwhf-25:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.34","timestamp":"2021-02-13 18:29:02.132341526Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_uMJzQ5xiX1YlCrcj1HBDDd1","ver":1},"status":{"status":"write"}}},{"id":"1_1613240942.147778_134.1","section":"bucket.instance","name":"ejuwhf-25:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.34","timestamp":"2021-02-13 18:29:02.147778756Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_uMJzQ5xiX1YlCrcj1HBDDd1","ver":1},"status":{"status":"complete"}}},{"id":"1_1613240942.153287_135.1","section":"bucket","name":"ejuwhf-25","timestamp":"2021-02-13 18:29:02.153287603Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_A3dK8rBY3svnWMIeKILt9Z_","ver":1},"status":{"status":"write"}}},{"id":"1_1613240942.168281_136.1","section":"bucket","name":"ejuwhf-25","timestamp":"2021-02-13 18:29:02.168281459Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_A3dK8rBY3svnWMIeKILt9Z_","ver":1},"status":{"status":"complete"}}},{"id":"1_1613240942.238318_137.1","section":"bucket.instance","name":"ejuwhf-26:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.35","timestamp":"2021-02-13 18:29:02.238318066Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_L3Z-v3OBQisJH8Y-dXJplsy","ver":1},"status":{"status":"write"}}},{"id":"1_1613240942.254572_138.1","section":"bucket.instance","name":"ejuwhf-26:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.35","timestamp":"2021-02-13 18:29:02.254572785Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_L3Z-v3OBQisJH8Y-dXJplsy","ver":1},"status":{"status":"complete"}}},{"id":"1_1613240942.260239_139.1","section":"bucket","name":"ejuwhf-26","timestamp":"2021-02-13 18:29:02.260239723Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_cPHMuqLQT9Fp0sttVt7JMgo","ver":1},"status":{"status":"write"}}},{"id":"1_1613240942.275753_140.1","section":"bucket","name":"ejuwhf-26","timestamp":"2021-02-13 18:29:02.275753150Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_cPHMuqLQT9Fp0sttVt7JMgo","ver":1},"status":{"status":"complete"}}},{"id":"1_1613240942.328657_141.1","section":"bucket.instance","name":"ejuwhf-24:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.33","timestamp":"2021-02-13 18:29:02.328657731Z","data":{"read_version":{"tag":"_Mymfhn6ginn73AnD7ml29g5","ver":1},"write_version":{"tag":"_Mymfhn6ginn73AnD7ml29g5","ver":2},"status":{"status":"write"}}},{"id":"1_1613240942.344935_142.1","section":"bucket.instance","name":"ejuwhf-24:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.33","timestamp":"2021-02-13 18:29:02.344935201Z","data":{"read_version":{"tag":"_Mymfhn6ginn73AnD7ml29g5","ver":1},"write_version":{"tag":"_Mymfhn6ginn73AnD7ml29g5","ver":2},"status":{"status":"complete"}}},{"id":"1_1613240942.353878_143.1","section":"bucket.instance","name":"ejuwhf-24:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.33","timestamp":"2021-02-13 18:29:02.353878692Z","data":{"read_version":{"tag":"_Mymfhn6ginn73AnD7ml29g5","ver":2},"write_version":{"tag":"_Mymfhn6ginn73AnD7ml29g5","ver":3},"status":{"status":"write"}}},{"id":"1_1613240942.370130_144.1","section":"bucket.instance","name":"ejuwhf-24:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.33","timestamp":"2021-02-13 18:29:02.370130831Z","data":{"read_version":{"tag":"_Mymfhn6ginn73AnD7ml29g5","ver":2},"write_version":{"tag":"_Mymfhn6ginn73AnD7ml29g5","ver":3},"status":{"status":"complete"}}},{"id":"1_1613240942.382481_145.1","section":"bucket.instance","name":"ejuwhf-25:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.34","timestamp":"2021-02-13 18:29:02.382481780Z","data":{"read_version":{"tag":"_uMJzQ5xiX1YlCrcj1HBDDd1","ver":1},"write_version":{"tag":"_uMJzQ5xiX1YlCrcj1HBDDd1","ver":2},"status":{"status":"write"}}},{"id":"1_1613240942.399166_146.1","section":"bucket.instance","name":"ejuwhf-25:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.34","timestamp":"2021-02-13 18:29:02.399166568Z","data":{"read_version":{"tag":"_uMJzQ5xiX1YlCrcj1HBDDd1","ver":1},"write_version":{"tag":"_uMJzQ5xiX1YlCrcj1HBDDd1","ver":2},"status":{"status":"complete"}}},{"id":"1_1613240942.421493_147.1","section":"bucket.instance","name":"ejuwhf-25:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.34","timestamp":"2021-02-13 18:29:02.421493448Z","data":{"read_version":{"tag":"_uMJzQ5xiX1YlCrcj1HBDDd1","ver":2},"write_version":{"tag":"_uMJzQ5xiX1YlCrcj1HBDDd1","ver":3},"status":{"status":"write"}}},{"id":"1_1613240942.437705_148.1","section":"bucket.instance","name":"ejuwhf-25:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.34","timestamp":"2021-02-13 18:29:02.437705406Z","data":{"read_version":{"tag":"_uMJzQ5xiX1YlCrcj1HBDDd1","ver":2},"write_version":{"tag":"_uMJzQ5xiX1YlCrcj1HBDDd1","ver":3},"status":{"status":"complete"}}},{"id":"1_1613240942.459839_149.1","section":"bucket.instance","name":"ejuwhf-26:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.35","timestamp":"2021-02-13 18:29:02.459839291Z","data":{"read_version":{"tag":"_L3Z-v3OBQisJH8Y-dXJplsy","ver":1},"write_version":{"tag":"_L3Z-v3OBQisJH8Y-dXJplsy","ver":2},"status":{"status":"write"}}},{"id":"1_1613240942.476918_150.1","section":"bucket.instance","name":"ejuwhf-26:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.35","timestamp":"2021-02-13 18:29:02.476918779Z","data":{"read_version":{"tag":"_L3Z-v3OBQisJH8Y-dXJplsy","ver":1},"write_version":{"tag":"_L3Z-v3OBQisJH8Y-dXJplsy","ver":2},"status":{"status":"complete"}}},{"id":"1_1613240942.499769_151.1","section":"bucket.instance","name":"ejuwhf-26:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.35","timestamp":"2021-02-13 18:29:02.499769496Z","data":{"read_version":{"tag":"_L3Z-v3OBQisJH8Y-dXJplsy","ver":2},"write_version":{"tag":"_L3Z-v3OBQisJH8Y-dXJplsy","ver":3},"status":{"status":"write"}}},{"id":"1_1613240942.515439_152.1","section":"bucket.instance","name":"ejuwhf-26:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.35","timestamp":"2021-02-13 18:29:02.515439820Z","data":{"read_version":{"tag":"_L3Z-v3OBQisJH8Y-dXJplsy","ver":2},"write_version":{"tag":"_L3Z-v3OBQisJH8Y-dXJplsy","ver":3},"status":{"status":"complete"}}},{"id":"1_1613241266.605637_161.1","section":"bucket.instance","name":"ejuwhf-27:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.36","timestamp":"2021-02-13 18:34:26.605637643Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_buhEDK5wV_BTZ1BfBOjuCtv","ver":1},"status":{"status":"write"}}},{"id":"1_1613241266.622739_162.1","section":"bucket.instance","name":"ejuwhf-27:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.36","timestamp":"2021-02-13 18:34:26.622739396Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_buhEDK5wV_BTZ1BfBOjuCtv","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241266.628411_163.1","section":"bucket","name":"ejuwhf-27","timestamp":"2021-02-13 18:34:26.628411671Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_cv0hC47mr82631TFimW_DVd","ver":1},"status":{"status":"write"}}},{"id":"1_1613241266.644465_164.1","section":"bucket","name":"ejuwhf-27","timestamp":"2021-02-13 18:34:26.644465762Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_cv0hC47mr82631TFimW_DVd","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241266.684520_165.1","section":"bucket.instance","name":"ejuwhf-28:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.37","timestamp":"2021-02-13 18:34:26.684520705Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Xd4FRhFK5zkknydU2nFa9wM","ver":1},"status":{"status":"write"}}},{"id":"1_1613241266.701308_166.1","section":"bucket.instance","name":"ejuwhf-28:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.37","timestamp":"2021-02-13 18:34:26.701308256Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Xd4FRhFK5zkknydU2nFa9wM","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241266.707762_167.1","section":"bucket","name":"ejuwhf-28","timestamp":"2021-02-13 18:34:26.707762712Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_fwmE9vPx54C_GLabnD2pr6O","ver":1},"status":{"status":"write"}}},{"id":"1_1613241266.723793_168.1","section":"bucket","name":"ejuwhf-28","timestamp":"2021-02-13 18:34:26.723793662Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_fwmE9vPx54C_GLabnD2pr6O","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241266.793975_169.1","section":"bucket.instance","name":"ejuwhf-29:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.38","timestamp":"2021-02-13 18:34:26.793975407Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_OYTb8fo0cI6eTvGgrw7zDVl","ver":1},"status":{"status":"write"}}},{"id":"1_1613241266.810889_170.1","section":"bucket.instance","name":"ejuwhf-29:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.38","timestamp":"2021-02-13 18:34:26.810889667Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_OYTb8fo0cI6eTvGgrw7zDVl","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241266.817391_171.1","section":"bucket","name":"ejuwhf-29","timestamp":"2021-02-13 18:34:26.817391051Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_8f7U215eIbZcyAN-0Ty-CHS","ver":1},"status":{"status":"write"}}},{"id":"1_1613241266.833518_172.1","section":"bucket","name":"ejuwhf-29","timestamp":"2021-02-13 18:34:26.833518174Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_8f7U215eIbZcyAN-0Ty-CHS","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241266.890012_173.1","section":"bucket.instance","name":"ejuwhf-27:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.36","timestamp":"2021-02-13 18:34:26.890012595Z","data":{"read_version":{"tag":"_buhEDK5wV_BTZ1BfBOjuCtv","ver":1},"write_version":{"tag":"_buhEDK5wV_BTZ1BfBOjuCtv","ver":2},"status":{"status":"write"}}},{"id":"1_1613241266.906758_174.1","section":"bucket.instance","name":"ejuwhf-27:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.36","timestamp":"2021-02-13 18:34:26.906758267Z","data":{"read_version":{"tag":"_buhEDK5wV_BTZ1BfBOjuCtv","ver":1},"write_version":{"tag":"_buhEDK5wV_BTZ1BfBOjuCtv","ver":2},"status":{"status":"complete"}}},{"id":"1_1613241266.965553_175.1","section":"bucket.instance","name":"ejuwhf-28:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.37","timestamp":"2021-02-13 18:34:26.965553236Z","data":{"read_version":{"tag":"_Xd4FRhFK5zkknydU2nFa9wM","ver":1},"write_version":{"tag":"_Xd4FRhFK5zkknydU2nFa9wM","ver":2},"status":{"status":"write"}}},{"id":"1_1613241266.983302_176.1","section":"bucket.instance","name":"ejuwhf-28:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.37","timestamp":"2021-02-13 18:34:26.983302909Z","data":{"read_version":{"tag":"_Xd4FRhFK5zkknydU2nFa9wM","ver":1},"write_version":{"tag":"_Xd4FRhFK5zkknydU2nFa9wM","ver":2},"status":{"status":"complete"}}},{"id":"1_1613241267.056149_177.1","section":"bucket.instance","name":"ejuwhf-29:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.38","timestamp":"2021-02-13 18:34:27.056149375Z","data":{"read_version":{"tag":"_OYTb8fo0cI6eTvGgrw7zDVl","ver":1},"write_version":{"tag":"_OYTb8fo0cI6eTvGgrw7zDVl","ver":2},"status":{"status":"write"}}},{"id":"1_1613241267.073356_178.1","section":"bucket.instance","name":"ejuwhf-29:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.38","timestamp":"2021-02-13 18:34:27.073356371Z","data":{"read_version":{"tag":"_OYTb8fo0cI6eTvGgrw7zDVl","ver":1},"write_version":{"tag":"_OYTb8fo0cI6eTvGgrw7zDVl","ver":2},"status":{"status":"complete"}}},{"id":"1_1613241267.151605_179.1","section":"bucket.instance","name":"ejuwhf-30:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.39","timestamp":"2021-02-13 18:34:27.151605712Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_xOOIxE04nsc05E_DBE8Tl4c","ver":1},"status":{"status":"write"}}},{"id":"1_1613241267.168752_180.1","section":"bucket.instance","name":"ejuwhf-30:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.39","timestamp":"2021-02-13 18:34:27.168752478Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_xOOIxE04nsc05E_DBE8Tl4c","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241267.174869_181.1","section":"bucket","name":"ejuwhf-30","timestamp":"2021-02-13 18:34:27.174869113Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_fXNqCzc4CG0kd9VOzBG9Q7P","ver":1},"status":{"status":"write"}}},{"id":"1_1613241267.190845_182.1","section":"bucket","name":"ejuwhf-30","timestamp":"2021-02-13 18:34:27.190845919Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_fXNqCzc4CG0kd9VOzBG9Q7P","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241267.225373_183.1","section":"bucket.instance","name":"ejuwhf-31:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.40","timestamp":"2021-02-13 18:34:27.225373782Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_vq-PbUFwVQj7aAfQtnD_3EU","ver":1},"status":{"status":"write"}}},{"id":"1_1613241267.242435_184.1","section":"bucket.instance","name":"ejuwhf-31:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.40","timestamp":"2021-02-13 18:34:27.242435556Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_vq-PbUFwVQj7aAfQtnD_3EU","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241267.248007_185.1","section":"bucket","name":"ejuwhf-31","timestamp":"2021-02-13 18:34:27.248007585Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_KctrzUTN-Z2qNoPxtPlfK8y","ver":1},"status":{"status":"write"}}},{"id":"1_1613241267.263145_186.1","section":"bucket","name":"ejuwhf-31","timestamp":"2021-02-13 18:34:27.263145093Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_KctrzUTN-Z2qNoPxtPlfK8y","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241267.328171_187.1","section":"bucket.instance","name":"ejuwhf-32:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.41","timestamp":"2021-02-13 18:34:27.328171763Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_pMTJ0sdLLeifyII2MXvLxTT","ver":1},"status":{"status":"write"}}},{"id":"1_1613241267.345082_188.1","section":"bucket.instance","name":"ejuwhf-32:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.41","timestamp":"2021-02-13 18:34:27.345082724Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_pMTJ0sdLLeifyII2MXvLxTT","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241267.350511_189.1","section":"bucket","name":"ejuwhf-32","timestamp":"2021-02-13 18:34:27.350511022Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ZBwWS6lgLvXfPlIIuMt3AtT","ver":1},"status":{"status":"write"}}},{"id":"1_1613241267.365375_190.1","section":"bucket","name":"ejuwhf-32","timestamp":"2021-02-13 18:34:27.365375654Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ZBwWS6lgLvXfPlIIuMt3AtT","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241267.427546_191.1","section":"bucket.instance","name":"ejuwhf-30:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.39","timestamp":"2021-02-13 18:34:27.427546507Z","data":{"read_version":{"tag":"_xOOIxE04nsc05E_DBE8Tl4c","ver":1},"write_version":{"tag":"_xOOIxE04nsc05E_DBE8Tl4c","ver":2},"status":{"status":"write"}}},{"id":"1_1613241267.443747_192.1","section":"bucket.instance","name":"ejuwhf-30:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.39","timestamp":"2021-02-13 18:34:27.443747325Z","data":{"read_version":{"tag":"_xOOIxE04nsc05E_DBE8Tl4c","ver":1},"write_version":{"tag":"_xOOIxE04nsc05E_DBE8Tl4c","ver":2},"status":{"status":"complete"}}},{"id":"1_1613241267.515491_193.1","section":"bucket.instance","name":"ejuwhf-31:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.40","timestamp":"2021-02-13 18:34:27.515491775Z","data":{"read_version":{"tag":"_vq-PbUFwVQj7aAfQtnD_3EU","ver":1},"write_version":{"tag":"_vq-PbUFwVQj7aAfQtnD_3EU","ver":2},"status":{"status":"write"}}},{"id":"1_1613241267.532248_194.1","section":"bucket.instance","name":"ejuwhf-31:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.40","timestamp":"2021-02-13 18:34:27.532248179Z","data":{"read_version":{"tag":"_vq-PbUFwVQj7aAfQtnD_3EU","ver":1},"write_version":{"tag":"_vq-PbUFwVQj7aAfQtnD_3EU","ver":2},"status":{"status":"complete"}}},{"id":"1_1613241267.614493_195.1","section":"bucket.instance","name":"ejuwhf-32:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.41","timestamp":"2021-02-13 18:34:27.614493922Z","data":{"read_version":{"tag":"_pMTJ0sdLLeifyII2MXvLxTT","ver":1},"write_version":{"tag":"_pMTJ0sdLLeifyII2MXvLxTT","ver":2},"status":{"status":"write"}}},{"id":"1_1613241267.631169_196.1","section":"bucket.instance","name":"ejuwhf-32:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.41","timestamp":"2021-02-13 18:34:27.631169929Z","data":{"read_version":{"tag":"_pMTJ0sdLLeifyII2MXvLxTT","ver":1},"write_version":{"tag":"_pMTJ0sdLLeifyII2MXvLxTT","ver":2},"status":{"status":"complete"}}},{"id":"1_1613241267.703455_197.1","section":"bucket.instance","name":"ejuwhf-33:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.42","timestamp":"2021-02-13 18:34:27.703455821Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_H8xnpAZEzqUOed9D6o8b0E0","ver":1},"status":{"status":"write"}}},{"id":"1_1613241267.709061_198.1","section":"bucket.instance","name":"ejuwhf-33:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.42","timestamp":"2021-02-13 18:34:27.709061094Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_H8xnpAZEzqUOed9D6o8b0E0","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241267.710918_199.1","section":"bucket","name":"ejuwhf-33","timestamp":"2021-02-13 18:34:27.710918130Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_5d9OIM7k69p0P0uAysQiRdG","ver":1},"status":{"status":"write"}}},{"id":"1_1613241267.716192_200.1","section":"bucket","name":"ejuwhf-33","timestamp":"2021-02-13 18:34:27.716192524Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_5d9OIM7k69p0P0uAysQiRdG","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241267.728031_201.1","section":"bucket.instance","name":"ejuwhf-34:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.43","timestamp":"2021-02-13 18:34:27.728031465Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_CRJvAYGaC5ssXc3dJv7KEk4","ver":1},"status":{"status":"write"}}},{"id":"1_1613241267.733121_202.1","section":"bucket.instance","name":"ejuwhf-34:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.43","timestamp":"2021-02-13 18:34:27.733121606Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_CRJvAYGaC5ssXc3dJv7KEk4","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241267.735002_203.1","section":"bucket","name":"ejuwhf-34","timestamp":"2021-02-13 18:34:27.735002139Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ro68eUWJTFM6zc_B6pTLzxQ","ver":1},"status":{"status":"write"}}},{"id":"1_1613241267.739821_204.1","section":"bucket","name":"ejuwhf-34","timestamp":"2021-02-13 18:34:27.739821981Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ro68eUWJTFM6zc_B6pTLzxQ","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241267.788853_205.1","section":"bucket.instance","name":"ejuwhf-35:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.44","timestamp":"2021-02-13 18:34:27.788853889Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_W0CjPxEhZ84WmkTK-IJS63R","ver":1},"status":{"status":"write"}}},{"id":"1_1613241267.805812_206.1","section":"bucket.instance","name":"ejuwhf-35:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.44","timestamp":"2021-02-13 18:34:27.805812011Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_W0CjPxEhZ84WmkTK-IJS63R","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241267.812537_207.1","section":"bucket","name":"ejuwhf-35","timestamp":"2021-02-13 18:34:27.812537791Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_3BdK8ESSfyzlLsuvW_K1IJj","ver":1},"status":{"status":"write"}}},{"id":"1_1613241267.829128_208.1","section":"bucket","name":"ejuwhf-35","timestamp":"2021-02-13 18:34:27.829128246Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_3BdK8ESSfyzlLsuvW_K1IJj","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241267.880158_209.1","section":"bucket.instance","name":"ejuwhf-33:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.42","timestamp":"2021-02-13 18:34:27.880158053Z","data":{"read_version":{"tag":"_H8xnpAZEzqUOed9D6o8b0E0","ver":1},"write_version":{"tag":"_H8xnpAZEzqUOed9D6o8b0E0","ver":2},"status":{"status":"write"}}},{"id":"1_1613241267.897939_210.1","section":"bucket.instance","name":"ejuwhf-33:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.42","timestamp":"2021-02-13 18:34:27.897939577Z","data":{"read_version":{"tag":"_H8xnpAZEzqUOed9D6o8b0E0","ver":1},"write_version":{"tag":"_H8xnpAZEzqUOed9D6o8b0E0","ver":2},"status":{"status":"complete"}}},{"id":"1_1613241268.960288_211.1","section":"bucket.instance","name":"ejuwhf-34:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.43","timestamp":"2021-02-13 18:34:28.960288660Z","data":{"read_version":{"tag":"_CRJvAYGaC5ssXc3dJv7KEk4","ver":1},"write_version":{"tag":"_CRJvAYGaC5ssXc3dJv7KEk4","ver":2},"status":{"status":"write"}}},{"id":"1_1613241268.978013_212.1","section":"bucket.instance","name":"ejuwhf-34:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.43","timestamp":"2021-02-13 18:34:28.978013262Z","data":{"read_version":{"tag":"_CRJvAYGaC5ssXc3dJv7KEk4","ver":1},"write_version":{"tag":"_CRJvAYGaC5ssXc3dJv7KEk4","ver":2},"status":{"status":"complete"}}},{"id":"1_1613241270.429647_213.1","section":"bucket.instance","name":"ejuwhf-35:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.44","timestamp":"2021-02-13 18:34:30.429647701Z","data":{"read_version":{"tag":"_W0CjPxEhZ84WmkTK-IJS63R","ver":1},"write_version":{"tag":"_W0CjPxEhZ84WmkTK-IJS63R","ver":2},"status":{"status":"write"}}},{"id":"1_1613241270.446438_214.1","section":"bucket.instance","name":"ejuwhf-35:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.44","timestamp":"2021-02-13 18:34:30.446438646Z","data":{"read_version":{"tag":"_W0CjPxEhZ84WmkTK-IJS63R","ver":1},"write_version":{"tag":"_W0CjPxEhZ84WmkTK-IJS63R","ver":2},"status":{"status":"complete"}}},{"id":"1_1613241270.850432_215.1","section":"bucket.instance","name":"ejuwhf-36:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.45","timestamp":"2021-02-13 18:34:30.850432491Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_9UmWS9ftBX75KSmck3AaoP3","ver":1},"status":{"status":"write"}}},{"id":"1_1613241270.866532_216.1","section":"bucket.instance","name":"ejuwhf-36:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.45","timestamp":"2021-02-13 18:34:30.866532637Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_9UmWS9ftBX75KSmck3AaoP3","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241270.872542_217.1","section":"bucket","name":"ejuwhf-36","timestamp":"2021-02-13 18:34:30.872542707Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_73boIkO_FojWkXyFQw7oy7A","ver":1},"status":{"status":"write"}}},{"id":"1_1613241270.888203_218.1","section":"bucket","name":"ejuwhf-36","timestamp":"2021-02-13 18:34:30.888203891Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_73boIkO_FojWkXyFQw7oy7A","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241271.585572_219.1","section":"bucket.instance","name":"ejuwhf-37:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.46","timestamp":"2021-02-13 18:34:31.585572280Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_mDbnQaV5gAjZL8anNAScPB9","ver":1},"status":{"status":"write"}}},{"id":"1_1613241271.603089_220.1","section":"bucket.instance","name":"ejuwhf-37:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.46","timestamp":"2021-02-13 18:34:31.603089265Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_mDbnQaV5gAjZL8anNAScPB9","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241271.608951_221.1","section":"bucket","name":"ejuwhf-37","timestamp":"2021-02-13 18:34:31.608951157Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_s74zFZJJ4NFsgBcob2jXayP","ver":1},"status":{"status":"write"}}},{"id":"1_1613241271.624585_222.1","section":"bucket","name":"ejuwhf-37","timestamp":"2021-02-13 18:34:31.624585936Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_s74zFZJJ4NFsgBcob2jXayP","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241272.105214_223.1","section":"bucket.instance","name":"ejuwhf-38:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.47","timestamp":"2021-02-13 18:34:32.105214877Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_hOR-x810TeuF27wCR96Wty1","ver":1},"status":{"status":"write"}}},{"id":"1_1613241272.122415_224.1","section":"bucket.instance","name":"ejuwhf-38:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.47","timestamp":"2021-02-13 18:34:32.122415123Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_hOR-x810TeuF27wCR96Wty1","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241272.128464_225.1","section":"bucket","name":"ejuwhf-38","timestamp":"2021-02-13 18:34:32.128464434Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_3IUloz0JebNxZ4oJtAH1uGt","ver":1},"status":{"status":"write"}}},{"id":"1_1613241272.144691_226.1","section":"bucket","name":"ejuwhf-38","timestamp":"2021-02-13 18:34:32.144691215Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_3IUloz0JebNxZ4oJtAH1uGt","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241280.698617_230.1","section":"bucket.instance","name":"ejuwhf-39:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.48","timestamp":"2021-02-13 18:34:40.698617098Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_eYhw6M1Kq9Fsl1gXEYBZ6tb","ver":1},"status":{"status":"write"}}},{"id":"1_1613241280.714973_231.1","section":"bucket.instance","name":"ejuwhf-39:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.48","timestamp":"2021-02-13 18:34:40.714973292Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_eYhw6M1Kq9Fsl1gXEYBZ6tb","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241280.720530_232.1","section":"bucket","name":"ejuwhf-39","timestamp":"2021-02-13 18:34:40.720530128Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_3SHNqKcm35n77170DwwQ5uP","ver":1},"status":{"status":"write"}}},{"id":"1_1613241280.736452_233.1","section":"bucket","name":"ejuwhf-39","timestamp":"2021-02-13 18:34:40.736452448Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_3SHNqKcm35n77170DwwQ5uP","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241281.607686_235.1","section":"bucket.instance","name":"ejuwhf-40:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.49","timestamp":"2021-02-13 18:34:41.607686289Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ET7-100GAjHcWvb6dmSd471","ver":1},"status":{"status":"write"}}},{"id":"1_1613241281.623808_236.1","section":"bucket.instance","name":"ejuwhf-40:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.49","timestamp":"2021-02-13 18:34:41.623808900Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ET7-100GAjHcWvb6dmSd471","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241281.629531_237.1","section":"bucket","name":"ejuwhf-40","timestamp":"2021-02-13 18:34:41.629531463Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_YLtkbjHvhAUvE3rtVFYlkKS","ver":1},"status":{"status":"write"}}},{"id":"1_1613241281.645755_238.1","section":"bucket","name":"ejuwhf-40","timestamp":"2021-02-13 18:34:41.645755376Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_YLtkbjHvhAUvE3rtVFYlkKS","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241281.785892_239.1","section":"bucket.instance","name":"ejuwhf-41:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.50","timestamp":"2021-02-13 18:34:41.785892843Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_A4tdGeJPy82CSxfrGu7y2YU","ver":1},"status":{"status":"write"}}},{"id":"1_1613241281.802707_240.1","section":"bucket.instance","name":"ejuwhf-41:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.50","timestamp":"2021-02-13 18:34:41.802707356Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_A4tdGeJPy82CSxfrGu7y2YU","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241281.808203_241.1","section":"bucket","name":"ejuwhf-41","timestamp":"2021-02-13 18:34:41.808203156Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_-Tx8KzgTMRgfsqe1Lj-5EOH","ver":1},"status":{"status":"write"}}},{"id":"1_1613241281.822512_242.1","section":"bucket","name":"ejuwhf-41","timestamp":"2021-02-13 18:34:41.822512374Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_-Tx8KzgTMRgfsqe1Lj-5EOH","ver":1},"status":{"status":"complete"}}}] 2021-02-13T18:37:02.764 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'list', '--period', '138dc4ba-dc02-4957-87c3-e8bf2d80917c', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:37:02.764 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'list', '--period', '138dc4ba-dc02-4957-87c3-e8bf2d80917c', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:37:02.765 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog list --period 138dc4ba-dc02-4957-87c3-e8bf2d80917c --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:37:02.897 INFO:teuthology.orchestra.run.gibba025.stdout:[{"id":"1_1613238836.390537_30.1","section":"user","name":"rgw-multisite-test-user","timestamp":"2021-02-13 17:53:56.390537712Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_pP6iIiaEGrFvLGsZM7x-OH9","ver":1},"status":{"status":"write"}}},{"id":"1_1613238836.394578_31.1","section":"user","name":"rgw-multisite-test-user","timestamp":"2021-02-13 17:53:56.394578235Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_pP6iIiaEGrFvLGsZM7x-OH9","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238955.574548_34.1","section":"bucket.instance","name":"ejuwhf-1:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.1","timestamp":"2021-02-13 17:55:55.574548718Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_x9-l_GSKepPMI4ZXnkA47yy","ver":1},"status":{"status":"write"}}},{"id":"1_1613238955.577573_35.1","section":"bucket.instance","name":"ejuwhf-1:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.1","timestamp":"2021-02-13 17:55:55.577573029Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_x9-l_GSKepPMI4ZXnkA47yy","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238955.578734_36.1","section":"bucket","name":"ejuwhf-1","timestamp":"2021-02-13 17:55:55.578734260Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_J8joTt2UmmIiOX87U166pOB","ver":1},"status":{"status":"write"}}},{"id":"1_1613238955.582128_37.1","section":"bucket","name":"ejuwhf-1","timestamp":"2021-02-13 17:55:55.582128841Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_J8joTt2UmmIiOX87U166pOB","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238955.598221_38.1","section":"bucket.instance","name":"ejuwhf-2:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.2","timestamp":"2021-02-13 17:55:55.598221635Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_XxLX1rySo-vI8MVX_6lsszw","ver":1},"status":{"status":"write"}}},{"id":"1_1613238955.601565_39.1","section":"bucket.instance","name":"ejuwhf-2:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.2","timestamp":"2021-02-13 17:55:55.601565432Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_XxLX1rySo-vI8MVX_6lsszw","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238955.602725_40.1","section":"bucket","name":"ejuwhf-2","timestamp":"2021-02-13 17:55:55.602725072Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_-17U9gIvg7jYouuMTrIVOEd","ver":1},"status":{"status":"write"}}},{"id":"1_1613238955.606187_41.1","section":"bucket","name":"ejuwhf-2","timestamp":"2021-02-13 17:55:55.606187695Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_-17U9gIvg7jYouuMTrIVOEd","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238956.751602_42.1","section":"bucket.instance","name":"ejuwhf-3:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.3","timestamp":"2021-02-13 17:55:56.751602944Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_lNPGQ7Vy4iyapNXVdS3aLPf","ver":1},"status":{"status":"write"}}},{"id":"1_1613238956.768275_43.1","section":"bucket.instance","name":"ejuwhf-3:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.3","timestamp":"2021-02-13 17:55:56.768275574Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_lNPGQ7Vy4iyapNXVdS3aLPf","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238956.775120_44.1","section":"bucket","name":"ejuwhf-3","timestamp":"2021-02-13 17:55:56.775120953Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_GCZqbJ9H_lfQq60lQ2CTjOd","ver":1},"status":{"status":"write"}}},{"id":"1_1613238956.791138_45.1","section":"bucket","name":"ejuwhf-3","timestamp":"2021-02-13 17:55:56.791138180Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_GCZqbJ9H_lfQq60lQ2CTjOd","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238960.597491_46.1","section":"bucket.instance","name":"ejuwhf-4:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.4","timestamp":"2021-02-13 17:56:00.597491162Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_0QbpwLYGTsIvm_YOZIhcyWS","ver":1},"status":{"status":"write"}}},{"id":"1_1613238960.614238_47.1","section":"bucket.instance","name":"ejuwhf-4:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.4","timestamp":"2021-02-13 17:56:00.614238433Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_0QbpwLYGTsIvm_YOZIhcyWS","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238960.620257_48.1","section":"bucket","name":"ejuwhf-4","timestamp":"2021-02-13 17:56:00.620257808Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_QDWd5t9vsHeGWEiagLoZ4l6","ver":1},"status":{"status":"write"}}},{"id":"1_1613238960.636707_49.1","section":"bucket","name":"ejuwhf-4","timestamp":"2021-02-13 17:56:00.636707536Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_QDWd5t9vsHeGWEiagLoZ4l6","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238960.666464_50.1","section":"bucket.instance","name":"ejuwhf-5:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.5","timestamp":"2021-02-13 17:56:00.666464684Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_HA_YqoBH5yRaCOOmwLHMDu_","ver":1},"status":{"status":"write"}}},{"id":"1_1613238960.682695_51.1","section":"bucket.instance","name":"ejuwhf-5:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.5","timestamp":"2021-02-13 17:56:00.682695337Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_HA_YqoBH5yRaCOOmwLHMDu_","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238960.688294_52.1","section":"bucket","name":"ejuwhf-5","timestamp":"2021-02-13 17:56:00.688294896Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_S2lucmmbUZ62_X47K1y6mSF","ver":1},"status":{"status":"write"}}},{"id":"1_1613238960.704528_53.1","section":"bucket","name":"ejuwhf-5","timestamp":"2021-02-13 17:56:00.704528473Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_S2lucmmbUZ62_X47K1y6mSF","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238960.766449_54.1","section":"bucket.instance","name":"ejuwhf-6:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.6","timestamp":"2021-02-13 17:56:00.766449862Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_4itjl067RN6aZgRRW5-Ukgb","ver":1},"status":{"status":"write"}}},{"id":"1_1613238960.782254_55.1","section":"bucket.instance","name":"ejuwhf-6:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.6","timestamp":"2021-02-13 17:56:00.782254386Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_4itjl067RN6aZgRRW5-Ukgb","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238960.787967_56.1","section":"bucket","name":"ejuwhf-6","timestamp":"2021-02-13 17:56:00.787967808Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"__e1Dsav3WgX_R99k1Kz1phg","ver":1},"status":{"status":"write"}}},{"id":"1_1613238960.804035_57.1","section":"bucket","name":"ejuwhf-6","timestamp":"2021-02-13 17:56:00.804035948Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"__e1Dsav3WgX_R99k1Kz1phg","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238968.578083_58.1","section":"bucket.instance","name":"ejuwhf-4:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.7","timestamp":"2021-02-13 17:56:08.578083676Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_rdxJZW8AbbLkx3Jo3qeZSTL","ver":1},"status":{"status":"write"}}},{"id":"1_1613238968.593717_59.1","section":"bucket.instance","name":"ejuwhf-4:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.7","timestamp":"2021-02-13 17:56:08.593717090Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_rdxJZW8AbbLkx3Jo3qeZSTL","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238968.600220_60.1","section":"bucket","name":"ejuwhf-4","timestamp":"2021-02-13 17:56:08.600220552Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_iCiP82FAKM6s-vHtX5gBzSR","ver":1},"status":{"status":"write"}}},{"id":"1_1613238968.610741_61.1","section":"bucket","name":"ejuwhf-4","timestamp":"2021-02-13 17:56:08.610741110Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_iCiP82FAKM6s-vHtX5gBzSR","ver":1},"status":{"status":"abort"}}},{"id":"1_1613238968.620505_62.1","section":"bucket.instance","name":"ejuwhf-4:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.7","timestamp":"2021-02-13 17:56:08.620505159Z","data":{"read_version":{"tag":"_rdxJZW8AbbLkx3Jo3qeZSTL","ver":1},"write_version":{"tag":"_rdxJZW8AbbLkx3Jo3qeZSTL","ver":2},"status":{"status":"remove"}}},{"id":"1_1613238968.636055_63.1","section":"bucket.instance","name":"ejuwhf-4:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.7","timestamp":"2021-02-13 17:56:08.636055803Z","data":{"read_version":{"tag":"_rdxJZW8AbbLkx3Jo3qeZSTL","ver":1},"write_version":{"tag":"_rdxJZW8AbbLkx3Jo3qeZSTL","ver":2},"status":{"status":"complete"}}},{"id":"1_1613238968.664189_64.1","section":"bucket.instance","name":"ejuwhf-5:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.8","timestamp":"2021-02-13 17:56:08.664189415Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_FcGNUs98T9meCX_-NJVwm_9","ver":1},"status":{"status":"write"}}},{"id":"1_1613238968.679282_65.1","section":"bucket.instance","name":"ejuwhf-5:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.8","timestamp":"2021-02-13 17:56:08.679282375Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_FcGNUs98T9meCX_-NJVwm_9","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238968.685310_66.1","section":"bucket","name":"ejuwhf-5","timestamp":"2021-02-13 17:56:08.685310012Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_waFuBRwm_oVRbc3bCTEK-2Q","ver":1},"status":{"status":"write"}}},{"id":"1_1613238968.695627_67.1","section":"bucket","name":"ejuwhf-5","timestamp":"2021-02-13 17:56:08.695627687Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_waFuBRwm_oVRbc3bCTEK-2Q","ver":1},"status":{"status":"abort"}}},{"id":"1_1613238968.705293_68.1","section":"bucket.instance","name":"ejuwhf-5:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.8","timestamp":"2021-02-13 17:56:08.705293699Z","data":{"read_version":{"tag":"_FcGNUs98T9meCX_-NJVwm_9","ver":1},"write_version":{"tag":"_FcGNUs98T9meCX_-NJVwm_9","ver":2},"status":{"status":"remove"}}},{"id":"1_1613238968.720069_69.1","section":"bucket.instance","name":"ejuwhf-5:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.8","timestamp":"2021-02-13 17:56:08.720069507Z","data":{"read_version":{"tag":"_FcGNUs98T9meCX_-NJVwm_9","ver":1},"write_version":{"tag":"_FcGNUs98T9meCX_-NJVwm_9","ver":2},"status":{"status":"complete"}}},{"id":"1_1613238968.747131_70.1","section":"bucket.instance","name":"ejuwhf-6:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.9","timestamp":"2021-02-13 17:56:08.747131498Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_KgNkkrSI2S7R0wW_SmAxVxt","ver":1},"status":{"status":"write"}}},{"id":"1_1613238968.763036_71.1","section":"bucket.instance","name":"ejuwhf-6:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.9","timestamp":"2021-02-13 17:56:08.763036003Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_KgNkkrSI2S7R0wW_SmAxVxt","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238968.769054_72.1","section":"bucket","name":"ejuwhf-6","timestamp":"2021-02-13 17:56:08.769054237Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_mBw7Ckz7EfNkJ26ASXtA1Qx","ver":1},"status":{"status":"write"}}},{"id":"1_1613238968.780056_73.1","section":"bucket","name":"ejuwhf-6","timestamp":"2021-02-13 17:56:08.780056555Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_mBw7Ckz7EfNkJ26ASXtA1Qx","ver":1},"status":{"status":"abort"}}},{"id":"1_1613238968.790518_74.1","section":"bucket.instance","name":"ejuwhf-6:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.9","timestamp":"2021-02-13 17:56:08.790518321Z","data":{"read_version":{"tag":"_KgNkkrSI2S7R0wW_SmAxVxt","ver":1},"write_version":{"tag":"_KgNkkrSI2S7R0wW_SmAxVxt","ver":2},"status":{"status":"remove"}}},{"id":"1_1613238968.805425_75.1","section":"bucket.instance","name":"ejuwhf-6:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.9","timestamp":"2021-02-13 17:56:08.805425116Z","data":{"read_version":{"tag":"_KgNkkrSI2S7R0wW_SmAxVxt","ver":1},"write_version":{"tag":"_KgNkkrSI2S7R0wW_SmAxVxt","ver":2},"status":{"status":"complete"}}},{"id":"1_1613238968.876119_76.1","section":"bucket.instance","name":"ejuwhf-4:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.10","timestamp":"2021-02-13 17:56:08.876119966Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_C13ny0FEaZhMoqR1eHNrzzo","ver":1},"status":{"status":"write"}}},{"id":"1_1613238968.892593_77.1","section":"bucket.instance","name":"ejuwhf-4:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.10","timestamp":"2021-02-13 17:56:08.892593644Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_C13ny0FEaZhMoqR1eHNrzzo","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238968.898155_78.1","section":"bucket","name":"ejuwhf-4","timestamp":"2021-02-13 17:56:08.898155724Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_S4geTzMH6fpArDdiMUd2Hj6","ver":1},"status":{"status":"write"}}},{"id":"1_1613238968.909527_79.1","section":"bucket","name":"ejuwhf-4","timestamp":"2021-02-13 17:56:08.909527088Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_S4geTzMH6fpArDdiMUd2Hj6","ver":1},"status":{"status":"abort"}}},{"id":"1_1613238968.919849_80.1","section":"bucket.instance","name":"ejuwhf-4:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.10","timestamp":"2021-02-13 17:56:08.919849797Z","data":{"read_version":{"tag":"_C13ny0FEaZhMoqR1eHNrzzo","ver":1},"write_version":{"tag":"_C13ny0FEaZhMoqR1eHNrzzo","ver":2},"status":{"status":"remove"}}},{"id":"1_1613238968.934852_81.1","section":"bucket.instance","name":"ejuwhf-4:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.10","timestamp":"2021-02-13 17:56:08.934852594Z","data":{"read_version":{"tag":"_C13ny0FEaZhMoqR1eHNrzzo","ver":1},"write_version":{"tag":"_C13ny0FEaZhMoqR1eHNrzzo","ver":2},"status":{"status":"complete"}}},{"id":"1_1613238968.997546_82.1","section":"bucket.instance","name":"ejuwhf-5:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.11","timestamp":"2021-02-13 17:56:08.997546443Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_0hI8LEwJXCt77LG_Y8caPyb","ver":1},"status":{"status":"write"}}},{"id":"1_1613238969.013809_83.1","section":"bucket.instance","name":"ejuwhf-5:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.11","timestamp":"2021-02-13 17:56:09.013809353Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_0hI8LEwJXCt77LG_Y8caPyb","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238969.019756_84.1","section":"bucket","name":"ejuwhf-5","timestamp":"2021-02-13 17:56:09.019756087Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_BES52o3jnI5HPCcsJxAGAPJ","ver":1},"status":{"status":"write"}}},{"id":"1_1613238969.031040_85.1","section":"bucket","name":"ejuwhf-5","timestamp":"2021-02-13 17:56:09.031040364Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_BES52o3jnI5HPCcsJxAGAPJ","ver":1},"status":{"status":"abort"}}},{"id":"1_1613238969.041765_86.1","section":"bucket.instance","name":"ejuwhf-5:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.11","timestamp":"2021-02-13 17:56:09.041765351Z","data":{"read_version":{"tag":"_0hI8LEwJXCt77LG_Y8caPyb","ver":1},"write_version":{"tag":"_0hI8LEwJXCt77LG_Y8caPyb","ver":2},"status":{"status":"remove"}}},{"id":"1_1613238969.056811_87.1","section":"bucket.instance","name":"ejuwhf-5:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.11","timestamp":"2021-02-13 17:56:09.056811080Z","data":{"read_version":{"tag":"_0hI8LEwJXCt77LG_Y8caPyb","ver":1},"write_version":{"tag":"_0hI8LEwJXCt77LG_Y8caPyb","ver":2},"status":{"status":"complete"}}},{"id":"1_1613238969.156956_88.1","section":"bucket.instance","name":"ejuwhf-6:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.12","timestamp":"2021-02-13 17:56:09.156956168Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_zCjiECQrQYftP3tksmjEkCi","ver":1},"status":{"status":"write"}}},{"id":"1_1613238969.172609_89.1","section":"bucket.instance","name":"ejuwhf-6:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.12","timestamp":"2021-02-13 17:56:09.172609871Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_zCjiECQrQYftP3tksmjEkCi","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238969.178077_90.1","section":"bucket","name":"ejuwhf-6","timestamp":"2021-02-13 17:56:09.178077356Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_oL1JaCHeOTBFodmq4Vo462S","ver":1},"status":{"status":"write"}}},{"id":"1_1613238969.189167_91.1","section":"bucket","name":"ejuwhf-6","timestamp":"2021-02-13 17:56:09.189167254Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_oL1JaCHeOTBFodmq4Vo462S","ver":1},"status":{"status":"abort"}}},{"id":"1_1613238969.199338_92.1","section":"bucket.instance","name":"ejuwhf-6:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.12","timestamp":"2021-02-13 17:56:09.199338685Z","data":{"read_version":{"tag":"_zCjiECQrQYftP3tksmjEkCi","ver":1},"write_version":{"tag":"_zCjiECQrQYftP3tksmjEkCi","ver":2},"status":{"status":"remove"}}},{"id":"1_1613238969.214181_93.1","section":"bucket.instance","name":"ejuwhf-6:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.12","timestamp":"2021-02-13 17:56:09.214181526Z","data":{"read_version":{"tag":"_zCjiECQrQYftP3tksmjEkCi","ver":1},"write_version":{"tag":"_zCjiECQrQYftP3tksmjEkCi","ver":2},"status":{"status":"complete"}}},{"id":"1_1613238970.008086_94.1","section":"bucket.instance","name":"ejuwhf-4:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.13","timestamp":"2021-02-13 17:56:10.008086848Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_v1tc2RjtPRbgReNqKENKBra","ver":1},"status":{"status":"write"}}},{"id":"1_1613238970.012670_95.1","section":"bucket.instance","name":"ejuwhf-4:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.13","timestamp":"2021-02-13 17:56:10.012670714Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_v1tc2RjtPRbgReNqKENKBra","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238970.014042_96.1","section":"bucket","name":"ejuwhf-4","timestamp":"2021-02-13 17:56:10.014042198Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_jKuSp21Zxke6SyefbVS70eh","ver":1},"status":{"status":"write"}}},{"id":"1_1613238970.016320_97.1","section":"bucket","name":"ejuwhf-4","timestamp":"2021-02-13 17:56:10.016320019Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_jKuSp21Zxke6SyefbVS70eh","ver":1},"status":{"status":"abort"}}},{"id":"1_1613238970.018539_98.1","section":"bucket.instance","name":"ejuwhf-4:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.13","timestamp":"2021-02-13 17:56:10.018539949Z","data":{"read_version":{"tag":"_v1tc2RjtPRbgReNqKENKBra","ver":1},"write_version":{"tag":"_v1tc2RjtPRbgReNqKENKBra","ver":2},"status":{"status":"remove"}}},{"id":"1_1613238970.022074_99.1","section":"bucket.instance","name":"ejuwhf-4:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.13","timestamp":"2021-02-13 17:56:10.022074729Z","data":{"read_version":{"tag":"_v1tc2RjtPRbgReNqKENKBra","ver":1},"write_version":{"tag":"_v1tc2RjtPRbgReNqKENKBra","ver":2},"status":{"status":"complete"}}},{"id":"1_1613238970.038564_100.1","section":"bucket.instance","name":"ejuwhf-5:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.14","timestamp":"2021-02-13 17:56:10.038564464Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Xxy0kA0Wvug2PQ7muelD8wi","ver":1},"status":{"status":"write"}}},{"id":"1_1613238970.043284_101.1","section":"bucket.instance","name":"ejuwhf-5:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.14","timestamp":"2021-02-13 17:56:10.043284541Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Xxy0kA0Wvug2PQ7muelD8wi","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238970.045447_102.1","section":"bucket","name":"ejuwhf-5","timestamp":"2021-02-13 17:56:10.045447439Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_4o9pGwW2NxyPbqj-tJaLONx","ver":1},"status":{"status":"write"}}},{"id":"1_1613238970.049722_103.1","section":"bucket","name":"ejuwhf-5","timestamp":"2021-02-13 17:56:10.049722714Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_4o9pGwW2NxyPbqj-tJaLONx","ver":1},"status":{"status":"abort"}}},{"id":"1_1613238970.053833_104.1","section":"bucket.instance","name":"ejuwhf-5:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.14","timestamp":"2021-02-13 17:56:10.053833249Z","data":{"read_version":{"tag":"_Xxy0kA0Wvug2PQ7muelD8wi","ver":1},"write_version":{"tag":"_Xxy0kA0Wvug2PQ7muelD8wi","ver":2},"status":{"status":"remove"}}},{"id":"1_1613238970.060705_105.1","section":"bucket.instance","name":"ejuwhf-5:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.14","timestamp":"2021-02-13 17:56:10.060705344Z","data":{"read_version":{"tag":"_Xxy0kA0Wvug2PQ7muelD8wi","ver":1},"write_version":{"tag":"_Xxy0kA0Wvug2PQ7muelD8wi","ver":2},"status":{"status":"complete"}}},{"id":"1_1613238970.135374_106.1","section":"bucket.instance","name":"ejuwhf-6:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.15","timestamp":"2021-02-13 17:56:10.135374943Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_eq-mn_enn9JS0uzsAd-kc3u","ver":1},"status":{"status":"write"}}},{"id":"1_1613238970.138703_107.1","section":"bucket.instance","name":"ejuwhf-6:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.15","timestamp":"2021-02-13 17:56:10.138703651Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_eq-mn_enn9JS0uzsAd-kc3u","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238970.140040_108.1","section":"bucket","name":"ejuwhf-6","timestamp":"2021-02-13 17:56:10.140040095Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_wcze0QNXW6OpN55syVKmWYX","ver":1},"status":{"status":"write"}}},{"id":"1_1613238970.143082_109.1","section":"bucket","name":"ejuwhf-6","timestamp":"2021-02-13 17:56:10.143082486Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_wcze0QNXW6OpN55syVKmWYX","ver":1},"status":{"status":"abort"}}},{"id":"1_1613238970.145487_110.1","section":"bucket.instance","name":"ejuwhf-6:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.15","timestamp":"2021-02-13 17:56:10.145487685Z","data":{"read_version":{"tag":"_eq-mn_enn9JS0uzsAd-kc3u","ver":1},"write_version":{"tag":"_eq-mn_enn9JS0uzsAd-kc3u","ver":2},"status":{"status":"remove"}}},{"id":"1_1613238970.149013_111.1","section":"bucket.instance","name":"ejuwhf-6:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.15","timestamp":"2021-02-13 17:56:10.149013694Z","data":{"read_version":{"tag":"_eq-mn_enn9JS0uzsAd-kc3u","ver":1},"write_version":{"tag":"_eq-mn_enn9JS0uzsAd-kc3u","ver":2},"status":{"status":"complete"}}},{"id":"1_1613238983.138841_112.1","section":"bucket.instance","name":"ejuwhf-7:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.16","timestamp":"2021-02-13 17:56:23.138841633Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_6gToYEDMo15odl3q3-L3Vdk","ver":1},"status":{"status":"write"}}},{"id":"1_1613238983.154116_113.1","section":"bucket.instance","name":"ejuwhf-7:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.16","timestamp":"2021-02-13 17:56:23.154116996Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_6gToYEDMo15odl3q3-L3Vdk","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238983.159663_114.1","section":"bucket","name":"ejuwhf-7","timestamp":"2021-02-13 17:56:23.159663722Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_vMCydHAxj_7QuSB-qm9iUeu","ver":1},"status":{"status":"write"}}},{"id":"1_1613238983.175427_115.1","section":"bucket","name":"ejuwhf-7","timestamp":"2021-02-13 17:56:23.175427702Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_vMCydHAxj_7QuSB-qm9iUeu","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238983.204618_116.1","section":"bucket.instance","name":"ejuwhf-8:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.17","timestamp":"2021-02-13 17:56:23.204618338Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Hdp3JF03_d_n4JjDXpJzu0M","ver":1},"status":{"status":"write"}}},{"id":"1_1613238983.219872_117.1","section":"bucket.instance","name":"ejuwhf-8:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.17","timestamp":"2021-02-13 17:56:23.219872258Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Hdp3JF03_d_n4JjDXpJzu0M","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238983.225498_118.1","section":"bucket","name":"ejuwhf-8","timestamp":"2021-02-13 17:56:23.225498137Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_MGOREBZ0hisc7Gbu7eA5JrS","ver":1},"status":{"status":"write"}}},{"id":"1_1613238983.241003_119.1","section":"bucket","name":"ejuwhf-8","timestamp":"2021-02-13 17:56:23.241003542Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_MGOREBZ0hisc7Gbu7eA5JrS","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238983.303585_120.1","section":"bucket.instance","name":"ejuwhf-9:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.18","timestamp":"2021-02-13 17:56:23.303585683Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_jRCaQz5FozM4nex7-DOl0kP","ver":1},"status":{"status":"write"}}},{"id":"1_1613238983.318865_121.1","section":"bucket.instance","name":"ejuwhf-9:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.18","timestamp":"2021-02-13 17:56:23.318865612Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_jRCaQz5FozM4nex7-DOl0kP","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238983.325660_122.1","section":"bucket","name":"ejuwhf-9","timestamp":"2021-02-13 17:56:23.325660323Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_YYkgNX9vj3hntComaoMK5U7","ver":1},"status":{"status":"write"}}},{"id":"1_1613238983.341158_123.1","section":"bucket","name":"ejuwhf-9","timestamp":"2021-02-13 17:56:23.341158692Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_YYkgNX9vj3hntComaoMK5U7","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238989.616147_124.1","section":"bucket","name":"ejuwhf-7","timestamp":"2021-02-13 17:56:29.616147126Z","data":{"read_version":{"tag":"_vMCydHAxj_7QuSB-qm9iUeu","ver":1},"write_version":{"tag":"_vMCydHAxj_7QuSB-qm9iUeu","ver":2},"status":{"status":"remove"}}},{"id":"1_1613238989.631574_125.1","section":"bucket","name":"ejuwhf-7","timestamp":"2021-02-13 17:56:29.631574106Z","data":{"read_version":{"tag":"_vMCydHAxj_7QuSB-qm9iUeu","ver":1},"write_version":{"tag":"_vMCydHAxj_7QuSB-qm9iUeu","ver":2},"status":{"status":"complete"}}},{"id":"1_1613238989.670248_126.1","section":"bucket","name":"ejuwhf-8","timestamp":"2021-02-13 17:56:29.670248409Z","data":{"read_version":{"tag":"_MGOREBZ0hisc7Gbu7eA5JrS","ver":1},"write_version":{"tag":"_MGOREBZ0hisc7Gbu7eA5JrS","ver":2},"status":{"status":"remove"}}},{"id":"1_1613238989.685454_127.1","section":"bucket","name":"ejuwhf-8","timestamp":"2021-02-13 17:56:29.685454067Z","data":{"read_version":{"tag":"_MGOREBZ0hisc7Gbu7eA5JrS","ver":1},"write_version":{"tag":"_MGOREBZ0hisc7Gbu7eA5JrS","ver":2},"status":{"status":"complete"}}},{"id":"1_1613238989.754736_128.1","section":"bucket","name":"ejuwhf-9","timestamp":"2021-02-13 17:56:29.754736933Z","data":{"read_version":{"tag":"_YYkgNX9vj3hntComaoMK5U7","ver":1},"write_version":{"tag":"_YYkgNX9vj3hntComaoMK5U7","ver":2},"status":{"status":"remove"}}},{"id":"1_1613238989.770436_129.1","section":"bucket","name":"ejuwhf-9","timestamp":"2021-02-13 17:56:29.770436155Z","data":{"read_version":{"tag":"_YYkgNX9vj3hntComaoMK5U7","ver":1},"write_version":{"tag":"_YYkgNX9vj3hntComaoMK5U7","ver":2},"status":{"status":"complete"}}},{"id":"1_1613238996.408432_20.1","section":"bucket.instance","name":"ejuwhf-10:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.19","timestamp":"2021-02-13 17:56:36.408432478Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_4l67hELsPgMja42xS8A6UhZ","ver":1},"status":{"status":"write"}}},{"id":"1_1613238996.425111_21.1","section":"bucket.instance","name":"ejuwhf-10:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.19","timestamp":"2021-02-13 17:56:36.425111236Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_4l67hELsPgMja42xS8A6UhZ","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238996.431060_22.1","section":"bucket","name":"ejuwhf-10","timestamp":"2021-02-13 17:56:36.431060604Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_xJby3h3bIk5vujQVV2pSTI-","ver":1},"status":{"status":"write"}}},{"id":"1_1613238996.446399_23.1","section":"bucket","name":"ejuwhf-10","timestamp":"2021-02-13 17:56:36.446399505Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_xJby3h3bIk5vujQVV2pSTI-","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238996.476122_24.1","section":"bucket.instance","name":"ejuwhf-11:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.20","timestamp":"2021-02-13 17:56:36.476122639Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_BCqsB66WxEPsrV6oYaSn_X-","ver":1},"status":{"status":"write"}}},{"id":"1_1613238996.491357_25.1","section":"bucket.instance","name":"ejuwhf-11:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.20","timestamp":"2021-02-13 17:56:36.491357838Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_BCqsB66WxEPsrV6oYaSn_X-","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238996.497273_26.1","section":"bucket","name":"ejuwhf-11","timestamp":"2021-02-13 17:56:36.497273035Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ojdkozIRvVsoWlCTyPLaGvj","ver":1},"status":{"status":"write"}}},{"id":"1_1613238996.512730_27.1","section":"bucket","name":"ejuwhf-11","timestamp":"2021-02-13 17:56:36.512730394Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ojdkozIRvVsoWlCTyPLaGvj","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238996.571112_28.1","section":"bucket.instance","name":"ejuwhf-12:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.21","timestamp":"2021-02-13 17:56:36.571112397Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_r6gSqSaTmTbReYf0uGy8_aC","ver":1},"status":{"status":"write"}}},{"id":"1_1613238996.586525_29.1","section":"bucket.instance","name":"ejuwhf-12:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.21","timestamp":"2021-02-13 17:56:36.586525109Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_r6gSqSaTmTbReYf0uGy8_aC","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238996.592228_30.1","section":"bucket","name":"ejuwhf-12","timestamp":"2021-02-13 17:56:36.592228025Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_--CaWqDYGbvQ4rZIucE1e-K","ver":1},"status":{"status":"write"}}},{"id":"1_1613238996.608007_31.1","section":"bucket","name":"ejuwhf-12","timestamp":"2021-02-13 17:56:36.608007431Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_--CaWqDYGbvQ4rZIucE1e-K","ver":1},"status":{"status":"complete"}}},{"id":"1_1613239321.080300_38.1","section":"bucket.instance","name":"ejuwhf-13:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.22","timestamp":"2021-02-13 18:02:01.080300919Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_78_uv7fHwaN7Qq4cyWhHLJz","ver":1},"status":{"status":"write"}}},{"id":"1_1613239321.097646_39.1","section":"bucket.instance","name":"ejuwhf-13:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.22","timestamp":"2021-02-13 18:02:01.097646161Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_78_uv7fHwaN7Qq4cyWhHLJz","ver":1},"status":{"status":"complete"}}},{"id":"1_1613239321.103822_40.1","section":"bucket","name":"ejuwhf-13","timestamp":"2021-02-13 18:02:01.103822896Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_lALUDndfu0TuP5K39wzC8in","ver":1},"status":{"status":"write"}}},{"id":"1_1613239321.120036_41.1","section":"bucket","name":"ejuwhf-13","timestamp":"2021-02-13 18:02:01.120036765Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_lALUDndfu0TuP5K39wzC8in","ver":1},"status":{"status":"complete"}}},{"id":"1_1613239321.157244_42.1","section":"bucket.instance","name":"ejuwhf-14:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.23","timestamp":"2021-02-13 18:02:01.157244195Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_fjpp4stMsyB7r2vHCXiSEql","ver":1},"status":{"status":"write"}}},{"id":"1_1613239321.173727_43.1","section":"bucket.instance","name":"ejuwhf-14:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.23","timestamp":"2021-02-13 18:02:01.173727725Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_fjpp4stMsyB7r2vHCXiSEql","ver":1},"status":{"status":"complete"}}},{"id":"1_1613239321.180183_44.1","section":"bucket","name":"ejuwhf-14","timestamp":"2021-02-13 18:02:01.180183919Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_lw1mkbLyJ3o-_DlonZo1SDZ","ver":1},"status":{"status":"write"}}},{"id":"1_1613239321.196368_45.1","section":"bucket","name":"ejuwhf-14","timestamp":"2021-02-13 18:02:01.196368937Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_lw1mkbLyJ3o-_DlonZo1SDZ","ver":1},"status":{"status":"complete"}}},{"id":"1_1613239321.265331_46.1","section":"bucket.instance","name":"ejuwhf-15:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.24","timestamp":"2021-02-13 18:02:01.265331350Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_uR_U3DJvBMRDbNsj1s38fR9","ver":1},"status":{"status":"write"}}},{"id":"1_1613239321.281670_47.1","section":"bucket.instance","name":"ejuwhf-15:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.24","timestamp":"2021-02-13 18:02:01.281670891Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_uR_U3DJvBMRDbNsj1s38fR9","ver":1},"status":{"status":"complete"}}},{"id":"1_1613239321.288543_48.1","section":"bucket","name":"ejuwhf-15","timestamp":"2021-02-13 18:02:01.288543122Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_k0PgphUQ7BAgCgZzpBUzBNN","ver":1},"status":{"status":"write"}}},{"id":"1_1613239321.305535_49.1","section":"bucket","name":"ejuwhf-15","timestamp":"2021-02-13 18:02:01.305535796Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_k0PgphUQ7BAgCgZzpBUzBNN","ver":1},"status":{"status":"complete"}}},{"id":"1_1613239643.733725_59.1","section":"bucket.instance","name":"ejuwhf-16:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.25","timestamp":"2021-02-13 18:07:23.733725000Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_nrprWx7VCq8YBJvRP_pJfT4","ver":1},"status":{"status":"write"}}},{"id":"1_1613239643.749943_60.1","section":"bucket.instance","name":"ejuwhf-16:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.25","timestamp":"2021-02-13 18:07:23.749943843Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_nrprWx7VCq8YBJvRP_pJfT4","ver":1},"status":{"status":"complete"}}},{"id":"1_1613239643.755418_61.1","section":"bucket","name":"ejuwhf-16","timestamp":"2021-02-13 18:07:23.755418869Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_LBYOapPliGlX3yh25unm84s","ver":1},"status":{"status":"write"}}},{"id":"1_1613239643.771083_62.1","section":"bucket","name":"ejuwhf-16","timestamp":"2021-02-13 18:07:23.771083206Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_LBYOapPliGlX3yh25unm84s","ver":1},"status":{"status":"complete"}}},{"id":"1_1613239643.806893_63.1","section":"bucket.instance","name":"ejuwhf-17:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.26","timestamp":"2021-02-13 18:07:23.806893724Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_8ovGbH1o6FvQnTtXB8s_UQm","ver":1},"status":{"status":"write"}}},{"id":"1_1613239643.822147_64.1","section":"bucket.instance","name":"ejuwhf-17:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.26","timestamp":"2021-02-13 18:07:23.822147852Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_8ovGbH1o6FvQnTtXB8s_UQm","ver":1},"status":{"status":"complete"}}},{"id":"1_1613239643.828619_65.1","section":"bucket","name":"ejuwhf-17","timestamp":"2021-02-13 18:07:23.828619399Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_h5MGnGsOEE9cFxGphgLOG3x","ver":1},"status":{"status":"write"}}},{"id":"1_1613239643.843279_66.1","section":"bucket","name":"ejuwhf-17","timestamp":"2021-02-13 18:07:23.843279069Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_h5MGnGsOEE9cFxGphgLOG3x","ver":1},"status":{"status":"complete"}}},{"id":"1_1613239643.906536_67.1","section":"bucket.instance","name":"ejuwhf-18:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.27","timestamp":"2021-02-13 18:07:23.906536499Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_YkOje16YwjBiAb0w6q8pqfO","ver":1},"status":{"status":"write"}}},{"id":"1_1613239643.922078_68.1","section":"bucket.instance","name":"ejuwhf-18:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.27","timestamp":"2021-02-13 18:07:23.922078168Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_YkOje16YwjBiAb0w6q8pqfO","ver":1},"status":{"status":"complete"}}},{"id":"1_1613239643.928111_69.1","section":"bucket","name":"ejuwhf-18","timestamp":"2021-02-13 18:07:23.928111593Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_2fiWbEVMEWvujFO3XL_4NjI","ver":1},"status":{"status":"write"}}},{"id":"1_1613239643.944698_70.1","section":"bucket","name":"ejuwhf-18","timestamp":"2021-02-13 18:07:23.944698661Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_2fiWbEVMEWvujFO3XL_4NjI","ver":1},"status":{"status":"complete"}}},{"id":"1_1613239643.992830_71.1","section":"bucket.instance","name":"ejuwhf-16:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.25","timestamp":"2021-02-13 18:07:23.992830606Z","data":{"read_version":{"tag":"_nrprWx7VCq8YBJvRP_pJfT4","ver":1},"write_version":{"tag":"_nrprWx7VCq8YBJvRP_pJfT4","ver":2},"status":{"status":"write"}}},{"id":"1_1613239644.009885_72.1","section":"bucket.instance","name":"ejuwhf-16:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.25","timestamp":"2021-02-13 18:07:24.009885261Z","data":{"read_version":{"tag":"_nrprWx7VCq8YBJvRP_pJfT4","ver":1},"write_version":{"tag":"_nrprWx7VCq8YBJvRP_pJfT4","ver":2},"status":{"status":"complete"}}},{"id":"1_1613239644.020434_73.1","section":"bucket.instance","name":"ejuwhf-17:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.26","timestamp":"2021-02-13 18:07:24.020434444Z","data":{"read_version":{"tag":"_8ovGbH1o6FvQnTtXB8s_UQm","ver":1},"write_version":{"tag":"_8ovGbH1o6FvQnTtXB8s_UQm","ver":2},"status":{"status":"write"}}},{"id":"1_1613239644.036282_74.1","section":"bucket.instance","name":"ejuwhf-17:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.26","timestamp":"2021-02-13 18:07:24.036282947Z","data":{"read_version":{"tag":"_8ovGbH1o6FvQnTtXB8s_UQm","ver":1},"write_version":{"tag":"_8ovGbH1o6FvQnTtXB8s_UQm","ver":2},"status":{"status":"complete"}}},{"id":"1_1613239644.055423_75.1","section":"bucket.instance","name":"ejuwhf-18:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.27","timestamp":"2021-02-13 18:07:24.055423607Z","data":{"read_version":{"tag":"_YkOje16YwjBiAb0w6q8pqfO","ver":1},"write_version":{"tag":"_YkOje16YwjBiAb0w6q8pqfO","ver":2},"status":{"status":"write"}}},{"id":"1_1613239644.070890_76.1","section":"bucket.instance","name":"ejuwhf-18:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.27","timestamp":"2021-02-13 18:07:24.070890569Z","data":{"read_version":{"tag":"_YkOje16YwjBiAb0w6q8pqfO","ver":1},"write_version":{"tag":"_YkOje16YwjBiAb0w6q8pqfO","ver":2},"status":{"status":"complete"}}},{"id":"1_1613239973.558856_84.1","section":"bucket.instance","name":"ejuwhf-19:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.28","timestamp":"2021-02-13 18:12:53.558856802Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_QLbnfIoGGaZIt0rwcmk-qti","ver":1},"status":{"status":"write"}}},{"id":"1_1613239973.575588_85.1","section":"bucket.instance","name":"ejuwhf-19:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.28","timestamp":"2021-02-13 18:12:53.575588311Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_QLbnfIoGGaZIt0rwcmk-qti","ver":1},"status":{"status":"complete"}}},{"id":"1_1613239973.581642_86.1","section":"bucket","name":"ejuwhf-19","timestamp":"2021-02-13 18:12:53.581642872Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_6FRUK8ncgnwrL2ZLGpRvips","ver":1},"status":{"status":"write"}}},{"id":"1_1613239973.597791_87.1","section":"bucket","name":"ejuwhf-19","timestamp":"2021-02-13 18:12:53.597791408Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_6FRUK8ncgnwrL2ZLGpRvips","ver":1},"status":{"status":"complete"}}},{"id":"1_1613239973.618317_88.1","section":"bucket.instance","name":"ejuwhf-19:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.28","timestamp":"2021-02-13 18:12:53.618317926Z","data":{"read_version":{"tag":"_QLbnfIoGGaZIt0rwcmk-qti","ver":1},"write_version":{"tag":"_QLbnfIoGGaZIt0rwcmk-qti","ver":2},"status":{"status":"write"}}},{"id":"1_1613239973.634814_89.1","section":"bucket.instance","name":"ejuwhf-19:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.28","timestamp":"2021-02-13 18:12:53.634814126Z","data":{"read_version":{"tag":"_QLbnfIoGGaZIt0rwcmk-qti","ver":1},"write_version":{"tag":"_QLbnfIoGGaZIt0rwcmk-qti","ver":2},"status":{"status":"complete"}}},{"id":"1_1613240298.200387_96.1","section":"bucket.instance","name":"ejuwhf-20:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.29","timestamp":"2021-02-13 18:18:18.200387564Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_zG-4FJP4lrTan5vmKfxkgxY","ver":1},"status":{"status":"write"}}},{"id":"1_1613240298.216338_97.1","section":"bucket.instance","name":"ejuwhf-20:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.29","timestamp":"2021-02-13 18:18:18.216338639Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_zG-4FJP4lrTan5vmKfxkgxY","ver":1},"status":{"status":"complete"}}},{"id":"1_1613240298.221718_98.1","section":"bucket","name":"ejuwhf-20","timestamp":"2021-02-13 18:18:18.221718896Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_hjd9VzRPYHn39EeVUieezBi","ver":1},"status":{"status":"write"}}},{"id":"1_1613240298.236365_99.1","section":"bucket","name":"ejuwhf-20","timestamp":"2021-02-13 18:18:18.236365179Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_hjd9VzRPYHn39EeVUieezBi","ver":1},"status":{"status":"complete"}}},{"id":"1_1613240621.656212_103.1","section":"bucket.instance","name":"ejuwhf-21:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.30","timestamp":"2021-02-13 18:23:41.656212918Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_PI91VmrZ-dDN5s_JIZJAPOu","ver":1},"status":{"status":"write"}}},{"id":"1_1613240621.672322_104.1","section":"bucket.instance","name":"ejuwhf-21:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.30","timestamp":"2021-02-13 18:23:41.672322312Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_PI91VmrZ-dDN5s_JIZJAPOu","ver":1},"status":{"status":"complete"}}},{"id":"1_1613240621.678630_105.1","section":"bucket","name":"ejuwhf-21","timestamp":"2021-02-13 18:23:41.678630564Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_QJCL0oRPCaZnOLc3FqHRPYX","ver":1},"status":{"status":"write"}}},{"id":"1_1613240621.693560_106.1","section":"bucket","name":"ejuwhf-21","timestamp":"2021-02-13 18:23:41.693560697Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_QJCL0oRPCaZnOLc3FqHRPYX","ver":1},"status":{"status":"complete"}}},{"id":"1_1613240621.741301_107.1","section":"bucket.instance","name":"ejuwhf-22:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.31","timestamp":"2021-02-13 18:23:41.741301484Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_hl5-x8kVDYpS5w-oh53bPCW","ver":1},"status":{"status":"write"}}},{"id":"1_1613240621.757529_108.1","section":"bucket.instance","name":"ejuwhf-22:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.31","timestamp":"2021-02-13 18:23:41.757529664Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_hl5-x8kVDYpS5w-oh53bPCW","ver":1},"status":{"status":"complete"}}},{"id":"1_1613240621.762982_109.1","section":"bucket","name":"ejuwhf-22","timestamp":"2021-02-13 18:23:41.762982204Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_qyPb-YYouea6Artq7SRkTtW","ver":1},"status":{"status":"write"}}},{"id":"1_1613240621.778531_110.1","section":"bucket","name":"ejuwhf-22","timestamp":"2021-02-13 18:23:41.778531566Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_qyPb-YYouea6Artq7SRkTtW","ver":1},"status":{"status":"complete"}}},{"id":"1_1613240621.852919_111.1","section":"bucket.instance","name":"ejuwhf-23:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.32","timestamp":"2021-02-13 18:23:41.852919112Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Zi3cYMrdm4uEttRZYVVoHN6","ver":1},"status":{"status":"write"}}},{"id":"1_1613240621.869034_112.1","section":"bucket.instance","name":"ejuwhf-23:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.32","timestamp":"2021-02-13 18:23:41.869034552Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Zi3cYMrdm4uEttRZYVVoHN6","ver":1},"status":{"status":"complete"}}},{"id":"1_1613240621.874580_113.1","section":"bucket","name":"ejuwhf-23","timestamp":"2021-02-13 18:23:41.874580193Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_HU3tbDLtK_l1Ht1UbiwZmmt","ver":1},"status":{"status":"write"}}},{"id":"1_1613240621.889892_114.1","section":"bucket","name":"ejuwhf-23","timestamp":"2021-02-13 18:23:41.889892437Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_HU3tbDLtK_l1Ht1UbiwZmmt","ver":1},"status":{"status":"complete"}}},{"id":"1_1613240621.938311_115.1","section":"bucket.instance","name":"ejuwhf-21:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.30","timestamp":"2021-02-13 18:23:41.938311534Z","data":{"read_version":{"tag":"_PI91VmrZ-dDN5s_JIZJAPOu","ver":1},"write_version":{"tag":"_PI91VmrZ-dDN5s_JIZJAPOu","ver":2},"status":{"status":"write"}}},{"id":"1_1613240621.954359_116.1","section":"bucket.instance","name":"ejuwhf-21:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.30","timestamp":"2021-02-13 18:23:41.954359504Z","data":{"read_version":{"tag":"_PI91VmrZ-dDN5s_JIZJAPOu","ver":1},"write_version":{"tag":"_PI91VmrZ-dDN5s_JIZJAPOu","ver":2},"status":{"status":"complete"}}},{"id":"1_1613240621.972224_117.1","section":"bucket.instance","name":"ejuwhf-22:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.31","timestamp":"2021-02-13 18:23:41.972224734Z","data":{"read_version":{"tag":"_hl5-x8kVDYpS5w-oh53bPCW","ver":1},"write_version":{"tag":"_hl5-x8kVDYpS5w-oh53bPCW","ver":2},"status":{"status":"write"}}},{"id":"1_1613240621.988926_118.1","section":"bucket.instance","name":"ejuwhf-22:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.31","timestamp":"2021-02-13 18:23:41.988926707Z","data":{"read_version":{"tag":"_hl5-x8kVDYpS5w-oh53bPCW","ver":1},"write_version":{"tag":"_hl5-x8kVDYpS5w-oh53bPCW","ver":2},"status":{"status":"complete"}}},{"id":"1_1613240622.014812_119.1","section":"bucket.instance","name":"ejuwhf-23:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.32","timestamp":"2021-02-13 18:23:42.014812172Z","data":{"read_version":{"tag":"_Zi3cYMrdm4uEttRZYVVoHN6","ver":1},"write_version":{"tag":"_Zi3cYMrdm4uEttRZYVVoHN6","ver":2},"status":{"status":"write"}}},{"id":"1_1613240622.031550_120.1","section":"bucket.instance","name":"ejuwhf-23:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.32","timestamp":"2021-02-13 18:23:42.031550983Z","data":{"read_version":{"tag":"_Zi3cYMrdm4uEttRZYVVoHN6","ver":1},"write_version":{"tag":"_Zi3cYMrdm4uEttRZYVVoHN6","ver":2},"status":{"status":"complete"}}},{"id":"1_1613240942.057496_129.1","section":"bucket.instance","name":"ejuwhf-24:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.33","timestamp":"2021-02-13 18:29:02.057496314Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Mymfhn6ginn73AnD7ml29g5","ver":1},"status":{"status":"write"}}},{"id":"1_1613240942.074249_130.1","section":"bucket.instance","name":"ejuwhf-24:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.33","timestamp":"2021-02-13 18:29:02.074249549Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Mymfhn6ginn73AnD7ml29g5","ver":1},"status":{"status":"complete"}}},{"id":"1_1613240942.080340_131.1","section":"bucket","name":"ejuwhf-24","timestamp":"2021-02-13 18:29:02.080340488Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_LXwSzpg4EyuMmTpiPZjf1cc","ver":1},"status":{"status":"write"}}},{"id":"1_1613240942.096212_132.1","section":"bucket","name":"ejuwhf-24","timestamp":"2021-02-13 18:29:02.096212692Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_LXwSzpg4EyuMmTpiPZjf1cc","ver":1},"status":{"status":"complete"}}},{"id":"1_1613240942.132341_133.1","section":"bucket.instance","name":"ejuwhf-25:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.34","timestamp":"2021-02-13 18:29:02.132341526Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_uMJzQ5xiX1YlCrcj1HBDDd1","ver":1},"status":{"status":"write"}}},{"id":"1_1613240942.147778_134.1","section":"bucket.instance","name":"ejuwhf-25:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.34","timestamp":"2021-02-13 18:29:02.147778756Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_uMJzQ5xiX1YlCrcj1HBDDd1","ver":1},"status":{"status":"complete"}}},{"id":"1_1613240942.153287_135.1","section":"bucket","name":"ejuwhf-25","timestamp":"2021-02-13 18:29:02.153287603Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_A3dK8rBY3svnWMIeKILt9Z_","ver":1},"status":{"status":"write"}}},{"id":"1_1613240942.168281_136.1","section":"bucket","name":"ejuwhf-25","timestamp":"2021-02-13 18:29:02.168281459Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_A3dK8rBY3svnWMIeKILt9Z_","ver":1},"status":{"status":"complete"}}},{"id":"1_1613240942.238318_137.1","section":"bucket.instance","name":"ejuwhf-26:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.35","timestamp":"2021-02-13 18:29:02.238318066Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_L3Z-v3OBQisJH8Y-dXJplsy","ver":1},"status":{"status":"write"}}},{"id":"1_1613240942.254572_138.1","section":"bucket.instance","name":"ejuwhf-26:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.35","timestamp":"2021-02-13 18:29:02.254572785Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_L3Z-v3OBQisJH8Y-dXJplsy","ver":1},"status":{"status":"complete"}}},{"id":"1_1613240942.260239_139.1","section":"bucket","name":"ejuwhf-26","timestamp":"2021-02-13 18:29:02.260239723Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_cPHMuqLQT9Fp0sttVt7JMgo","ver":1},"status":{"status":"write"}}},{"id":"1_1613240942.275753_140.1","section":"bucket","name":"ejuwhf-26","timestamp":"2021-02-13 18:29:02.275753150Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_cPHMuqLQT9Fp0sttVt7JMgo","ver":1},"status":{"status":"complete"}}},{"id":"1_1613240942.328657_141.1","section":"bucket.instance","name":"ejuwhf-24:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.33","timestamp":"2021-02-13 18:29:02.328657731Z","data":{"read_version":{"tag":"_Mymfhn6ginn73AnD7ml29g5","ver":1},"write_version":{"tag":"_Mymfhn6ginn73AnD7ml29g5","ver":2},"status":{"status":"write"}}},{"id":"1_1613240942.344935_142.1","section":"bucket.instance","name":"ejuwhf-24:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.33","timestamp":"2021-02-13 18:29:02.344935201Z","data":{"read_version":{"tag":"_Mymfhn6ginn73AnD7ml29g5","ver":1},"write_version":{"tag":"_Mymfhn6ginn73AnD7ml29g5","ver":2},"status":{"status":"complete"}}},{"id":"1_1613240942.353878_143.1","section":"bucket.instance","name":"ejuwhf-24:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.33","timestamp":"2021-02-13 18:29:02.353878692Z","data":{"read_version":{"tag":"_Mymfhn6ginn73AnD7ml29g5","ver":2},"write_version":{"tag":"_Mymfhn6ginn73AnD7ml29g5","ver":3},"status":{"status":"write"}}},{"id":"1_1613240942.370130_144.1","section":"bucket.instance","name":"ejuwhf-24:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.33","timestamp":"2021-02-13 18:29:02.370130831Z","data":{"read_version":{"tag":"_Mymfhn6ginn73AnD7ml29g5","ver":2},"write_version":{"tag":"_Mymfhn6ginn73AnD7ml29g5","ver":3},"status":{"status":"complete"}}},{"id":"1_1613240942.382481_145.1","section":"bucket.instance","name":"ejuwhf-25:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.34","timestamp":"2021-02-13 18:29:02.382481780Z","data":{"read_version":{"tag":"_uMJzQ5xiX1YlCrcj1HBDDd1","ver":1},"write_version":{"tag":"_uMJzQ5xiX1YlCrcj1HBDDd1","ver":2},"status":{"status":"write"}}},{"id":"1_1613240942.399166_146.1","section":"bucket.instance","name":"ejuwhf-25:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.34","timestamp":"2021-02-13 18:29:02.399166568Z","data":{"read_version":{"tag":"_uMJzQ5xiX1YlCrcj1HBDDd1","ver":1},"write_version":{"tag":"_uMJzQ5xiX1YlCrcj1HBDDd1","ver":2},"status":{"status":"complete"}}},{"id":"1_1613240942.421493_147.1","section":"bucket.instance","name":"ejuwhf-25:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.34","timestamp":"2021-02-13 18:29:02.421493448Z","data":{"read_version":{"tag":"_uMJzQ5xiX1YlCrcj1HBDDd1","ver":2},"write_version":{"tag":"_uMJzQ5xiX1YlCrcj1HBDDd1","ver":3},"status":{"status":"write"}}},{"id":"1_1613240942.437705_148.1","section":"bucket.instance","name":"ejuwhf-25:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.34","timestamp":"2021-02-13 18:29:02.437705406Z","data":{"read_version":{"tag":"_uMJzQ5xiX1YlCrcj1HBDDd1","ver":2},"write_version":{"tag":"_uMJzQ5xiX1YlCrcj1HBDDd1","ver":3},"status":{"status":"complete"}}},{"id":"1_1613240942.459839_149.1","section":"bucket.instance","name":"ejuwhf-26:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.35","timestamp":"2021-02-13 18:29:02.459839291Z","data":{"read_version":{"tag":"_L3Z-v3OBQisJH8Y-dXJplsy","ver":1},"write_version":{"tag":"_L3Z-v3OBQisJH8Y-dXJplsy","ver":2},"status":{"status":"write"}}},{"id":"1_1613240942.476918_150.1","section":"bucket.instance","name":"ejuwhf-26:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.35","timestamp":"2021-02-13 18:29:02.476918779Z","data":{"read_version":{"tag":"_L3Z-v3OBQisJH8Y-dXJplsy","ver":1},"write_version":{"tag":"_L3Z-v3OBQisJH8Y-dXJplsy","ver":2},"status":{"status":"complete"}}},{"id":"1_1613240942.499769_151.1","section":"bucket.instance","name":"ejuwhf-26:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.35","timestamp":"2021-02-13 18:29:02.499769496Z","data":{"read_version":{"tag":"_L3Z-v3OBQisJH8Y-dXJplsy","ver":2},"write_version":{"tag":"_L3Z-v3OBQisJH8Y-dXJplsy","ver":3},"status":{"status":"write"}}},{"id":"1_1613240942.515439_152.1","section":"bucket.instance","name":"ejuwhf-26:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.35","timestamp":"2021-02-13 18:29:02.515439820Z","data":{"read_version":{"tag":"_L3Z-v3OBQisJH8Y-dXJplsy","ver":2},"write_version":{"tag":"_L3Z-v3OBQisJH8Y-dXJplsy","ver":3},"status":{"status":"complete"}}},{"id":"1_1613241266.605637_161.1","section":"bucket.instance","name":"ejuwhf-27:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.36","timestamp":"2021-02-13 18:34:26.605637643Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_buhEDK5wV_BTZ1BfBOjuCtv","ver":1},"status":{"status":"write"}}},{"id":"1_1613241266.622739_162.1","section":"bucket.instance","name":"ejuwhf-27:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.36","timestamp":"2021-02-13 18:34:26.622739396Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_buhEDK5wV_BTZ1BfBOjuCtv","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241266.628411_163.1","section":"bucket","name":"ejuwhf-27","timestamp":"2021-02-13 18:34:26.628411671Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_cv0hC47mr82631TFimW_DVd","ver":1},"status":{"status":"write"}}},{"id":"1_1613241266.644465_164.1","section":"bucket","name":"ejuwhf-27","timestamp":"2021-02-13 18:34:26.644465762Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_cv0hC47mr82631TFimW_DVd","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241266.684520_165.1","section":"bucket.instance","name":"ejuwhf-28:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.37","timestamp":"2021-02-13 18:34:26.684520705Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Xd4FRhFK5zkknydU2nFa9wM","ver":1},"status":{"status":"write"}}},{"id":"1_1613241266.701308_166.1","section":"bucket.instance","name":"ejuwhf-28:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.37","timestamp":"2021-02-13 18:34:26.701308256Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Xd4FRhFK5zkknydU2nFa9wM","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241266.707762_167.1","section":"bucket","name":"ejuwhf-28","timestamp":"2021-02-13 18:34:26.707762712Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_fwmE9vPx54C_GLabnD2pr6O","ver":1},"status":{"status":"write"}}},{"id":"1_1613241266.723793_168.1","section":"bucket","name":"ejuwhf-28","timestamp":"2021-02-13 18:34:26.723793662Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_fwmE9vPx54C_GLabnD2pr6O","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241266.793975_169.1","section":"bucket.instance","name":"ejuwhf-29:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.38","timestamp":"2021-02-13 18:34:26.793975407Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_OYTb8fo0cI6eTvGgrw7zDVl","ver":1},"status":{"status":"write"}}},{"id":"1_1613241266.810889_170.1","section":"bucket.instance","name":"ejuwhf-29:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.38","timestamp":"2021-02-13 18:34:26.810889667Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_OYTb8fo0cI6eTvGgrw7zDVl","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241266.817391_171.1","section":"bucket","name":"ejuwhf-29","timestamp":"2021-02-13 18:34:26.817391051Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_8f7U215eIbZcyAN-0Ty-CHS","ver":1},"status":{"status":"write"}}},{"id":"1_1613241266.833518_172.1","section":"bucket","name":"ejuwhf-29","timestamp":"2021-02-13 18:34:26.833518174Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_8f7U215eIbZcyAN-0Ty-CHS","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241266.890012_173.1","section":"bucket.instance","name":"ejuwhf-27:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.36","timestamp":"2021-02-13 18:34:26.890012595Z","data":{"read_version":{"tag":"_buhEDK5wV_BTZ1BfBOjuCtv","ver":1},"write_version":{"tag":"_buhEDK5wV_BTZ1BfBOjuCtv","ver":2},"status":{"status":"write"}}},{"id":"1_1613241266.906758_174.1","section":"bucket.instance","name":"ejuwhf-27:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.36","timestamp":"2021-02-13 18:34:26.906758267Z","data":{"read_version":{"tag":"_buhEDK5wV_BTZ1BfBOjuCtv","ver":1},"write_version":{"tag":"_buhEDK5wV_BTZ1BfBOjuCtv","ver":2},"status":{"status":"complete"}}},{"id":"1_1613241266.965553_175.1","section":"bucket.instance","name":"ejuwhf-28:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.37","timestamp":"2021-02-13 18:34:26.965553236Z","data":{"read_version":{"tag":"_Xd4FRhFK5zkknydU2nFa9wM","ver":1},"write_version":{"tag":"_Xd4FRhFK5zkknydU2nFa9wM","ver":2},"status":{"status":"write"}}},{"id":"1_1613241266.983302_176.1","section":"bucket.instance","name":"ejuwhf-28:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.37","timestamp":"2021-02-13 18:34:26.983302909Z","data":{"read_version":{"tag":"_Xd4FRhFK5zkknydU2nFa9wM","ver":1},"write_version":{"tag":"_Xd4FRhFK5zkknydU2nFa9wM","ver":2},"status":{"status":"complete"}}},{"id":"1_1613241267.056149_177.1","section":"bucket.instance","name":"ejuwhf-29:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.38","timestamp":"2021-02-13 18:34:27.056149375Z","data":{"read_version":{"tag":"_OYTb8fo0cI6eTvGgrw7zDVl","ver":1},"write_version":{"tag":"_OYTb8fo0cI6eTvGgrw7zDVl","ver":2},"status":{"status":"write"}}},{"id":"1_1613241267.073356_178.1","section":"bucket.instance","name":"ejuwhf-29:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.38","timestamp":"2021-02-13 18:34:27.073356371Z","data":{"read_version":{"tag":"_OYTb8fo0cI6eTvGgrw7zDVl","ver":1},"write_version":{"tag":"_OYTb8fo0cI6eTvGgrw7zDVl","ver":2},"status":{"status":"complete"}}},{"id":"1_1613241267.151605_179.1","section":"bucket.instance","name":"ejuwhf-30:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.39","timestamp":"2021-02-13 18:34:27.151605712Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_xOOIxE04nsc05E_DBE8Tl4c","ver":1},"status":{"status":"write"}}},{"id":"1_1613241267.168752_180.1","section":"bucket.instance","name":"ejuwhf-30:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.39","timestamp":"2021-02-13 18:34:27.168752478Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_xOOIxE04nsc05E_DBE8Tl4c","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241267.174869_181.1","section":"bucket","name":"ejuwhf-30","timestamp":"2021-02-13 18:34:27.174869113Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_fXNqCzc4CG0kd9VOzBG9Q7P","ver":1},"status":{"status":"write"}}},{"id":"1_1613241267.190845_182.1","section":"bucket","name":"ejuwhf-30","timestamp":"2021-02-13 18:34:27.190845919Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_fXNqCzc4CG0kd9VOzBG9Q7P","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241267.225373_183.1","section":"bucket.instance","name":"ejuwhf-31:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.40","timestamp":"2021-02-13 18:34:27.225373782Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_vq-PbUFwVQj7aAfQtnD_3EU","ver":1},"status":{"status":"write"}}},{"id":"1_1613241267.242435_184.1","section":"bucket.instance","name":"ejuwhf-31:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.40","timestamp":"2021-02-13 18:34:27.242435556Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_vq-PbUFwVQj7aAfQtnD_3EU","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241267.248007_185.1","section":"bucket","name":"ejuwhf-31","timestamp":"2021-02-13 18:34:27.248007585Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_KctrzUTN-Z2qNoPxtPlfK8y","ver":1},"status":{"status":"write"}}},{"id":"1_1613241267.263145_186.1","section":"bucket","name":"ejuwhf-31","timestamp":"2021-02-13 18:34:27.263145093Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_KctrzUTN-Z2qNoPxtPlfK8y","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241267.328171_187.1","section":"bucket.instance","name":"ejuwhf-32:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.41","timestamp":"2021-02-13 18:34:27.328171763Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_pMTJ0sdLLeifyII2MXvLxTT","ver":1},"status":{"status":"write"}}},{"id":"1_1613241267.345082_188.1","section":"bucket.instance","name":"ejuwhf-32:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.41","timestamp":"2021-02-13 18:34:27.345082724Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_pMTJ0sdLLeifyII2MXvLxTT","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241267.350511_189.1","section":"bucket","name":"ejuwhf-32","timestamp":"2021-02-13 18:34:27.350511022Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ZBwWS6lgLvXfPlIIuMt3AtT","ver":1},"status":{"status":"write"}}},{"id":"1_1613241267.365375_190.1","section":"bucket","name":"ejuwhf-32","timestamp":"2021-02-13 18:34:27.365375654Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ZBwWS6lgLvXfPlIIuMt3AtT","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241267.427546_191.1","section":"bucket.instance","name":"ejuwhf-30:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.39","timestamp":"2021-02-13 18:34:27.427546507Z","data":{"read_version":{"tag":"_xOOIxE04nsc05E_DBE8Tl4c","ver":1},"write_version":{"tag":"_xOOIxE04nsc05E_DBE8Tl4c","ver":2},"status":{"status":"write"}}},{"id":"1_1613241267.443747_192.1","section":"bucket.instance","name":"ejuwhf-30:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.39","timestamp":"2021-02-13 18:34:27.443747325Z","data":{"read_version":{"tag":"_xOOIxE04nsc05E_DBE8Tl4c","ver":1},"write_version":{"tag":"_xOOIxE04nsc05E_DBE8Tl4c","ver":2},"status":{"status":"complete"}}},{"id":"1_1613241267.515491_193.1","section":"bucket.instance","name":"ejuwhf-31:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.40","timestamp":"2021-02-13 18:34:27.515491775Z","data":{"read_version":{"tag":"_vq-PbUFwVQj7aAfQtnD_3EU","ver":1},"write_version":{"tag":"_vq-PbUFwVQj7aAfQtnD_3EU","ver":2},"status":{"status":"write"}}},{"id":"1_1613241267.532248_194.1","section":"bucket.instance","name":"ejuwhf-31:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.40","timestamp":"2021-02-13 18:34:27.532248179Z","data":{"read_version":{"tag":"_vq-PbUFwVQj7aAfQtnD_3EU","ver":1},"write_version":{"tag":"_vq-PbUFwVQj7aAfQtnD_3EU","ver":2},"status":{"status":"complete"}}},{"id":"1_1613241267.614493_195.1","section":"bucket.instance","name":"ejuwhf-32:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.41","timestamp":"2021-02-13 18:34:27.614493922Z","data":{"read_version":{"tag":"_pMTJ0sdLLeifyII2MXvLxTT","ver":1},"write_version":{"tag":"_pMTJ0sdLLeifyII2MXvLxTT","ver":2},"status":{"status":"write"}}},{"id":"1_1613241267.631169_196.1","section":"bucket.instance","name":"ejuwhf-32:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.41","timestamp":"2021-02-13 18:34:27.631169929Z","data":{"read_version":{"tag":"_pMTJ0sdLLeifyII2MXvLxTT","ver":1},"write_version":{"tag":"_pMTJ0sdLLeifyII2MXvLxTT","ver":2},"status":{"status":"complete"}}},{"id":"1_1613241267.703455_197.1","section":"bucket.instance","name":"ejuwhf-33:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.42","timestamp":"2021-02-13 18:34:27.703455821Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_H8xnpAZEzqUOed9D6o8b0E0","ver":1},"status":{"status":"write"}}},{"id":"1_1613241267.709061_198.1","section":"bucket.instance","name":"ejuwhf-33:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.42","timestamp":"2021-02-13 18:34:27.709061094Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_H8xnpAZEzqUOed9D6o8b0E0","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241267.710918_199.1","section":"bucket","name":"ejuwhf-33","timestamp":"2021-02-13 18:34:27.710918130Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_5d9OIM7k69p0P0uAysQiRdG","ver":1},"status":{"status":"write"}}},{"id":"1_1613241267.716192_200.1","section":"bucket","name":"ejuwhf-33","timestamp":"2021-02-13 18:34:27.716192524Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_5d9OIM7k69p0P0uAysQiRdG","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241267.728031_201.1","section":"bucket.instance","name":"ejuwhf-34:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.43","timestamp":"2021-02-13 18:34:27.728031465Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_CRJvAYGaC5ssXc3dJv7KEk4","ver":1},"status":{"status":"write"}}},{"id":"1_1613241267.733121_202.1","section":"bucket.instance","name":"ejuwhf-34:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.43","timestamp":"2021-02-13 18:34:27.733121606Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_CRJvAYGaC5ssXc3dJv7KEk4","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241267.735002_203.1","section":"bucket","name":"ejuwhf-34","timestamp":"2021-02-13 18:34:27.735002139Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ro68eUWJTFM6zc_B6pTLzxQ","ver":1},"status":{"status":"write"}}},{"id":"1_1613241267.739821_204.1","section":"bucket","name":"ejuwhf-34","timestamp":"2021-02-13 18:34:27.739821981Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ro68eUWJTFM6zc_B6pTLzxQ","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241267.788853_205.1","section":"bucket.instance","name":"ejuwhf-35:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.44","timestamp":"2021-02-13 18:34:27.788853889Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_W0CjPxEhZ84WmkTK-IJS63R","ver":1},"status":{"status":"write"}}},{"id":"1_1613241267.805812_206.1","section":"bucket.instance","name":"ejuwhf-35:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.44","timestamp":"2021-02-13 18:34:27.805812011Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_W0CjPxEhZ84WmkTK-IJS63R","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241267.812537_207.1","section":"bucket","name":"ejuwhf-35","timestamp":"2021-02-13 18:34:27.812537791Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_3BdK8ESSfyzlLsuvW_K1IJj","ver":1},"status":{"status":"write"}}},{"id":"1_1613241267.829128_208.1","section":"bucket","name":"ejuwhf-35","timestamp":"2021-02-13 18:34:27.829128246Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_3BdK8ESSfyzlLsuvW_K1IJj","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241267.880158_209.1","section":"bucket.instance","name":"ejuwhf-33:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.42","timestamp":"2021-02-13 18:34:27.880158053Z","data":{"read_version":{"tag":"_H8xnpAZEzqUOed9D6o8b0E0","ver":1},"write_version":{"tag":"_H8xnpAZEzqUOed9D6o8b0E0","ver":2},"status":{"status":"write"}}},{"id":"1_1613241267.897939_210.1","section":"bucket.instance","name":"ejuwhf-33:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.42","timestamp":"2021-02-13 18:34:27.897939577Z","data":{"read_version":{"tag":"_H8xnpAZEzqUOed9D6o8b0E0","ver":1},"write_version":{"tag":"_H8xnpAZEzqUOed9D6o8b0E0","ver":2},"status":{"status":"complete"}}},{"id":"1_1613241268.960288_211.1","section":"bucket.instance","name":"ejuwhf-34:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.43","timestamp":"2021-02-13 18:34:28.960288660Z","data":{"read_version":{"tag":"_CRJvAYGaC5ssXc3dJv7KEk4","ver":1},"write_version":{"tag":"_CRJvAYGaC5ssXc3dJv7KEk4","ver":2},"status":{"status":"write"}}},{"id":"1_1613241268.978013_212.1","section":"bucket.instance","name":"ejuwhf-34:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.43","timestamp":"2021-02-13 18:34:28.978013262Z","data":{"read_version":{"tag":"_CRJvAYGaC5ssXc3dJv7KEk4","ver":1},"write_version":{"tag":"_CRJvAYGaC5ssXc3dJv7KEk4","ver":2},"status":{"status":"complete"}}},{"id":"1_1613241270.429647_213.1","section":"bucket.instance","name":"ejuwhf-35:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.44","timestamp":"2021-02-13 18:34:30.429647701Z","data":{"read_version":{"tag":"_W0CjPxEhZ84WmkTK-IJS63R","ver":1},"write_version":{"tag":"_W0CjPxEhZ84WmkTK-IJS63R","ver":2},"status":{"status":"write"}}},{"id":"1_1613241270.446438_214.1","section":"bucket.instance","name":"ejuwhf-35:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.44","timestamp":"2021-02-13 18:34:30.446438646Z","data":{"read_version":{"tag":"_W0CjPxEhZ84WmkTK-IJS63R","ver":1},"write_version":{"tag":"_W0CjPxEhZ84WmkTK-IJS63R","ver":2},"status":{"status":"complete"}}},{"id":"1_1613241270.850432_215.1","section":"bucket.instance","name":"ejuwhf-36:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.45","timestamp":"2021-02-13 18:34:30.850432491Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_9UmWS9ftBX75KSmck3AaoP3","ver":1},"status":{"status":"write"}}},{"id":"1_1613241270.866532_216.1","section":"bucket.instance","name":"ejuwhf-36:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.45","timestamp":"2021-02-13 18:34:30.866532637Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_9UmWS9ftBX75KSmck3AaoP3","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241270.872542_217.1","section":"bucket","name":"ejuwhf-36","timestamp":"2021-02-13 18:34:30.872542707Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_73boIkO_FojWkXyFQw7oy7A","ver":1},"status":{"status":"write"}}},{"id":"1_1613241270.888203_218.1","section":"bucket","name":"ejuwhf-36","timestamp":"2021-02-13 18:34:30.888203891Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_73boIkO_FojWkXyFQw7oy7A","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241271.585572_219.1","section":"bucket.instance","name":"ejuwhf-37:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.46","timestamp":"2021-02-13 18:34:31.585572280Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_mDbnQaV5gAjZL8anNAScPB9","ver":1},"status":{"status":"write"}}},{"id":"1_1613241271.603089_220.1","section":"bucket.instance","name":"ejuwhf-37:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.46","timestamp":"2021-02-13 18:34:31.603089265Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_mDbnQaV5gAjZL8anNAScPB9","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241271.608951_221.1","section":"bucket","name":"ejuwhf-37","timestamp":"2021-02-13 18:34:31.608951157Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_s74zFZJJ4NFsgBcob2jXayP","ver":1},"status":{"status":"write"}}},{"id":"1_1613241271.624585_222.1","section":"bucket","name":"ejuwhf-37","timestamp":"2021-02-13 18:34:31.624585936Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_s74zFZJJ4NFsgBcob2jXayP","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241272.105214_223.1","section":"bucket.instance","name":"ejuwhf-38:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.47","timestamp":"2021-02-13 18:34:32.105214877Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_hOR-x810TeuF27wCR96Wty1","ver":1},"status":{"status":"write"}}},{"id":"1_1613241272.122415_224.1","section":"bucket.instance","name":"ejuwhf-38:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.47","timestamp":"2021-02-13 18:34:32.122415123Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_hOR-x810TeuF27wCR96Wty1","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241272.128464_225.1","section":"bucket","name":"ejuwhf-38","timestamp":"2021-02-13 18:34:32.128464434Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_3IUloz0JebNxZ4oJtAH1uGt","ver":1},"status":{"status":"write"}}},{"id":"1_1613241272.144691_226.1","section":"bucket","name":"ejuwhf-38","timestamp":"2021-02-13 18:34:32.144691215Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_3IUloz0JebNxZ4oJtAH1uGt","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241280.698617_230.1","section":"bucket.instance","name":"ejuwhf-39:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.48","timestamp":"2021-02-13 18:34:40.698617098Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_eYhw6M1Kq9Fsl1gXEYBZ6tb","ver":1},"status":{"status":"write"}}},{"id":"1_1613241280.714973_231.1","section":"bucket.instance","name":"ejuwhf-39:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.48","timestamp":"2021-02-13 18:34:40.714973292Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_eYhw6M1Kq9Fsl1gXEYBZ6tb","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241280.720530_232.1","section":"bucket","name":"ejuwhf-39","timestamp":"2021-02-13 18:34:40.720530128Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_3SHNqKcm35n77170DwwQ5uP","ver":1},"status":{"status":"write"}}},{"id":"1_1613241280.736452_233.1","section":"bucket","name":"ejuwhf-39","timestamp":"2021-02-13 18:34:40.736452448Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_3SHNqKcm35n77170DwwQ5uP","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241281.607686_235.1","section":"bucket.instance","name":"ejuwhf-40:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.49","timestamp":"2021-02-13 18:34:41.607686289Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ET7-100GAjHcWvb6dmSd471","ver":1},"status":{"status":"write"}}},{"id":"1_1613241281.623808_236.1","section":"bucket.instance","name":"ejuwhf-40:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.49","timestamp":"2021-02-13 18:34:41.623808900Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ET7-100GAjHcWvb6dmSd471","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241281.629531_237.1","section":"bucket","name":"ejuwhf-40","timestamp":"2021-02-13 18:34:41.629531463Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_YLtkbjHvhAUvE3rtVFYlkKS","ver":1},"status":{"status":"write"}}},{"id":"1_1613241281.645755_238.1","section":"bucket","name":"ejuwhf-40","timestamp":"2021-02-13 18:34:41.645755376Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_YLtkbjHvhAUvE3rtVFYlkKS","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241281.785892_239.1","section":"bucket.instance","name":"ejuwhf-41:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.50","timestamp":"2021-02-13 18:34:41.785892843Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_A4tdGeJPy82CSxfrGu7y2YU","ver":1},"status":{"status":"write"}}},{"id":"1_1613241281.802707_240.1","section":"bucket.instance","name":"ejuwhf-41:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.50","timestamp":"2021-02-13 18:34:41.802707356Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_A4tdGeJPy82CSxfrGu7y2YU","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241281.808203_241.1","section":"bucket","name":"ejuwhf-41","timestamp":"2021-02-13 18:34:41.808203156Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_-Tx8KzgTMRgfsqe1Lj-5EOH","ver":1},"status":{"status":"write"}}},{"id":"1_1613241281.822512_242.1","section":"bucket","name":"ejuwhf-41","timestamp":"2021-02-13 18:34:41.822512374Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_-Tx8KzgTMRgfsqe1Lj-5EOH","ver":1},"status":{"status":"complete"}}}] 2021-02-13T18:37:02.899 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['mdlog', 'list', '--period', '138dc4ba-dc02-4957-87c3-e8bf2d80917c', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:37:02.899 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'mdlog', 'list', '--period', '138dc4ba-dc02-4957-87c3-e8bf2d80917c', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:37:02.899 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 mdlog list --period 138dc4ba-dc02-4957-87c3-e8bf2d80917c --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:37:03.032 INFO:teuthology.orchestra.run.gibba036.stdout:[{"id":"1_1613238836.390537_30.1","section":"user","name":"rgw-multisite-test-user","timestamp":"2021-02-13 17:53:56.390537712Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_pP6iIiaEGrFvLGsZM7x-OH9","ver":1},"status":{"status":"write"}}},{"id":"1_1613238836.394578_31.1","section":"user","name":"rgw-multisite-test-user","timestamp":"2021-02-13 17:53:56.394578235Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_pP6iIiaEGrFvLGsZM7x-OH9","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238955.574548_34.1","section":"bucket.instance","name":"ejuwhf-1:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.1","timestamp":"2021-02-13 17:55:55.574548718Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_x9-l_GSKepPMI4ZXnkA47yy","ver":1},"status":{"status":"write"}}},{"id":"1_1613238955.577573_35.1","section":"bucket.instance","name":"ejuwhf-1:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.1","timestamp":"2021-02-13 17:55:55.577573029Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_x9-l_GSKepPMI4ZXnkA47yy","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238955.578734_36.1","section":"bucket","name":"ejuwhf-1","timestamp":"2021-02-13 17:55:55.578734260Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_J8joTt2UmmIiOX87U166pOB","ver":1},"status":{"status":"write"}}},{"id":"1_1613238955.582128_37.1","section":"bucket","name":"ejuwhf-1","timestamp":"2021-02-13 17:55:55.582128841Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_J8joTt2UmmIiOX87U166pOB","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238955.598221_38.1","section":"bucket.instance","name":"ejuwhf-2:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.2","timestamp":"2021-02-13 17:55:55.598221635Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_XxLX1rySo-vI8MVX_6lsszw","ver":1},"status":{"status":"write"}}},{"id":"1_1613238955.601565_39.1","section":"bucket.instance","name":"ejuwhf-2:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.2","timestamp":"2021-02-13 17:55:55.601565432Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_XxLX1rySo-vI8MVX_6lsszw","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238955.602725_40.1","section":"bucket","name":"ejuwhf-2","timestamp":"2021-02-13 17:55:55.602725072Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_-17U9gIvg7jYouuMTrIVOEd","ver":1},"status":{"status":"write"}}},{"id":"1_1613238955.606187_41.1","section":"bucket","name":"ejuwhf-2","timestamp":"2021-02-13 17:55:55.606187695Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_-17U9gIvg7jYouuMTrIVOEd","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238956.751602_42.1","section":"bucket.instance","name":"ejuwhf-3:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.3","timestamp":"2021-02-13 17:55:56.751602944Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_lNPGQ7Vy4iyapNXVdS3aLPf","ver":1},"status":{"status":"write"}}},{"id":"1_1613238956.768275_43.1","section":"bucket.instance","name":"ejuwhf-3:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.3","timestamp":"2021-02-13 17:55:56.768275574Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_lNPGQ7Vy4iyapNXVdS3aLPf","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238956.775120_44.1","section":"bucket","name":"ejuwhf-3","timestamp":"2021-02-13 17:55:56.775120953Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_GCZqbJ9H_lfQq60lQ2CTjOd","ver":1},"status":{"status":"write"}}},{"id":"1_1613238956.791138_45.1","section":"bucket","name":"ejuwhf-3","timestamp":"2021-02-13 17:55:56.791138180Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_GCZqbJ9H_lfQq60lQ2CTjOd","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238960.597491_46.1","section":"bucket.instance","name":"ejuwhf-4:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.4","timestamp":"2021-02-13 17:56:00.597491162Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_0QbpwLYGTsIvm_YOZIhcyWS","ver":1},"status":{"status":"write"}}},{"id":"1_1613238960.614238_47.1","section":"bucket.instance","name":"ejuwhf-4:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.4","timestamp":"2021-02-13 17:56:00.614238433Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_0QbpwLYGTsIvm_YOZIhcyWS","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238960.620257_48.1","section":"bucket","name":"ejuwhf-4","timestamp":"2021-02-13 17:56:00.620257808Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_QDWd5t9vsHeGWEiagLoZ4l6","ver":1},"status":{"status":"write"}}},{"id":"1_1613238960.636707_49.1","section":"bucket","name":"ejuwhf-4","timestamp":"2021-02-13 17:56:00.636707536Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_QDWd5t9vsHeGWEiagLoZ4l6","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238960.666464_50.1","section":"bucket.instance","name":"ejuwhf-5:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.5","timestamp":"2021-02-13 17:56:00.666464684Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_HA_YqoBH5yRaCOOmwLHMDu_","ver":1},"status":{"status":"write"}}},{"id":"1_1613238960.682695_51.1","section":"bucket.instance","name":"ejuwhf-5:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.5","timestamp":"2021-02-13 17:56:00.682695337Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_HA_YqoBH5yRaCOOmwLHMDu_","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238960.688294_52.1","section":"bucket","name":"ejuwhf-5","timestamp":"2021-02-13 17:56:00.688294896Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_S2lucmmbUZ62_X47K1y6mSF","ver":1},"status":{"status":"write"}}},{"id":"1_1613238960.704528_53.1","section":"bucket","name":"ejuwhf-5","timestamp":"2021-02-13 17:56:00.704528473Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_S2lucmmbUZ62_X47K1y6mSF","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238960.766449_54.1","section":"bucket.instance","name":"ejuwhf-6:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.6","timestamp":"2021-02-13 17:56:00.766449862Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_4itjl067RN6aZgRRW5-Ukgb","ver":1},"status":{"status":"write"}}},{"id":"1_1613238960.782254_55.1","section":"bucket.instance","name":"ejuwhf-6:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.6","timestamp":"2021-02-13 17:56:00.782254386Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_4itjl067RN6aZgRRW5-Ukgb","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238960.787967_56.1","section":"bucket","name":"ejuwhf-6","timestamp":"2021-02-13 17:56:00.787967808Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"__e1Dsav3WgX_R99k1Kz1phg","ver":1},"status":{"status":"write"}}},{"id":"1_1613238960.804035_57.1","section":"bucket","name":"ejuwhf-6","timestamp":"2021-02-13 17:56:00.804035948Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"__e1Dsav3WgX_R99k1Kz1phg","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238968.578083_58.1","section":"bucket.instance","name":"ejuwhf-4:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.7","timestamp":"2021-02-13 17:56:08.578083676Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_rdxJZW8AbbLkx3Jo3qeZSTL","ver":1},"status":{"status":"write"}}},{"id":"1_1613238968.593717_59.1","section":"bucket.instance","name":"ejuwhf-4:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.7","timestamp":"2021-02-13 17:56:08.593717090Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_rdxJZW8AbbLkx3Jo3qeZSTL","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238968.600220_60.1","section":"bucket","name":"ejuwhf-4","timestamp":"2021-02-13 17:56:08.600220552Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_iCiP82FAKM6s-vHtX5gBzSR","ver":1},"status":{"status":"write"}}},{"id":"1_1613238968.610741_61.1","section":"bucket","name":"ejuwhf-4","timestamp":"2021-02-13 17:56:08.610741110Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_iCiP82FAKM6s-vHtX5gBzSR","ver":1},"status":{"status":"abort"}}},{"id":"1_1613238968.620505_62.1","section":"bucket.instance","name":"ejuwhf-4:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.7","timestamp":"2021-02-13 17:56:08.620505159Z","data":{"read_version":{"tag":"_rdxJZW8AbbLkx3Jo3qeZSTL","ver":1},"write_version":{"tag":"_rdxJZW8AbbLkx3Jo3qeZSTL","ver":2},"status":{"status":"remove"}}},{"id":"1_1613238968.636055_63.1","section":"bucket.instance","name":"ejuwhf-4:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.7","timestamp":"2021-02-13 17:56:08.636055803Z","data":{"read_version":{"tag":"_rdxJZW8AbbLkx3Jo3qeZSTL","ver":1},"write_version":{"tag":"_rdxJZW8AbbLkx3Jo3qeZSTL","ver":2},"status":{"status":"complete"}}},{"id":"1_1613238968.664189_64.1","section":"bucket.instance","name":"ejuwhf-5:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.8","timestamp":"2021-02-13 17:56:08.664189415Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_FcGNUs98T9meCX_-NJVwm_9","ver":1},"status":{"status":"write"}}},{"id":"1_1613238968.679282_65.1","section":"bucket.instance","name":"ejuwhf-5:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.8","timestamp":"2021-02-13 17:56:08.679282375Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_FcGNUs98T9meCX_-NJVwm_9","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238968.685310_66.1","section":"bucket","name":"ejuwhf-5","timestamp":"2021-02-13 17:56:08.685310012Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_waFuBRwm_oVRbc3bCTEK-2Q","ver":1},"status":{"status":"write"}}},{"id":"1_1613238968.695627_67.1","section":"bucket","name":"ejuwhf-5","timestamp":"2021-02-13 17:56:08.695627687Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_waFuBRwm_oVRbc3bCTEK-2Q","ver":1},"status":{"status":"abort"}}},{"id":"1_1613238968.705293_68.1","section":"bucket.instance","name":"ejuwhf-5:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.8","timestamp":"2021-02-13 17:56:08.705293699Z","data":{"read_version":{"tag":"_FcGNUs98T9meCX_-NJVwm_9","ver":1},"write_version":{"tag":"_FcGNUs98T9meCX_-NJVwm_9","ver":2},"status":{"status":"remove"}}},{"id":"1_1613238968.720069_69.1","section":"bucket.instance","name":"ejuwhf-5:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.8","timestamp":"2021-02-13 17:56:08.720069507Z","data":{"read_version":{"tag":"_FcGNUs98T9meCX_-NJVwm_9","ver":1},"write_version":{"tag":"_FcGNUs98T9meCX_-NJVwm_9","ver":2},"status":{"status":"complete"}}},{"id":"1_1613238968.747131_70.1","section":"bucket.instance","name":"ejuwhf-6:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.9","timestamp":"2021-02-13 17:56:08.747131498Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_KgNkkrSI2S7R0wW_SmAxVxt","ver":1},"status":{"status":"write"}}},{"id":"1_1613238968.763036_71.1","section":"bucket.instance","name":"ejuwhf-6:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.9","timestamp":"2021-02-13 17:56:08.763036003Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_KgNkkrSI2S7R0wW_SmAxVxt","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238968.769054_72.1","section":"bucket","name":"ejuwhf-6","timestamp":"2021-02-13 17:56:08.769054237Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_mBw7Ckz7EfNkJ26ASXtA1Qx","ver":1},"status":{"status":"write"}}},{"id":"1_1613238968.780056_73.1","section":"bucket","name":"ejuwhf-6","timestamp":"2021-02-13 17:56:08.780056555Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_mBw7Ckz7EfNkJ26ASXtA1Qx","ver":1},"status":{"status":"abort"}}},{"id":"1_1613238968.790518_74.1","section":"bucket.instance","name":"ejuwhf-6:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.9","timestamp":"2021-02-13 17:56:08.790518321Z","data":{"read_version":{"tag":"_KgNkkrSI2S7R0wW_SmAxVxt","ver":1},"write_version":{"tag":"_KgNkkrSI2S7R0wW_SmAxVxt","ver":2},"status":{"status":"remove"}}},{"id":"1_1613238968.805425_75.1","section":"bucket.instance","name":"ejuwhf-6:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.9","timestamp":"2021-02-13 17:56:08.805425116Z","data":{"read_version":{"tag":"_KgNkkrSI2S7R0wW_SmAxVxt","ver":1},"write_version":{"tag":"_KgNkkrSI2S7R0wW_SmAxVxt","ver":2},"status":{"status":"complete"}}},{"id":"1_1613238968.876119_76.1","section":"bucket.instance","name":"ejuwhf-4:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.10","timestamp":"2021-02-13 17:56:08.876119966Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_C13ny0FEaZhMoqR1eHNrzzo","ver":1},"status":{"status":"write"}}},{"id":"1_1613238968.892593_77.1","section":"bucket.instance","name":"ejuwhf-4:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.10","timestamp":"2021-02-13 17:56:08.892593644Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_C13ny0FEaZhMoqR1eHNrzzo","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238968.898155_78.1","section":"bucket","name":"ejuwhf-4","timestamp":"2021-02-13 17:56:08.898155724Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_S4geTzMH6fpArDdiMUd2Hj6","ver":1},"status":{"status":"write"}}},{"id":"1_1613238968.909527_79.1","section":"bucket","name":"ejuwhf-4","timestamp":"2021-02-13 17:56:08.909527088Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_S4geTzMH6fpArDdiMUd2Hj6","ver":1},"status":{"status":"abort"}}},{"id":"1_1613238968.919849_80.1","section":"bucket.instance","name":"ejuwhf-4:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.10","timestamp":"2021-02-13 17:56:08.919849797Z","data":{"read_version":{"tag":"_C13ny0FEaZhMoqR1eHNrzzo","ver":1},"write_version":{"tag":"_C13ny0FEaZhMoqR1eHNrzzo","ver":2},"status":{"status":"remove"}}},{"id":"1_1613238968.934852_81.1","section":"bucket.instance","name":"ejuwhf-4:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.10","timestamp":"2021-02-13 17:56:08.934852594Z","data":{"read_version":{"tag":"_C13ny0FEaZhMoqR1eHNrzzo","ver":1},"write_version":{"tag":"_C13ny0FEaZhMoqR1eHNrzzo","ver":2},"status":{"status":"complete"}}},{"id":"1_1613238968.997546_82.1","section":"bucket.instance","name":"ejuwhf-5:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.11","timestamp":"2021-02-13 17:56:08.997546443Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_0hI8LEwJXCt77LG_Y8caPyb","ver":1},"status":{"status":"write"}}},{"id":"1_1613238969.013809_83.1","section":"bucket.instance","name":"ejuwhf-5:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.11","timestamp":"2021-02-13 17:56:09.013809353Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_0hI8LEwJXCt77LG_Y8caPyb","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238969.019756_84.1","section":"bucket","name":"ejuwhf-5","timestamp":"2021-02-13 17:56:09.019756087Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_BES52o3jnI5HPCcsJxAGAPJ","ver":1},"status":{"status":"write"}}},{"id":"1_1613238969.031040_85.1","section":"bucket","name":"ejuwhf-5","timestamp":"2021-02-13 17:56:09.031040364Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_BES52o3jnI5HPCcsJxAGAPJ","ver":1},"status":{"status":"abort"}}},{"id":"1_1613238969.041765_86.1","section":"bucket.instance","name":"ejuwhf-5:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.11","timestamp":"2021-02-13 17:56:09.041765351Z","data":{"read_version":{"tag":"_0hI8LEwJXCt77LG_Y8caPyb","ver":1},"write_version":{"tag":"_0hI8LEwJXCt77LG_Y8caPyb","ver":2},"status":{"status":"remove"}}},{"id":"1_1613238969.056811_87.1","section":"bucket.instance","name":"ejuwhf-5:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.11","timestamp":"2021-02-13 17:56:09.056811080Z","data":{"read_version":{"tag":"_0hI8LEwJXCt77LG_Y8caPyb","ver":1},"write_version":{"tag":"_0hI8LEwJXCt77LG_Y8caPyb","ver":2},"status":{"status":"complete"}}},{"id":"1_1613238969.156956_88.1","section":"bucket.instance","name":"ejuwhf-6:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.12","timestamp":"2021-02-13 17:56:09.156956168Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_zCjiECQrQYftP3tksmjEkCi","ver":1},"status":{"status":"write"}}},{"id":"1_1613238969.172609_89.1","section":"bucket.instance","name":"ejuwhf-6:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.12","timestamp":"2021-02-13 17:56:09.172609871Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_zCjiECQrQYftP3tksmjEkCi","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238969.178077_90.1","section":"bucket","name":"ejuwhf-6","timestamp":"2021-02-13 17:56:09.178077356Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_oL1JaCHeOTBFodmq4Vo462S","ver":1},"status":{"status":"write"}}},{"id":"1_1613238969.189167_91.1","section":"bucket","name":"ejuwhf-6","timestamp":"2021-02-13 17:56:09.189167254Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_oL1JaCHeOTBFodmq4Vo462S","ver":1},"status":{"status":"abort"}}},{"id":"1_1613238969.199338_92.1","section":"bucket.instance","name":"ejuwhf-6:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.12","timestamp":"2021-02-13 17:56:09.199338685Z","data":{"read_version":{"tag":"_zCjiECQrQYftP3tksmjEkCi","ver":1},"write_version":{"tag":"_zCjiECQrQYftP3tksmjEkCi","ver":2},"status":{"status":"remove"}}},{"id":"1_1613238969.214181_93.1","section":"bucket.instance","name":"ejuwhf-6:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.12","timestamp":"2021-02-13 17:56:09.214181526Z","data":{"read_version":{"tag":"_zCjiECQrQYftP3tksmjEkCi","ver":1},"write_version":{"tag":"_zCjiECQrQYftP3tksmjEkCi","ver":2},"status":{"status":"complete"}}},{"id":"1_1613238970.008086_94.1","section":"bucket.instance","name":"ejuwhf-4:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.13","timestamp":"2021-02-13 17:56:10.008086848Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_v1tc2RjtPRbgReNqKENKBra","ver":1},"status":{"status":"write"}}},{"id":"1_1613238970.012670_95.1","section":"bucket.instance","name":"ejuwhf-4:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.13","timestamp":"2021-02-13 17:56:10.012670714Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_v1tc2RjtPRbgReNqKENKBra","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238970.014042_96.1","section":"bucket","name":"ejuwhf-4","timestamp":"2021-02-13 17:56:10.014042198Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_jKuSp21Zxke6SyefbVS70eh","ver":1},"status":{"status":"write"}}},{"id":"1_1613238970.016320_97.1","section":"bucket","name":"ejuwhf-4","timestamp":"2021-02-13 17:56:10.016320019Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_jKuSp21Zxke6SyefbVS70eh","ver":1},"status":{"status":"abort"}}},{"id":"1_1613238970.018539_98.1","section":"bucket.instance","name":"ejuwhf-4:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.13","timestamp":"2021-02-13 17:56:10.018539949Z","data":{"read_version":{"tag":"_v1tc2RjtPRbgReNqKENKBra","ver":1},"write_version":{"tag":"_v1tc2RjtPRbgReNqKENKBra","ver":2},"status":{"status":"remove"}}},{"id":"1_1613238970.022074_99.1","section":"bucket.instance","name":"ejuwhf-4:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.13","timestamp":"2021-02-13 17:56:10.022074729Z","data":{"read_version":{"tag":"_v1tc2RjtPRbgReNqKENKBra","ver":1},"write_version":{"tag":"_v1tc2RjtPRbgReNqKENKBra","ver":2},"status":{"status":"complete"}}},{"id":"1_1613238970.038564_100.1","section":"bucket.instance","name":"ejuwhf-5:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.14","timestamp":"2021-02-13 17:56:10.038564464Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Xxy0kA0Wvug2PQ7muelD8wi","ver":1},"status":{"status":"write"}}},{"id":"1_1613238970.043284_101.1","section":"bucket.instance","name":"ejuwhf-5:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.14","timestamp":"2021-02-13 17:56:10.043284541Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Xxy0kA0Wvug2PQ7muelD8wi","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238970.045447_102.1","section":"bucket","name":"ejuwhf-5","timestamp":"2021-02-13 17:56:10.045447439Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_4o9pGwW2NxyPbqj-tJaLONx","ver":1},"status":{"status":"write"}}},{"id":"1_1613238970.049722_103.1","section":"bucket","name":"ejuwhf-5","timestamp":"2021-02-13 17:56:10.049722714Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_4o9pGwW2NxyPbqj-tJaLONx","ver":1},"status":{"status":"abort"}}},{"id":"1_1613238970.053833_104.1","section":"bucket.instance","name":"ejuwhf-5:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.14","timestamp":"2021-02-13 17:56:10.053833249Z","data":{"read_version":{"tag":"_Xxy0kA0Wvug2PQ7muelD8wi","ver":1},"write_version":{"tag":"_Xxy0kA0Wvug2PQ7muelD8wi","ver":2},"status":{"status":"remove"}}},{"id":"1_1613238970.060705_105.1","section":"bucket.instance","name":"ejuwhf-5:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.14","timestamp":"2021-02-13 17:56:10.060705344Z","data":{"read_version":{"tag":"_Xxy0kA0Wvug2PQ7muelD8wi","ver":1},"write_version":{"tag":"_Xxy0kA0Wvug2PQ7muelD8wi","ver":2},"status":{"status":"complete"}}},{"id":"1_1613238970.135374_106.1","section":"bucket.instance","name":"ejuwhf-6:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.15","timestamp":"2021-02-13 17:56:10.135374943Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_eq-mn_enn9JS0uzsAd-kc3u","ver":1},"status":{"status":"write"}}},{"id":"1_1613238970.138703_107.1","section":"bucket.instance","name":"ejuwhf-6:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.15","timestamp":"2021-02-13 17:56:10.138703651Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_eq-mn_enn9JS0uzsAd-kc3u","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238970.140040_108.1","section":"bucket","name":"ejuwhf-6","timestamp":"2021-02-13 17:56:10.140040095Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_wcze0QNXW6OpN55syVKmWYX","ver":1},"status":{"status":"write"}}},{"id":"1_1613238970.143082_109.1","section":"bucket","name":"ejuwhf-6","timestamp":"2021-02-13 17:56:10.143082486Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_wcze0QNXW6OpN55syVKmWYX","ver":1},"status":{"status":"abort"}}},{"id":"1_1613238970.145487_110.1","section":"bucket.instance","name":"ejuwhf-6:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.15","timestamp":"2021-02-13 17:56:10.145487685Z","data":{"read_version":{"tag":"_eq-mn_enn9JS0uzsAd-kc3u","ver":1},"write_version":{"tag":"_eq-mn_enn9JS0uzsAd-kc3u","ver":2},"status":{"status":"remove"}}},{"id":"1_1613238970.149013_111.1","section":"bucket.instance","name":"ejuwhf-6:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.15","timestamp":"2021-02-13 17:56:10.149013694Z","data":{"read_version":{"tag":"_eq-mn_enn9JS0uzsAd-kc3u","ver":1},"write_version":{"tag":"_eq-mn_enn9JS0uzsAd-kc3u","ver":2},"status":{"status":"complete"}}},{"id":"1_1613238983.138841_112.1","section":"bucket.instance","name":"ejuwhf-7:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.16","timestamp":"2021-02-13 17:56:23.138841633Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_6gToYEDMo15odl3q3-L3Vdk","ver":1},"status":{"status":"write"}}},{"id":"1_1613238983.154116_113.1","section":"bucket.instance","name":"ejuwhf-7:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.16","timestamp":"2021-02-13 17:56:23.154116996Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_6gToYEDMo15odl3q3-L3Vdk","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238983.159663_114.1","section":"bucket","name":"ejuwhf-7","timestamp":"2021-02-13 17:56:23.159663722Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_vMCydHAxj_7QuSB-qm9iUeu","ver":1},"status":{"status":"write"}}},{"id":"1_1613238983.175427_115.1","section":"bucket","name":"ejuwhf-7","timestamp":"2021-02-13 17:56:23.175427702Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_vMCydHAxj_7QuSB-qm9iUeu","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238983.204618_116.1","section":"bucket.instance","name":"ejuwhf-8:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.17","timestamp":"2021-02-13 17:56:23.204618338Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Hdp3JF03_d_n4JjDXpJzu0M","ver":1},"status":{"status":"write"}}},{"id":"1_1613238983.219872_117.1","section":"bucket.instance","name":"ejuwhf-8:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.17","timestamp":"2021-02-13 17:56:23.219872258Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Hdp3JF03_d_n4JjDXpJzu0M","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238983.225498_118.1","section":"bucket","name":"ejuwhf-8","timestamp":"2021-02-13 17:56:23.225498137Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_MGOREBZ0hisc7Gbu7eA5JrS","ver":1},"status":{"status":"write"}}},{"id":"1_1613238983.241003_119.1","section":"bucket","name":"ejuwhf-8","timestamp":"2021-02-13 17:56:23.241003542Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_MGOREBZ0hisc7Gbu7eA5JrS","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238983.303585_120.1","section":"bucket.instance","name":"ejuwhf-9:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.18","timestamp":"2021-02-13 17:56:23.303585683Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_jRCaQz5FozM4nex7-DOl0kP","ver":1},"status":{"status":"write"}}},{"id":"1_1613238983.318865_121.1","section":"bucket.instance","name":"ejuwhf-9:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.18","timestamp":"2021-02-13 17:56:23.318865612Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_jRCaQz5FozM4nex7-DOl0kP","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238983.325660_122.1","section":"bucket","name":"ejuwhf-9","timestamp":"2021-02-13 17:56:23.325660323Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_YYkgNX9vj3hntComaoMK5U7","ver":1},"status":{"status":"write"}}},{"id":"1_1613238983.341158_123.1","section":"bucket","name":"ejuwhf-9","timestamp":"2021-02-13 17:56:23.341158692Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_YYkgNX9vj3hntComaoMK5U7","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238989.616147_124.1","section":"bucket","name":"ejuwhf-7","timestamp":"2021-02-13 17:56:29.616147126Z","data":{"read_version":{"tag":"_vMCydHAxj_7QuSB-qm9iUeu","ver":1},"write_version":{"tag":"_vMCydHAxj_7QuSB-qm9iUeu","ver":2},"status":{"status":"remove"}}},{"id":"1_1613238989.631574_125.1","section":"bucket","name":"ejuwhf-7","timestamp":"2021-02-13 17:56:29.631574106Z","data":{"read_version":{"tag":"_vMCydHAxj_7QuSB-qm9iUeu","ver":1},"write_version":{"tag":"_vMCydHAxj_7QuSB-qm9iUeu","ver":2},"status":{"status":"complete"}}},{"id":"1_1613238989.670248_126.1","section":"bucket","name":"ejuwhf-8","timestamp":"2021-02-13 17:56:29.670248409Z","data":{"read_version":{"tag":"_MGOREBZ0hisc7Gbu7eA5JrS","ver":1},"write_version":{"tag":"_MGOREBZ0hisc7Gbu7eA5JrS","ver":2},"status":{"status":"remove"}}},{"id":"1_1613238989.685454_127.1","section":"bucket","name":"ejuwhf-8","timestamp":"2021-02-13 17:56:29.685454067Z","data":{"read_version":{"tag":"_MGOREBZ0hisc7Gbu7eA5JrS","ver":1},"write_version":{"tag":"_MGOREBZ0hisc7Gbu7eA5JrS","ver":2},"status":{"status":"complete"}}},{"id":"1_1613238989.754736_128.1","section":"bucket","name":"ejuwhf-9","timestamp":"2021-02-13 17:56:29.754736933Z","data":{"read_version":{"tag":"_YYkgNX9vj3hntComaoMK5U7","ver":1},"write_version":{"tag":"_YYkgNX9vj3hntComaoMK5U7","ver":2},"status":{"status":"remove"}}},{"id":"1_1613238989.770436_129.1","section":"bucket","name":"ejuwhf-9","timestamp":"2021-02-13 17:56:29.770436155Z","data":{"read_version":{"tag":"_YYkgNX9vj3hntComaoMK5U7","ver":1},"write_version":{"tag":"_YYkgNX9vj3hntComaoMK5U7","ver":2},"status":{"status":"complete"}}},{"id":"1_1613238996.408432_20.1","section":"bucket.instance","name":"ejuwhf-10:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.19","timestamp":"2021-02-13 17:56:36.408432478Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_4l67hELsPgMja42xS8A6UhZ","ver":1},"status":{"status":"write"}}},{"id":"1_1613238996.425111_21.1","section":"bucket.instance","name":"ejuwhf-10:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.19","timestamp":"2021-02-13 17:56:36.425111236Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_4l67hELsPgMja42xS8A6UhZ","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238996.431060_22.1","section":"bucket","name":"ejuwhf-10","timestamp":"2021-02-13 17:56:36.431060604Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_xJby3h3bIk5vujQVV2pSTI-","ver":1},"status":{"status":"write"}}},{"id":"1_1613238996.446399_23.1","section":"bucket","name":"ejuwhf-10","timestamp":"2021-02-13 17:56:36.446399505Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_xJby3h3bIk5vujQVV2pSTI-","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238996.476122_24.1","section":"bucket.instance","name":"ejuwhf-11:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.20","timestamp":"2021-02-13 17:56:36.476122639Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_BCqsB66WxEPsrV6oYaSn_X-","ver":1},"status":{"status":"write"}}},{"id":"1_1613238996.491357_25.1","section":"bucket.instance","name":"ejuwhf-11:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.20","timestamp":"2021-02-13 17:56:36.491357838Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_BCqsB66WxEPsrV6oYaSn_X-","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238996.497273_26.1","section":"bucket","name":"ejuwhf-11","timestamp":"2021-02-13 17:56:36.497273035Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ojdkozIRvVsoWlCTyPLaGvj","ver":1},"status":{"status":"write"}}},{"id":"1_1613238996.512730_27.1","section":"bucket","name":"ejuwhf-11","timestamp":"2021-02-13 17:56:36.512730394Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ojdkozIRvVsoWlCTyPLaGvj","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238996.571112_28.1","section":"bucket.instance","name":"ejuwhf-12:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.21","timestamp":"2021-02-13 17:56:36.571112397Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_r6gSqSaTmTbReYf0uGy8_aC","ver":1},"status":{"status":"write"}}},{"id":"1_1613238996.586525_29.1","section":"bucket.instance","name":"ejuwhf-12:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.21","timestamp":"2021-02-13 17:56:36.586525109Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_r6gSqSaTmTbReYf0uGy8_aC","ver":1},"status":{"status":"complete"}}},{"id":"1_1613238996.592228_30.1","section":"bucket","name":"ejuwhf-12","timestamp":"2021-02-13 17:56:36.592228025Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_--CaWqDYGbvQ4rZIucE1e-K","ver":1},"status":{"status":"write"}}},{"id":"1_1613238996.608007_31.1","section":"bucket","name":"ejuwhf-12","timestamp":"2021-02-13 17:56:36.608007431Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_--CaWqDYGbvQ4rZIucE1e-K","ver":1},"status":{"status":"complete"}}},{"id":"1_1613239321.080300_38.1","section":"bucket.instance","name":"ejuwhf-13:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.22","timestamp":"2021-02-13 18:02:01.080300919Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_78_uv7fHwaN7Qq4cyWhHLJz","ver":1},"status":{"status":"write"}}},{"id":"1_1613239321.097646_39.1","section":"bucket.instance","name":"ejuwhf-13:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.22","timestamp":"2021-02-13 18:02:01.097646161Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_78_uv7fHwaN7Qq4cyWhHLJz","ver":1},"status":{"status":"complete"}}},{"id":"1_1613239321.103822_40.1","section":"bucket","name":"ejuwhf-13","timestamp":"2021-02-13 18:02:01.103822896Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_lALUDndfu0TuP5K39wzC8in","ver":1},"status":{"status":"write"}}},{"id":"1_1613239321.120036_41.1","section":"bucket","name":"ejuwhf-13","timestamp":"2021-02-13 18:02:01.120036765Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_lALUDndfu0TuP5K39wzC8in","ver":1},"status":{"status":"complete"}}},{"id":"1_1613239321.157244_42.1","section":"bucket.instance","name":"ejuwhf-14:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.23","timestamp":"2021-02-13 18:02:01.157244195Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_fjpp4stMsyB7r2vHCXiSEql","ver":1},"status":{"status":"write"}}},{"id":"1_1613239321.173727_43.1","section":"bucket.instance","name":"ejuwhf-14:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.23","timestamp":"2021-02-13 18:02:01.173727725Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_fjpp4stMsyB7r2vHCXiSEql","ver":1},"status":{"status":"complete"}}},{"id":"1_1613239321.180183_44.1","section":"bucket","name":"ejuwhf-14","timestamp":"2021-02-13 18:02:01.180183919Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_lw1mkbLyJ3o-_DlonZo1SDZ","ver":1},"status":{"status":"write"}}},{"id":"1_1613239321.196368_45.1","section":"bucket","name":"ejuwhf-14","timestamp":"2021-02-13 18:02:01.196368937Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_lw1mkbLyJ3o-_DlonZo1SDZ","ver":1},"status":{"status":"complete"}}},{"id":"1_1613239321.265331_46.1","section":"bucket.instance","name":"ejuwhf-15:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.24","timestamp":"2021-02-13 18:02:01.265331350Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_uR_U3DJvBMRDbNsj1s38fR9","ver":1},"status":{"status":"write"}}},{"id":"1_1613239321.281670_47.1","section":"bucket.instance","name":"ejuwhf-15:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.24","timestamp":"2021-02-13 18:02:01.281670891Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_uR_U3DJvBMRDbNsj1s38fR9","ver":1},"status":{"status":"complete"}}},{"id":"1_1613239321.288543_48.1","section":"bucket","name":"ejuwhf-15","timestamp":"2021-02-13 18:02:01.288543122Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_k0PgphUQ7BAgCgZzpBUzBNN","ver":1},"status":{"status":"write"}}},{"id":"1_1613239321.305535_49.1","section":"bucket","name":"ejuwhf-15","timestamp":"2021-02-13 18:02:01.305535796Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_k0PgphUQ7BAgCgZzpBUzBNN","ver":1},"status":{"status":"complete"}}},{"id":"1_1613239643.733725_59.1","section":"bucket.instance","name":"ejuwhf-16:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.25","timestamp":"2021-02-13 18:07:23.733725000Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_nrprWx7VCq8YBJvRP_pJfT4","ver":1},"status":{"status":"write"}}},{"id":"1_1613239643.749943_60.1","section":"bucket.instance","name":"ejuwhf-16:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.25","timestamp":"2021-02-13 18:07:23.749943843Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_nrprWx7VCq8YBJvRP_pJfT4","ver":1},"status":{"status":"complete"}}},{"id":"1_1613239643.755418_61.1","section":"bucket","name":"ejuwhf-16","timestamp":"2021-02-13 18:07:23.755418869Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_LBYOapPliGlX3yh25unm84s","ver":1},"status":{"status":"write"}}},{"id":"1_1613239643.771083_62.1","section":"bucket","name":"ejuwhf-16","timestamp":"2021-02-13 18:07:23.771083206Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_LBYOapPliGlX3yh25unm84s","ver":1},"status":{"status":"complete"}}},{"id":"1_1613239643.806893_63.1","section":"bucket.instance","name":"ejuwhf-17:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.26","timestamp":"2021-02-13 18:07:23.806893724Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_8ovGbH1o6FvQnTtXB8s_UQm","ver":1},"status":{"status":"write"}}},{"id":"1_1613239643.822147_64.1","section":"bucket.instance","name":"ejuwhf-17:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.26","timestamp":"2021-02-13 18:07:23.822147852Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_8ovGbH1o6FvQnTtXB8s_UQm","ver":1},"status":{"status":"complete"}}},{"id":"1_1613239643.828619_65.1","section":"bucket","name":"ejuwhf-17","timestamp":"2021-02-13 18:07:23.828619399Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_h5MGnGsOEE9cFxGphgLOG3x","ver":1},"status":{"status":"write"}}},{"id":"1_1613239643.843279_66.1","section":"bucket","name":"ejuwhf-17","timestamp":"2021-02-13 18:07:23.843279069Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_h5MGnGsOEE9cFxGphgLOG3x","ver":1},"status":{"status":"complete"}}},{"id":"1_1613239643.906536_67.1","section":"bucket.instance","name":"ejuwhf-18:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.27","timestamp":"2021-02-13 18:07:23.906536499Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_YkOje16YwjBiAb0w6q8pqfO","ver":1},"status":{"status":"write"}}},{"id":"1_1613239643.922078_68.1","section":"bucket.instance","name":"ejuwhf-18:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.27","timestamp":"2021-02-13 18:07:23.922078168Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_YkOje16YwjBiAb0w6q8pqfO","ver":1},"status":{"status":"complete"}}},{"id":"1_1613239643.928111_69.1","section":"bucket","name":"ejuwhf-18","timestamp":"2021-02-13 18:07:23.928111593Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_2fiWbEVMEWvujFO3XL_4NjI","ver":1},"status":{"status":"write"}}},{"id":"1_1613239643.944698_70.1","section":"bucket","name":"ejuwhf-18","timestamp":"2021-02-13 18:07:23.944698661Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_2fiWbEVMEWvujFO3XL_4NjI","ver":1},"status":{"status":"complete"}}},{"id":"1_1613239643.992830_71.1","section":"bucket.instance","name":"ejuwhf-16:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.25","timestamp":"2021-02-13 18:07:23.992830606Z","data":{"read_version":{"tag":"_nrprWx7VCq8YBJvRP_pJfT4","ver":1},"write_version":{"tag":"_nrprWx7VCq8YBJvRP_pJfT4","ver":2},"status":{"status":"write"}}},{"id":"1_1613239644.009885_72.1","section":"bucket.instance","name":"ejuwhf-16:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.25","timestamp":"2021-02-13 18:07:24.009885261Z","data":{"read_version":{"tag":"_nrprWx7VCq8YBJvRP_pJfT4","ver":1},"write_version":{"tag":"_nrprWx7VCq8YBJvRP_pJfT4","ver":2},"status":{"status":"complete"}}},{"id":"1_1613239644.020434_73.1","section":"bucket.instance","name":"ejuwhf-17:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.26","timestamp":"2021-02-13 18:07:24.020434444Z","data":{"read_version":{"tag":"_8ovGbH1o6FvQnTtXB8s_UQm","ver":1},"write_version":{"tag":"_8ovGbH1o6FvQnTtXB8s_UQm","ver":2},"status":{"status":"write"}}},{"id":"1_1613239644.036282_74.1","section":"bucket.instance","name":"ejuwhf-17:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.26","timestamp":"2021-02-13 18:07:24.036282947Z","data":{"read_version":{"tag":"_8ovGbH1o6FvQnTtXB8s_UQm","ver":1},"write_version":{"tag":"_8ovGbH1o6FvQnTtXB8s_UQm","ver":2},"status":{"status":"complete"}}},{"id":"1_1613239644.055423_75.1","section":"bucket.instance","name":"ejuwhf-18:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.27","timestamp":"2021-02-13 18:07:24.055423607Z","data":{"read_version":{"tag":"_YkOje16YwjBiAb0w6q8pqfO","ver":1},"write_version":{"tag":"_YkOje16YwjBiAb0w6q8pqfO","ver":2},"status":{"status":"write"}}},{"id":"1_1613239644.070890_76.1","section":"bucket.instance","name":"ejuwhf-18:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.27","timestamp":"2021-02-13 18:07:24.070890569Z","data":{"read_version":{"tag":"_YkOje16YwjBiAb0w6q8pqfO","ver":1},"write_version":{"tag":"_YkOje16YwjBiAb0w6q8pqfO","ver":2},"status":{"status":"complete"}}},{"id":"1_1613239973.558856_84.1","section":"bucket.instance","name":"ejuwhf-19:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.28","timestamp":"2021-02-13 18:12:53.558856802Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_QLbnfIoGGaZIt0rwcmk-qti","ver":1},"status":{"status":"write"}}},{"id":"1_1613239973.575588_85.1","section":"bucket.instance","name":"ejuwhf-19:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.28","timestamp":"2021-02-13 18:12:53.575588311Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_QLbnfIoGGaZIt0rwcmk-qti","ver":1},"status":{"status":"complete"}}},{"id":"1_1613239973.581642_86.1","section":"bucket","name":"ejuwhf-19","timestamp":"2021-02-13 18:12:53.581642872Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_6FRUK8ncgnwrL2ZLGpRvips","ver":1},"status":{"status":"write"}}},{"id":"1_1613239973.597791_87.1","section":"bucket","name":"ejuwhf-19","timestamp":"2021-02-13 18:12:53.597791408Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_6FRUK8ncgnwrL2ZLGpRvips","ver":1},"status":{"status":"complete"}}},{"id":"1_1613239973.618317_88.1","section":"bucket.instance","name":"ejuwhf-19:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.28","timestamp":"2021-02-13 18:12:53.618317926Z","data":{"read_version":{"tag":"_QLbnfIoGGaZIt0rwcmk-qti","ver":1},"write_version":{"tag":"_QLbnfIoGGaZIt0rwcmk-qti","ver":2},"status":{"status":"write"}}},{"id":"1_1613239973.634814_89.1","section":"bucket.instance","name":"ejuwhf-19:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.28","timestamp":"2021-02-13 18:12:53.634814126Z","data":{"read_version":{"tag":"_QLbnfIoGGaZIt0rwcmk-qti","ver":1},"write_version":{"tag":"_QLbnfIoGGaZIt0rwcmk-qti","ver":2},"status":{"status":"complete"}}},{"id":"1_1613240298.200387_96.1","section":"bucket.instance","name":"ejuwhf-20:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.29","timestamp":"2021-02-13 18:18:18.200387564Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_zG-4FJP4lrTan5vmKfxkgxY","ver":1},"status":{"status":"write"}}},{"id":"1_1613240298.216338_97.1","section":"bucket.instance","name":"ejuwhf-20:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.29","timestamp":"2021-02-13 18:18:18.216338639Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_zG-4FJP4lrTan5vmKfxkgxY","ver":1},"status":{"status":"complete"}}},{"id":"1_1613240298.221718_98.1","section":"bucket","name":"ejuwhf-20","timestamp":"2021-02-13 18:18:18.221718896Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_hjd9VzRPYHn39EeVUieezBi","ver":1},"status":{"status":"write"}}},{"id":"1_1613240298.236365_99.1","section":"bucket","name":"ejuwhf-20","timestamp":"2021-02-13 18:18:18.236365179Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_hjd9VzRPYHn39EeVUieezBi","ver":1},"status":{"status":"complete"}}},{"id":"1_1613240621.656212_103.1","section":"bucket.instance","name":"ejuwhf-21:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.30","timestamp":"2021-02-13 18:23:41.656212918Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_PI91VmrZ-dDN5s_JIZJAPOu","ver":1},"status":{"status":"write"}}},{"id":"1_1613240621.672322_104.1","section":"bucket.instance","name":"ejuwhf-21:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.30","timestamp":"2021-02-13 18:23:41.672322312Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_PI91VmrZ-dDN5s_JIZJAPOu","ver":1},"status":{"status":"complete"}}},{"id":"1_1613240621.678630_105.1","section":"bucket","name":"ejuwhf-21","timestamp":"2021-02-13 18:23:41.678630564Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_QJCL0oRPCaZnOLc3FqHRPYX","ver":1},"status":{"status":"write"}}},{"id":"1_1613240621.693560_106.1","section":"bucket","name":"ejuwhf-21","timestamp":"2021-02-13 18:23:41.693560697Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_QJCL0oRPCaZnOLc3FqHRPYX","ver":1},"status":{"status":"complete"}}},{"id":"1_1613240621.741301_107.1","section":"bucket.instance","name":"ejuwhf-22:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.31","timestamp":"2021-02-13 18:23:41.741301484Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_hl5-x8kVDYpS5w-oh53bPCW","ver":1},"status":{"status":"write"}}},{"id":"1_1613240621.757529_108.1","section":"bucket.instance","name":"ejuwhf-22:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.31","timestamp":"2021-02-13 18:23:41.757529664Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_hl5-x8kVDYpS5w-oh53bPCW","ver":1},"status":{"status":"complete"}}},{"id":"1_1613240621.762982_109.1","section":"bucket","name":"ejuwhf-22","timestamp":"2021-02-13 18:23:41.762982204Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_qyPb-YYouea6Artq7SRkTtW","ver":1},"status":{"status":"write"}}},{"id":"1_1613240621.778531_110.1","section":"bucket","name":"ejuwhf-22","timestamp":"2021-02-13 18:23:41.778531566Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_qyPb-YYouea6Artq7SRkTtW","ver":1},"status":{"status":"complete"}}},{"id":"1_1613240621.852919_111.1","section":"bucket.instance","name":"ejuwhf-23:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.32","timestamp":"2021-02-13 18:23:41.852919112Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Zi3cYMrdm4uEttRZYVVoHN6","ver":1},"status":{"status":"write"}}},{"id":"1_1613240621.869034_112.1","section":"bucket.instance","name":"ejuwhf-23:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.32","timestamp":"2021-02-13 18:23:41.869034552Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Zi3cYMrdm4uEttRZYVVoHN6","ver":1},"status":{"status":"complete"}}},{"id":"1_1613240621.874580_113.1","section":"bucket","name":"ejuwhf-23","timestamp":"2021-02-13 18:23:41.874580193Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_HU3tbDLtK_l1Ht1UbiwZmmt","ver":1},"status":{"status":"write"}}},{"id":"1_1613240621.889892_114.1","section":"bucket","name":"ejuwhf-23","timestamp":"2021-02-13 18:23:41.889892437Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_HU3tbDLtK_l1Ht1UbiwZmmt","ver":1},"status":{"status":"complete"}}},{"id":"1_1613240621.938311_115.1","section":"bucket.instance","name":"ejuwhf-21:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.30","timestamp":"2021-02-13 18:23:41.938311534Z","data":{"read_version":{"tag":"_PI91VmrZ-dDN5s_JIZJAPOu","ver":1},"write_version":{"tag":"_PI91VmrZ-dDN5s_JIZJAPOu","ver":2},"status":{"status":"write"}}},{"id":"1_1613240621.954359_116.1","section":"bucket.instance","name":"ejuwhf-21:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.30","timestamp":"2021-02-13 18:23:41.954359504Z","data":{"read_version":{"tag":"_PI91VmrZ-dDN5s_JIZJAPOu","ver":1},"write_version":{"tag":"_PI91VmrZ-dDN5s_JIZJAPOu","ver":2},"status":{"status":"complete"}}},{"id":"1_1613240621.972224_117.1","section":"bucket.instance","name":"ejuwhf-22:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.31","timestamp":"2021-02-13 18:23:41.972224734Z","data":{"read_version":{"tag":"_hl5-x8kVDYpS5w-oh53bPCW","ver":1},"write_version":{"tag":"_hl5-x8kVDYpS5w-oh53bPCW","ver":2},"status":{"status":"write"}}},{"id":"1_1613240621.988926_118.1","section":"bucket.instance","name":"ejuwhf-22:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.31","timestamp":"2021-02-13 18:23:41.988926707Z","data":{"read_version":{"tag":"_hl5-x8kVDYpS5w-oh53bPCW","ver":1},"write_version":{"tag":"_hl5-x8kVDYpS5w-oh53bPCW","ver":2},"status":{"status":"complete"}}},{"id":"1_1613240622.014812_119.1","section":"bucket.instance","name":"ejuwhf-23:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.32","timestamp":"2021-02-13 18:23:42.014812172Z","data":{"read_version":{"tag":"_Zi3cYMrdm4uEttRZYVVoHN6","ver":1},"write_version":{"tag":"_Zi3cYMrdm4uEttRZYVVoHN6","ver":2},"status":{"status":"write"}}},{"id":"1_1613240622.031550_120.1","section":"bucket.instance","name":"ejuwhf-23:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.32","timestamp":"2021-02-13 18:23:42.031550983Z","data":{"read_version":{"tag":"_Zi3cYMrdm4uEttRZYVVoHN6","ver":1},"write_version":{"tag":"_Zi3cYMrdm4uEttRZYVVoHN6","ver":2},"status":{"status":"complete"}}},{"id":"1_1613240942.057496_129.1","section":"bucket.instance","name":"ejuwhf-24:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.33","timestamp":"2021-02-13 18:29:02.057496314Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Mymfhn6ginn73AnD7ml29g5","ver":1},"status":{"status":"write"}}},{"id":"1_1613240942.074249_130.1","section":"bucket.instance","name":"ejuwhf-24:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.33","timestamp":"2021-02-13 18:29:02.074249549Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Mymfhn6ginn73AnD7ml29g5","ver":1},"status":{"status":"complete"}}},{"id":"1_1613240942.080340_131.1","section":"bucket","name":"ejuwhf-24","timestamp":"2021-02-13 18:29:02.080340488Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_LXwSzpg4EyuMmTpiPZjf1cc","ver":1},"status":{"status":"write"}}},{"id":"1_1613240942.096212_132.1","section":"bucket","name":"ejuwhf-24","timestamp":"2021-02-13 18:29:02.096212692Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_LXwSzpg4EyuMmTpiPZjf1cc","ver":1},"status":{"status":"complete"}}},{"id":"1_1613240942.132341_133.1","section":"bucket.instance","name":"ejuwhf-25:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.34","timestamp":"2021-02-13 18:29:02.132341526Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_uMJzQ5xiX1YlCrcj1HBDDd1","ver":1},"status":{"status":"write"}}},{"id":"1_1613240942.147778_134.1","section":"bucket.instance","name":"ejuwhf-25:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.34","timestamp":"2021-02-13 18:29:02.147778756Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_uMJzQ5xiX1YlCrcj1HBDDd1","ver":1},"status":{"status":"complete"}}},{"id":"1_1613240942.153287_135.1","section":"bucket","name":"ejuwhf-25","timestamp":"2021-02-13 18:29:02.153287603Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_A3dK8rBY3svnWMIeKILt9Z_","ver":1},"status":{"status":"write"}}},{"id":"1_1613240942.168281_136.1","section":"bucket","name":"ejuwhf-25","timestamp":"2021-02-13 18:29:02.168281459Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_A3dK8rBY3svnWMIeKILt9Z_","ver":1},"status":{"status":"complete"}}},{"id":"1_1613240942.238318_137.1","section":"bucket.instance","name":"ejuwhf-26:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.35","timestamp":"2021-02-13 18:29:02.238318066Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_L3Z-v3OBQisJH8Y-dXJplsy","ver":1},"status":{"status":"write"}}},{"id":"1_1613240942.254572_138.1","section":"bucket.instance","name":"ejuwhf-26:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.35","timestamp":"2021-02-13 18:29:02.254572785Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_L3Z-v3OBQisJH8Y-dXJplsy","ver":1},"status":{"status":"complete"}}},{"id":"1_1613240942.260239_139.1","section":"bucket","name":"ejuwhf-26","timestamp":"2021-02-13 18:29:02.260239723Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_cPHMuqLQT9Fp0sttVt7JMgo","ver":1},"status":{"status":"write"}}},{"id":"1_1613240942.275753_140.1","section":"bucket","name":"ejuwhf-26","timestamp":"2021-02-13 18:29:02.275753150Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_cPHMuqLQT9Fp0sttVt7JMgo","ver":1},"status":{"status":"complete"}}},{"id":"1_1613240942.328657_141.1","section":"bucket.instance","name":"ejuwhf-24:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.33","timestamp":"2021-02-13 18:29:02.328657731Z","data":{"read_version":{"tag":"_Mymfhn6ginn73AnD7ml29g5","ver":1},"write_version":{"tag":"_Mymfhn6ginn73AnD7ml29g5","ver":2},"status":{"status":"write"}}},{"id":"1_1613240942.344935_142.1","section":"bucket.instance","name":"ejuwhf-24:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.33","timestamp":"2021-02-13 18:29:02.344935201Z","data":{"read_version":{"tag":"_Mymfhn6ginn73AnD7ml29g5","ver":1},"write_version":{"tag":"_Mymfhn6ginn73AnD7ml29g5","ver":2},"status":{"status":"complete"}}},{"id":"1_1613240942.353878_143.1","section":"bucket.instance","name":"ejuwhf-24:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.33","timestamp":"2021-02-13 18:29:02.353878692Z","data":{"read_version":{"tag":"_Mymfhn6ginn73AnD7ml29g5","ver":2},"write_version":{"tag":"_Mymfhn6ginn73AnD7ml29g5","ver":3},"status":{"status":"write"}}},{"id":"1_1613240942.370130_144.1","section":"bucket.instance","name":"ejuwhf-24:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.33","timestamp":"2021-02-13 18:29:02.370130831Z","data":{"read_version":{"tag":"_Mymfhn6ginn73AnD7ml29g5","ver":2},"write_version":{"tag":"_Mymfhn6ginn73AnD7ml29g5","ver":3},"status":{"status":"complete"}}},{"id":"1_1613240942.382481_145.1","section":"bucket.instance","name":"ejuwhf-25:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.34","timestamp":"2021-02-13 18:29:02.382481780Z","data":{"read_version":{"tag":"_uMJzQ5xiX1YlCrcj1HBDDd1","ver":1},"write_version":{"tag":"_uMJzQ5xiX1YlCrcj1HBDDd1","ver":2},"status":{"status":"write"}}},{"id":"1_1613240942.399166_146.1","section":"bucket.instance","name":"ejuwhf-25:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.34","timestamp":"2021-02-13 18:29:02.399166568Z","data":{"read_version":{"tag":"_uMJzQ5xiX1YlCrcj1HBDDd1","ver":1},"write_version":{"tag":"_uMJzQ5xiX1YlCrcj1HBDDd1","ver":2},"status":{"status":"complete"}}},{"id":"1_1613240942.421493_147.1","section":"bucket.instance","name":"ejuwhf-25:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.34","timestamp":"2021-02-13 18:29:02.421493448Z","data":{"read_version":{"tag":"_uMJzQ5xiX1YlCrcj1HBDDd1","ver":2},"write_version":{"tag":"_uMJzQ5xiX1YlCrcj1HBDDd1","ver":3},"status":{"status":"write"}}},{"id":"1_1613240942.437705_148.1","section":"bucket.instance","name":"ejuwhf-25:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.34","timestamp":"2021-02-13 18:29:02.437705406Z","data":{"read_version":{"tag":"_uMJzQ5xiX1YlCrcj1HBDDd1","ver":2},"write_version":{"tag":"_uMJzQ5xiX1YlCrcj1HBDDd1","ver":3},"status":{"status":"complete"}}},{"id":"1_1613240942.459839_149.1","section":"bucket.instance","name":"ejuwhf-26:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.35","timestamp":"2021-02-13 18:29:02.459839291Z","data":{"read_version":{"tag":"_L3Z-v3OBQisJH8Y-dXJplsy","ver":1},"write_version":{"tag":"_L3Z-v3OBQisJH8Y-dXJplsy","ver":2},"status":{"status":"write"}}},{"id":"1_1613240942.476918_150.1","section":"bucket.instance","name":"ejuwhf-26:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.35","timestamp":"2021-02-13 18:29:02.476918779Z","data":{"read_version":{"tag":"_L3Z-v3OBQisJH8Y-dXJplsy","ver":1},"write_version":{"tag":"_L3Z-v3OBQisJH8Y-dXJplsy","ver":2},"status":{"status":"complete"}}},{"id":"1_1613240942.499769_151.1","section":"bucket.instance","name":"ejuwhf-26:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.35","timestamp":"2021-02-13 18:29:02.499769496Z","data":{"read_version":{"tag":"_L3Z-v3OBQisJH8Y-dXJplsy","ver":2},"write_version":{"tag":"_L3Z-v3OBQisJH8Y-dXJplsy","ver":3},"status":{"status":"write"}}},{"id":"1_1613240942.515439_152.1","section":"bucket.instance","name":"ejuwhf-26:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.35","timestamp":"2021-02-13 18:29:02.515439820Z","data":{"read_version":{"tag":"_L3Z-v3OBQisJH8Y-dXJplsy","ver":2},"write_version":{"tag":"_L3Z-v3OBQisJH8Y-dXJplsy","ver":3},"status":{"status":"complete"}}},{"id":"1_1613241266.605637_161.1","section":"bucket.instance","name":"ejuwhf-27:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.36","timestamp":"2021-02-13 18:34:26.605637643Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_buhEDK5wV_BTZ1BfBOjuCtv","ver":1},"status":{"status":"write"}}},{"id":"1_1613241266.622739_162.1","section":"bucket.instance","name":"ejuwhf-27:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.36","timestamp":"2021-02-13 18:34:26.622739396Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_buhEDK5wV_BTZ1BfBOjuCtv","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241266.628411_163.1","section":"bucket","name":"ejuwhf-27","timestamp":"2021-02-13 18:34:26.628411671Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_cv0hC47mr82631TFimW_DVd","ver":1},"status":{"status":"write"}}},{"id":"1_1613241266.644465_164.1","section":"bucket","name":"ejuwhf-27","timestamp":"2021-02-13 18:34:26.644465762Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_cv0hC47mr82631TFimW_DVd","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241266.684520_165.1","section":"bucket.instance","name":"ejuwhf-28:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.37","timestamp":"2021-02-13 18:34:26.684520705Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Xd4FRhFK5zkknydU2nFa9wM","ver":1},"status":{"status":"write"}}},{"id":"1_1613241266.701308_166.1","section":"bucket.instance","name":"ejuwhf-28:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.37","timestamp":"2021-02-13 18:34:26.701308256Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Xd4FRhFK5zkknydU2nFa9wM","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241266.707762_167.1","section":"bucket","name":"ejuwhf-28","timestamp":"2021-02-13 18:34:26.707762712Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_fwmE9vPx54C_GLabnD2pr6O","ver":1},"status":{"status":"write"}}},{"id":"1_1613241266.723793_168.1","section":"bucket","name":"ejuwhf-28","timestamp":"2021-02-13 18:34:26.723793662Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_fwmE9vPx54C_GLabnD2pr6O","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241266.793975_169.1","section":"bucket.instance","name":"ejuwhf-29:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.38","timestamp":"2021-02-13 18:34:26.793975407Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_OYTb8fo0cI6eTvGgrw7zDVl","ver":1},"status":{"status":"write"}}},{"id":"1_1613241266.810889_170.1","section":"bucket.instance","name":"ejuwhf-29:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.38","timestamp":"2021-02-13 18:34:26.810889667Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_OYTb8fo0cI6eTvGgrw7zDVl","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241266.817391_171.1","section":"bucket","name":"ejuwhf-29","timestamp":"2021-02-13 18:34:26.817391051Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_8f7U215eIbZcyAN-0Ty-CHS","ver":1},"status":{"status":"write"}}},{"id":"1_1613241266.833518_172.1","section":"bucket","name":"ejuwhf-29","timestamp":"2021-02-13 18:34:26.833518174Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_8f7U215eIbZcyAN-0Ty-CHS","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241266.890012_173.1","section":"bucket.instance","name":"ejuwhf-27:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.36","timestamp":"2021-02-13 18:34:26.890012595Z","data":{"read_version":{"tag":"_buhEDK5wV_BTZ1BfBOjuCtv","ver":1},"write_version":{"tag":"_buhEDK5wV_BTZ1BfBOjuCtv","ver":2},"status":{"status":"write"}}},{"id":"1_1613241266.906758_174.1","section":"bucket.instance","name":"ejuwhf-27:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.36","timestamp":"2021-02-13 18:34:26.906758267Z","data":{"read_version":{"tag":"_buhEDK5wV_BTZ1BfBOjuCtv","ver":1},"write_version":{"tag":"_buhEDK5wV_BTZ1BfBOjuCtv","ver":2},"status":{"status":"complete"}}},{"id":"1_1613241266.965553_175.1","section":"bucket.instance","name":"ejuwhf-28:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.37","timestamp":"2021-02-13 18:34:26.965553236Z","data":{"read_version":{"tag":"_Xd4FRhFK5zkknydU2nFa9wM","ver":1},"write_version":{"tag":"_Xd4FRhFK5zkknydU2nFa9wM","ver":2},"status":{"status":"write"}}},{"id":"1_1613241266.983302_176.1","section":"bucket.instance","name":"ejuwhf-28:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.37","timestamp":"2021-02-13 18:34:26.983302909Z","data":{"read_version":{"tag":"_Xd4FRhFK5zkknydU2nFa9wM","ver":1},"write_version":{"tag":"_Xd4FRhFK5zkknydU2nFa9wM","ver":2},"status":{"status":"complete"}}},{"id":"1_1613241267.056149_177.1","section":"bucket.instance","name":"ejuwhf-29:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.38","timestamp":"2021-02-13 18:34:27.056149375Z","data":{"read_version":{"tag":"_OYTb8fo0cI6eTvGgrw7zDVl","ver":1},"write_version":{"tag":"_OYTb8fo0cI6eTvGgrw7zDVl","ver":2},"status":{"status":"write"}}},{"id":"1_1613241267.073356_178.1","section":"bucket.instance","name":"ejuwhf-29:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.38","timestamp":"2021-02-13 18:34:27.073356371Z","data":{"read_version":{"tag":"_OYTb8fo0cI6eTvGgrw7zDVl","ver":1},"write_version":{"tag":"_OYTb8fo0cI6eTvGgrw7zDVl","ver":2},"status":{"status":"complete"}}},{"id":"1_1613241267.151605_179.1","section":"bucket.instance","name":"ejuwhf-30:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.39","timestamp":"2021-02-13 18:34:27.151605712Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_xOOIxE04nsc05E_DBE8Tl4c","ver":1},"status":{"status":"write"}}},{"id":"1_1613241267.168752_180.1","section":"bucket.instance","name":"ejuwhf-30:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.39","timestamp":"2021-02-13 18:34:27.168752478Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_xOOIxE04nsc05E_DBE8Tl4c","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241267.174869_181.1","section":"bucket","name":"ejuwhf-30","timestamp":"2021-02-13 18:34:27.174869113Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_fXNqCzc4CG0kd9VOzBG9Q7P","ver":1},"status":{"status":"write"}}},{"id":"1_1613241267.190845_182.1","section":"bucket","name":"ejuwhf-30","timestamp":"2021-02-13 18:34:27.190845919Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_fXNqCzc4CG0kd9VOzBG9Q7P","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241267.225373_183.1","section":"bucket.instance","name":"ejuwhf-31:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.40","timestamp":"2021-02-13 18:34:27.225373782Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_vq-PbUFwVQj7aAfQtnD_3EU","ver":1},"status":{"status":"write"}}},{"id":"1_1613241267.242435_184.1","section":"bucket.instance","name":"ejuwhf-31:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.40","timestamp":"2021-02-13 18:34:27.242435556Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_vq-PbUFwVQj7aAfQtnD_3EU","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241267.248007_185.1","section":"bucket","name":"ejuwhf-31","timestamp":"2021-02-13 18:34:27.248007585Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_KctrzUTN-Z2qNoPxtPlfK8y","ver":1},"status":{"status":"write"}}},{"id":"1_1613241267.263145_186.1","section":"bucket","name":"ejuwhf-31","timestamp":"2021-02-13 18:34:27.263145093Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_KctrzUTN-Z2qNoPxtPlfK8y","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241267.328171_187.1","section":"bucket.instance","name":"ejuwhf-32:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.41","timestamp":"2021-02-13 18:34:27.328171763Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_pMTJ0sdLLeifyII2MXvLxTT","ver":1},"status":{"status":"write"}}},{"id":"1_1613241267.345082_188.1","section":"bucket.instance","name":"ejuwhf-32:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.41","timestamp":"2021-02-13 18:34:27.345082724Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_pMTJ0sdLLeifyII2MXvLxTT","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241267.350511_189.1","section":"bucket","name":"ejuwhf-32","timestamp":"2021-02-13 18:34:27.350511022Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ZBwWS6lgLvXfPlIIuMt3AtT","ver":1},"status":{"status":"write"}}},{"id":"1_1613241267.365375_190.1","section":"bucket","name":"ejuwhf-32","timestamp":"2021-02-13 18:34:27.365375654Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ZBwWS6lgLvXfPlIIuMt3AtT","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241267.427546_191.1","section":"bucket.instance","name":"ejuwhf-30:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.39","timestamp":"2021-02-13 18:34:27.427546507Z","data":{"read_version":{"tag":"_xOOIxE04nsc05E_DBE8Tl4c","ver":1},"write_version":{"tag":"_xOOIxE04nsc05E_DBE8Tl4c","ver":2},"status":{"status":"write"}}},{"id":"1_1613241267.443747_192.1","section":"bucket.instance","name":"ejuwhf-30:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.39","timestamp":"2021-02-13 18:34:27.443747325Z","data":{"read_version":{"tag":"_xOOIxE04nsc05E_DBE8Tl4c","ver":1},"write_version":{"tag":"_xOOIxE04nsc05E_DBE8Tl4c","ver":2},"status":{"status":"complete"}}},{"id":"1_1613241267.515491_193.1","section":"bucket.instance","name":"ejuwhf-31:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.40","timestamp":"2021-02-13 18:34:27.515491775Z","data":{"read_version":{"tag":"_vq-PbUFwVQj7aAfQtnD_3EU","ver":1},"write_version":{"tag":"_vq-PbUFwVQj7aAfQtnD_3EU","ver":2},"status":{"status":"write"}}},{"id":"1_1613241267.532248_194.1","section":"bucket.instance","name":"ejuwhf-31:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.40","timestamp":"2021-02-13 18:34:27.532248179Z","data":{"read_version":{"tag":"_vq-PbUFwVQj7aAfQtnD_3EU","ver":1},"write_version":{"tag":"_vq-PbUFwVQj7aAfQtnD_3EU","ver":2},"status":{"status":"complete"}}},{"id":"1_1613241267.614493_195.1","section":"bucket.instance","name":"ejuwhf-32:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.41","timestamp":"2021-02-13 18:34:27.614493922Z","data":{"read_version":{"tag":"_pMTJ0sdLLeifyII2MXvLxTT","ver":1},"write_version":{"tag":"_pMTJ0sdLLeifyII2MXvLxTT","ver":2},"status":{"status":"write"}}},{"id":"1_1613241267.631169_196.1","section":"bucket.instance","name":"ejuwhf-32:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.41","timestamp":"2021-02-13 18:34:27.631169929Z","data":{"read_version":{"tag":"_pMTJ0sdLLeifyII2MXvLxTT","ver":1},"write_version":{"tag":"_pMTJ0sdLLeifyII2MXvLxTT","ver":2},"status":{"status":"complete"}}},{"id":"1_1613241267.703455_197.1","section":"bucket.instance","name":"ejuwhf-33:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.42","timestamp":"2021-02-13 18:34:27.703455821Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_H8xnpAZEzqUOed9D6o8b0E0","ver":1},"status":{"status":"write"}}},{"id":"1_1613241267.709061_198.1","section":"bucket.instance","name":"ejuwhf-33:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.42","timestamp":"2021-02-13 18:34:27.709061094Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_H8xnpAZEzqUOed9D6o8b0E0","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241267.710918_199.1","section":"bucket","name":"ejuwhf-33","timestamp":"2021-02-13 18:34:27.710918130Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_5d9OIM7k69p0P0uAysQiRdG","ver":1},"status":{"status":"write"}}},{"id":"1_1613241267.716192_200.1","section":"bucket","name":"ejuwhf-33","timestamp":"2021-02-13 18:34:27.716192524Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_5d9OIM7k69p0P0uAysQiRdG","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241267.728031_201.1","section":"bucket.instance","name":"ejuwhf-34:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.43","timestamp":"2021-02-13 18:34:27.728031465Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_CRJvAYGaC5ssXc3dJv7KEk4","ver":1},"status":{"status":"write"}}},{"id":"1_1613241267.733121_202.1","section":"bucket.instance","name":"ejuwhf-34:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.43","timestamp":"2021-02-13 18:34:27.733121606Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_CRJvAYGaC5ssXc3dJv7KEk4","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241267.735002_203.1","section":"bucket","name":"ejuwhf-34","timestamp":"2021-02-13 18:34:27.735002139Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ro68eUWJTFM6zc_B6pTLzxQ","ver":1},"status":{"status":"write"}}},{"id":"1_1613241267.739821_204.1","section":"bucket","name":"ejuwhf-34","timestamp":"2021-02-13 18:34:27.739821981Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ro68eUWJTFM6zc_B6pTLzxQ","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241267.788853_205.1","section":"bucket.instance","name":"ejuwhf-35:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.44","timestamp":"2021-02-13 18:34:27.788853889Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_W0CjPxEhZ84WmkTK-IJS63R","ver":1},"status":{"status":"write"}}},{"id":"1_1613241267.805812_206.1","section":"bucket.instance","name":"ejuwhf-35:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.44","timestamp":"2021-02-13 18:34:27.805812011Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_W0CjPxEhZ84WmkTK-IJS63R","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241267.812537_207.1","section":"bucket","name":"ejuwhf-35","timestamp":"2021-02-13 18:34:27.812537791Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_3BdK8ESSfyzlLsuvW_K1IJj","ver":1},"status":{"status":"write"}}},{"id":"1_1613241267.829128_208.1","section":"bucket","name":"ejuwhf-35","timestamp":"2021-02-13 18:34:27.829128246Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_3BdK8ESSfyzlLsuvW_K1IJj","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241267.880158_209.1","section":"bucket.instance","name":"ejuwhf-33:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.42","timestamp":"2021-02-13 18:34:27.880158053Z","data":{"read_version":{"tag":"_H8xnpAZEzqUOed9D6o8b0E0","ver":1},"write_version":{"tag":"_H8xnpAZEzqUOed9D6o8b0E0","ver":2},"status":{"status":"write"}}},{"id":"1_1613241267.897939_210.1","section":"bucket.instance","name":"ejuwhf-33:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.42","timestamp":"2021-02-13 18:34:27.897939577Z","data":{"read_version":{"tag":"_H8xnpAZEzqUOed9D6o8b0E0","ver":1},"write_version":{"tag":"_H8xnpAZEzqUOed9D6o8b0E0","ver":2},"status":{"status":"complete"}}},{"id":"1_1613241268.960288_211.1","section":"bucket.instance","name":"ejuwhf-34:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.43","timestamp":"2021-02-13 18:34:28.960288660Z","data":{"read_version":{"tag":"_CRJvAYGaC5ssXc3dJv7KEk4","ver":1},"write_version":{"tag":"_CRJvAYGaC5ssXc3dJv7KEk4","ver":2},"status":{"status":"write"}}},{"id":"1_1613241268.978013_212.1","section":"bucket.instance","name":"ejuwhf-34:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.43","timestamp":"2021-02-13 18:34:28.978013262Z","data":{"read_version":{"tag":"_CRJvAYGaC5ssXc3dJv7KEk4","ver":1},"write_version":{"tag":"_CRJvAYGaC5ssXc3dJv7KEk4","ver":2},"status":{"status":"complete"}}},{"id":"1_1613241270.429647_213.1","section":"bucket.instance","name":"ejuwhf-35:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.44","timestamp":"2021-02-13 18:34:30.429647701Z","data":{"read_version":{"tag":"_W0CjPxEhZ84WmkTK-IJS63R","ver":1},"write_version":{"tag":"_W0CjPxEhZ84WmkTK-IJS63R","ver":2},"status":{"status":"write"}}},{"id":"1_1613241270.446438_214.1","section":"bucket.instance","name":"ejuwhf-35:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.44","timestamp":"2021-02-13 18:34:30.446438646Z","data":{"read_version":{"tag":"_W0CjPxEhZ84WmkTK-IJS63R","ver":1},"write_version":{"tag":"_W0CjPxEhZ84WmkTK-IJS63R","ver":2},"status":{"status":"complete"}}},{"id":"1_1613241270.850432_215.1","section":"bucket.instance","name":"ejuwhf-36:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.45","timestamp":"2021-02-13 18:34:30.850432491Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_9UmWS9ftBX75KSmck3AaoP3","ver":1},"status":{"status":"write"}}},{"id":"1_1613241270.866532_216.1","section":"bucket.instance","name":"ejuwhf-36:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.45","timestamp":"2021-02-13 18:34:30.866532637Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_9UmWS9ftBX75KSmck3AaoP3","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241270.872542_217.1","section":"bucket","name":"ejuwhf-36","timestamp":"2021-02-13 18:34:30.872542707Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_73boIkO_FojWkXyFQw7oy7A","ver":1},"status":{"status":"write"}}},{"id":"1_1613241270.888203_218.1","section":"bucket","name":"ejuwhf-36","timestamp":"2021-02-13 18:34:30.888203891Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_73boIkO_FojWkXyFQw7oy7A","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241271.585572_219.1","section":"bucket.instance","name":"ejuwhf-37:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.46","timestamp":"2021-02-13 18:34:31.585572280Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_mDbnQaV5gAjZL8anNAScPB9","ver":1},"status":{"status":"write"}}},{"id":"1_1613241271.603089_220.1","section":"bucket.instance","name":"ejuwhf-37:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.46","timestamp":"2021-02-13 18:34:31.603089265Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_mDbnQaV5gAjZL8anNAScPB9","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241271.608951_221.1","section":"bucket","name":"ejuwhf-37","timestamp":"2021-02-13 18:34:31.608951157Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_s74zFZJJ4NFsgBcob2jXayP","ver":1},"status":{"status":"write"}}},{"id":"1_1613241271.624585_222.1","section":"bucket","name":"ejuwhf-37","timestamp":"2021-02-13 18:34:31.624585936Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_s74zFZJJ4NFsgBcob2jXayP","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241272.105214_223.1","section":"bucket.instance","name":"ejuwhf-38:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.47","timestamp":"2021-02-13 18:34:32.105214877Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_hOR-x810TeuF27wCR96Wty1","ver":1},"status":{"status":"write"}}},{"id":"1_1613241272.122415_224.1","section":"bucket.instance","name":"ejuwhf-38:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.47","timestamp":"2021-02-13 18:34:32.122415123Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_hOR-x810TeuF27wCR96Wty1","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241272.128464_225.1","section":"bucket","name":"ejuwhf-38","timestamp":"2021-02-13 18:34:32.128464434Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_3IUloz0JebNxZ4oJtAH1uGt","ver":1},"status":{"status":"write"}}},{"id":"1_1613241272.144691_226.1","section":"bucket","name":"ejuwhf-38","timestamp":"2021-02-13 18:34:32.144691215Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_3IUloz0JebNxZ4oJtAH1uGt","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241280.698617_230.1","section":"bucket.instance","name":"ejuwhf-39:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.48","timestamp":"2021-02-13 18:34:40.698617098Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_eYhw6M1Kq9Fsl1gXEYBZ6tb","ver":1},"status":{"status":"write"}}},{"id":"1_1613241280.714973_231.1","section":"bucket.instance","name":"ejuwhf-39:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.48","timestamp":"2021-02-13 18:34:40.714973292Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_eYhw6M1Kq9Fsl1gXEYBZ6tb","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241280.720530_232.1","section":"bucket","name":"ejuwhf-39","timestamp":"2021-02-13 18:34:40.720530128Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_3SHNqKcm35n77170DwwQ5uP","ver":1},"status":{"status":"write"}}},{"id":"1_1613241280.736452_233.1","section":"bucket","name":"ejuwhf-39","timestamp":"2021-02-13 18:34:40.736452448Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_3SHNqKcm35n77170DwwQ5uP","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241281.607686_235.1","section":"bucket.instance","name":"ejuwhf-40:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.49","timestamp":"2021-02-13 18:34:41.607686289Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ET7-100GAjHcWvb6dmSd471","ver":1},"status":{"status":"write"}}},{"id":"1_1613241281.623808_236.1","section":"bucket.instance","name":"ejuwhf-40:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.49","timestamp":"2021-02-13 18:34:41.623808900Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ET7-100GAjHcWvb6dmSd471","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241281.629531_237.1","section":"bucket","name":"ejuwhf-40","timestamp":"2021-02-13 18:34:41.629531463Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_YLtkbjHvhAUvE3rtVFYlkKS","ver":1},"status":{"status":"write"}}},{"id":"1_1613241281.645755_238.1","section":"bucket","name":"ejuwhf-40","timestamp":"2021-02-13 18:34:41.645755376Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_YLtkbjHvhAUvE3rtVFYlkKS","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241281.785892_239.1","section":"bucket.instance","name":"ejuwhf-41:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.50","timestamp":"2021-02-13 18:34:41.785892843Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_A4tdGeJPy82CSxfrGu7y2YU","ver":1},"status":{"status":"write"}}},{"id":"1_1613241281.802707_240.1","section":"bucket.instance","name":"ejuwhf-41:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.50","timestamp":"2021-02-13 18:34:41.802707356Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_A4tdGeJPy82CSxfrGu7y2YU","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241281.808203_241.1","section":"bucket","name":"ejuwhf-41","timestamp":"2021-02-13 18:34:41.808203156Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_-Tx8KzgTMRgfsqe1Lj-5EOH","ver":1},"status":{"status":"write"}}},{"id":"1_1613241281.822512_242.1","section":"bucket","name":"ejuwhf-41","timestamp":"2021-02-13 18:34:41.822512374Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_-Tx8KzgTMRgfsqe1Lj-5EOH","ver":1},"status":{"status":"complete"}}}] 2021-02-13T18:37:03.036 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'list', '--period', '87cf2a0e-b653-4b98-b23c-48172347acb4', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:37:03.036 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'list', '--period', '87cf2a0e-b653-4b98-b23c-48172347acb4', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:37:03.038 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog list --period 87cf2a0e-b653-4b98-b23c-48172347acb4 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:37:03.166 INFO:teuthology.orchestra.run.gibba025.stdout:[{"id":"1_1613241349.071266_90.1","section":"bucket.instance","name":"ejuwhf-42:e658a22d-79d5-4296-b285-f122e7115b09.7499.1","timestamp":"2021-02-13 18:35:49.071266343Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_2TWTt3qqWtvx70NPRJExiW-","ver":1},"status":{"status":"write"}}},{"id":"1_1613241349.075050_91.1","section":"bucket.instance","name":"ejuwhf-42:e658a22d-79d5-4296-b285-f122e7115b09.7499.1","timestamp":"2021-02-13 18:35:49.075050902Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_2TWTt3qqWtvx70NPRJExiW-","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241349.076443_92.1","section":"bucket","name":"ejuwhf-42","timestamp":"2021-02-13 18:35:49.076443829Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_blP_VLnPxY9hBwZZHw33ryv","ver":1},"status":{"status":"write"}}},{"id":"1_1613241349.080219_93.1","section":"bucket","name":"ejuwhf-42","timestamp":"2021-02-13 18:35:49.080219430Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_blP_VLnPxY9hBwZZHw33ryv","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241349.134041_94.1","section":"bucket.instance","name":"ejuwhf-43:e658a22d-79d5-4296-b285-f122e7115b09.7499.2","timestamp":"2021-02-13 18:35:49.134041477Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_FvbKaN9m43_BVSv0WuDU4kl","ver":1},"status":{"status":"write"}}},{"id":"1_1613241349.148466_95.1","section":"bucket.instance","name":"ejuwhf-43:e658a22d-79d5-4296-b285-f122e7115b09.7499.2","timestamp":"2021-02-13 18:35:49.148466926Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_FvbKaN9m43_BVSv0WuDU4kl","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241349.153753_96.1","section":"bucket","name":"ejuwhf-43","timestamp":"2021-02-13 18:35:49.153753359Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_XqPy9_CvFWVdGfzP5ObuU1b","ver":1},"status":{"status":"write"}}},{"id":"1_1613241349.167298_97.1","section":"bucket","name":"ejuwhf-43","timestamp":"2021-02-13 18:35:49.167298211Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_XqPy9_CvFWVdGfzP5ObuU1b","ver":1},"status":{"status":"complete"}}}] 2021-02-13T18:37:03.167 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['mdlog', 'list', '--period', '87cf2a0e-b653-4b98-b23c-48172347acb4', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:37:03.167 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'mdlog', 'list', '--period', '87cf2a0e-b653-4b98-b23c-48172347acb4', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:37:03.167 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 mdlog list --period 87cf2a0e-b653-4b98-b23c-48172347acb4 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:37:03.287 INFO:teuthology.orchestra.run.gibba036.stdout:[{"id":"1_1613241349.071266_90.1","section":"bucket.instance","name":"ejuwhf-42:e658a22d-79d5-4296-b285-f122e7115b09.7499.1","timestamp":"2021-02-13 18:35:49.071266343Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_2TWTt3qqWtvx70NPRJExiW-","ver":1},"status":{"status":"write"}}},{"id":"1_1613241349.075050_91.1","section":"bucket.instance","name":"ejuwhf-42:e658a22d-79d5-4296-b285-f122e7115b09.7499.1","timestamp":"2021-02-13 18:35:49.075050902Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_2TWTt3qqWtvx70NPRJExiW-","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241349.076443_92.1","section":"bucket","name":"ejuwhf-42","timestamp":"2021-02-13 18:35:49.076443829Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_blP_VLnPxY9hBwZZHw33ryv","ver":1},"status":{"status":"write"}}},{"id":"1_1613241349.080219_93.1","section":"bucket","name":"ejuwhf-42","timestamp":"2021-02-13 18:35:49.080219430Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_blP_VLnPxY9hBwZZHw33ryv","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241349.134041_94.1","section":"bucket.instance","name":"ejuwhf-43:e658a22d-79d5-4296-b285-f122e7115b09.7499.2","timestamp":"2021-02-13 18:35:49.134041477Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_FvbKaN9m43_BVSv0WuDU4kl","ver":1},"status":{"status":"write"}}},{"id":"1_1613241349.148466_95.1","section":"bucket.instance","name":"ejuwhf-43:e658a22d-79d5-4296-b285-f122e7115b09.7499.2","timestamp":"2021-02-13 18:35:49.148466926Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_FvbKaN9m43_BVSv0WuDU4kl","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241349.153753_96.1","section":"bucket","name":"ejuwhf-43","timestamp":"2021-02-13 18:35:49.153753359Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_XqPy9_CvFWVdGfzP5ObuU1b","ver":1},"status":{"status":"write"}}},{"id":"1_1613241349.167298_97.1","section":"bucket","name":"ejuwhf-43","timestamp":"2021-02-13 18:35:49.167298211Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_XqPy9_CvFWVdGfzP5ObuU1b","ver":1},"status":{"status":"complete"}}}] 2021-02-13T18:37:03.288 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'list', '--period', '87cf2a0e-b653-4b98-b23c-48172347acb4', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:37:03.288 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'list', '--period', '87cf2a0e-b653-4b98-b23c-48172347acb4', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:37:03.288 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog list --period 87cf2a0e-b653-4b98-b23c-48172347acb4 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:37:03.378 INFO:teuthology.orchestra.run.gibba025.stdout:[{"id":"1_1613241349.071266_90.1","section":"bucket.instance","name":"ejuwhf-42:e658a22d-79d5-4296-b285-f122e7115b09.7499.1","timestamp":"2021-02-13 18:35:49.071266343Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_2TWTt3qqWtvx70NPRJExiW-","ver":1},"status":{"status":"write"}}},{"id":"1_1613241349.075050_91.1","section":"bucket.instance","name":"ejuwhf-42:e658a22d-79d5-4296-b285-f122e7115b09.7499.1","timestamp":"2021-02-13 18:35:49.075050902Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_2TWTt3qqWtvx70NPRJExiW-","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241349.076443_92.1","section":"bucket","name":"ejuwhf-42","timestamp":"2021-02-13 18:35:49.076443829Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_blP_VLnPxY9hBwZZHw33ryv","ver":1},"status":{"status":"write"}}},{"id":"1_1613241349.080219_93.1","section":"bucket","name":"ejuwhf-42","timestamp":"2021-02-13 18:35:49.080219430Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_blP_VLnPxY9hBwZZHw33ryv","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241349.134041_94.1","section":"bucket.instance","name":"ejuwhf-43:e658a22d-79d5-4296-b285-f122e7115b09.7499.2","timestamp":"2021-02-13 18:35:49.134041477Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_FvbKaN9m43_BVSv0WuDU4kl","ver":1},"status":{"status":"write"}}},{"id":"1_1613241349.148466_95.1","section":"bucket.instance","name":"ejuwhf-43:e658a22d-79d5-4296-b285-f122e7115b09.7499.2","timestamp":"2021-02-13 18:35:49.148466926Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_FvbKaN9m43_BVSv0WuDU4kl","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241349.153753_96.1","section":"bucket","name":"ejuwhf-43","timestamp":"2021-02-13 18:35:49.153753359Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_XqPy9_CvFWVdGfzP5ObuU1b","ver":1},"status":{"status":"write"}}},{"id":"1_1613241349.167298_97.1","section":"bucket","name":"ejuwhf-43","timestamp":"2021-02-13 18:35:49.167298211Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_XqPy9_CvFWVdGfzP5ObuU1b","ver":1},"status":{"status":"complete"}}}] 2021-02-13T18:37:03.379 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['mdlog', 'list', '--period', '87cf2a0e-b653-4b98-b23c-48172347acb4', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:37:03.379 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'mdlog', 'list', '--period', '87cf2a0e-b653-4b98-b23c-48172347acb4', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:37:03.379 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 mdlog list --period 87cf2a0e-b653-4b98-b23c-48172347acb4 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:37:03.500 INFO:teuthology.orchestra.run.gibba036.stdout:[{"id":"1_1613241349.071266_90.1","section":"bucket.instance","name":"ejuwhf-42:e658a22d-79d5-4296-b285-f122e7115b09.7499.1","timestamp":"2021-02-13 18:35:49.071266343Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_2TWTt3qqWtvx70NPRJExiW-","ver":1},"status":{"status":"write"}}},{"id":"1_1613241349.075050_91.1","section":"bucket.instance","name":"ejuwhf-42:e658a22d-79d5-4296-b285-f122e7115b09.7499.1","timestamp":"2021-02-13 18:35:49.075050902Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_2TWTt3qqWtvx70NPRJExiW-","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241349.076443_92.1","section":"bucket","name":"ejuwhf-42","timestamp":"2021-02-13 18:35:49.076443829Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_blP_VLnPxY9hBwZZHw33ryv","ver":1},"status":{"status":"write"}}},{"id":"1_1613241349.080219_93.1","section":"bucket","name":"ejuwhf-42","timestamp":"2021-02-13 18:35:49.080219430Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_blP_VLnPxY9hBwZZHw33ryv","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241349.134041_94.1","section":"bucket.instance","name":"ejuwhf-43:e658a22d-79d5-4296-b285-f122e7115b09.7499.2","timestamp":"2021-02-13 18:35:49.134041477Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_FvbKaN9m43_BVSv0WuDU4kl","ver":1},"status":{"status":"write"}}},{"id":"1_1613241349.148466_95.1","section":"bucket.instance","name":"ejuwhf-43:e658a22d-79d5-4296-b285-f122e7115b09.7499.2","timestamp":"2021-02-13 18:35:49.148466926Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_FvbKaN9m43_BVSv0WuDU4kl","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241349.153753_96.1","section":"bucket","name":"ejuwhf-43","timestamp":"2021-02-13 18:35:49.153753359Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_XqPy9_CvFWVdGfzP5ObuU1b","ver":1},"status":{"status":"write"}}},{"id":"1_1613241349.167298_97.1","section":"bucket","name":"ejuwhf-43","timestamp":"2021-02-13 18:35:49.167298211Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_XqPy9_CvFWVdGfzP5ObuU1b","ver":1},"status":{"status":"complete"}}}] 2021-02-13T18:37:03.500 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'list', '--period', 'c72c9bb6-7372-4355-b488-0f51f8a5cecb', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:37:03.501 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'list', '--period', 'c72c9bb6-7372-4355-b488-0f51f8a5cecb', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:37:03.501 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog list --period c72c9bb6-7372-4355-b488-0f51f8a5cecb --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:37:03.621 INFO:teuthology.orchestra.run.gibba025.stdout:[{"id":"1_1613241414.718222_199.1","section":"bucket.instance","name":"ejuwhf-44:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4825.1","timestamp":"2021-02-13 18:36:54.718222131Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_hw5EkD84tA1hgLEiMagRdpw","ver":1},"status":{"status":"write"}}},{"id":"1_1613241414.734455_200.1","section":"bucket.instance","name":"ejuwhf-44:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4825.1","timestamp":"2021-02-13 18:36:54.734455728Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_hw5EkD84tA1hgLEiMagRdpw","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241414.740973_201.1","section":"bucket","name":"ejuwhf-44","timestamp":"2021-02-13 18:36:54.740973613Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_-xUQINeOXRwpAr2swwXXuom","ver":1},"status":{"status":"write"}}},{"id":"1_1613241414.757191_202.1","section":"bucket","name":"ejuwhf-44","timestamp":"2021-02-13 18:36:54.757191749Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_-xUQINeOXRwpAr2swwXXuom","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241414.806029_203.1","section":"bucket.instance","name":"ejuwhf-45:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4825.2","timestamp":"2021-02-13 18:36:54.806029958Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_x2IuEyVl4pmJjhEaBlNCGWs","ver":1},"status":{"status":"write"}}},{"id":"1_1613241414.822534_204.1","section":"bucket.instance","name":"ejuwhf-45:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4825.2","timestamp":"2021-02-13 18:36:54.822534980Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_x2IuEyVl4pmJjhEaBlNCGWs","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241414.828777_205.1","section":"bucket","name":"ejuwhf-45","timestamp":"2021-02-13 18:36:54.828777477Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_xMWq_b8ZacmVHJHjS9aEQ0Y","ver":1},"status":{"status":"write"}}},{"id":"1_1613241414.844875_206.1","section":"bucket","name":"ejuwhf-45","timestamp":"2021-02-13 18:36:54.844875782Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_xMWq_b8ZacmVHJHjS9aEQ0Y","ver":1},"status":{"status":"complete"}}}] 2021-02-13T18:37:03.621 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['mdlog', 'list', '--period', 'c72c9bb6-7372-4355-b488-0f51f8a5cecb', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:37:03.621 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'mdlog', 'list', '--period', 'c72c9bb6-7372-4355-b488-0f51f8a5cecb', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:37:03.622 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 mdlog list --period c72c9bb6-7372-4355-b488-0f51f8a5cecb --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:37:03.705 INFO:teuthology.orchestra.run.gibba036.stdout:[{"id":"1_1613241414.718222_199.1","section":"bucket.instance","name":"ejuwhf-44:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4825.1","timestamp":"2021-02-13 18:36:54.718222131Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_hw5EkD84tA1hgLEiMagRdpw","ver":1},"status":{"status":"write"}}},{"id":"1_1613241414.734455_200.1","section":"bucket.instance","name":"ejuwhf-44:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4825.1","timestamp":"2021-02-13 18:36:54.734455728Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_hw5EkD84tA1hgLEiMagRdpw","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241414.740973_201.1","section":"bucket","name":"ejuwhf-44","timestamp":"2021-02-13 18:36:54.740973613Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_-xUQINeOXRwpAr2swwXXuom","ver":1},"status":{"status":"write"}}},{"id":"1_1613241414.757191_202.1","section":"bucket","name":"ejuwhf-44","timestamp":"2021-02-13 18:36:54.757191749Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_-xUQINeOXRwpAr2swwXXuom","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241414.806029_203.1","section":"bucket.instance","name":"ejuwhf-45:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4825.2","timestamp":"2021-02-13 18:36:54.806029958Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_x2IuEyVl4pmJjhEaBlNCGWs","ver":1},"status":{"status":"write"}}},{"id":"1_1613241414.822534_204.1","section":"bucket.instance","name":"ejuwhf-45:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4825.2","timestamp":"2021-02-13 18:36:54.822534980Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_x2IuEyVl4pmJjhEaBlNCGWs","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241414.828777_205.1","section":"bucket","name":"ejuwhf-45","timestamp":"2021-02-13 18:36:54.828777477Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_xMWq_b8ZacmVHJHjS9aEQ0Y","ver":1},"status":{"status":"write"}}},{"id":"1_1613241414.844875_206.1","section":"bucket","name":"ejuwhf-45","timestamp":"2021-02-13 18:36:54.844875782Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_xMWq_b8ZacmVHJHjS9aEQ0Y","ver":1},"status":{"status":"complete"}}}] 2021-02-13T18:37:03.706 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'list', '--period', 'c72c9bb6-7372-4355-b488-0f51f8a5cecb', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:37:03.706 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'list', '--period', 'c72c9bb6-7372-4355-b488-0f51f8a5cecb', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:37:03.706 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog list --period c72c9bb6-7372-4355-b488-0f51f8a5cecb --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:37:03.826 INFO:teuthology.orchestra.run.gibba025.stdout:[{"id":"1_1613241414.718222_199.1","section":"bucket.instance","name":"ejuwhf-44:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4825.1","timestamp":"2021-02-13 18:36:54.718222131Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_hw5EkD84tA1hgLEiMagRdpw","ver":1},"status":{"status":"write"}}},{"id":"1_1613241414.734455_200.1","section":"bucket.instance","name":"ejuwhf-44:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4825.1","timestamp":"2021-02-13 18:36:54.734455728Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_hw5EkD84tA1hgLEiMagRdpw","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241414.740973_201.1","section":"bucket","name":"ejuwhf-44","timestamp":"2021-02-13 18:36:54.740973613Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_-xUQINeOXRwpAr2swwXXuom","ver":1},"status":{"status":"write"}}},{"id":"1_1613241414.757191_202.1","section":"bucket","name":"ejuwhf-44","timestamp":"2021-02-13 18:36:54.757191749Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_-xUQINeOXRwpAr2swwXXuom","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241414.806029_203.1","section":"bucket.instance","name":"ejuwhf-45:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4825.2","timestamp":"2021-02-13 18:36:54.806029958Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_x2IuEyVl4pmJjhEaBlNCGWs","ver":1},"status":{"status":"write"}}},{"id":"1_1613241414.822534_204.1","section":"bucket.instance","name":"ejuwhf-45:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4825.2","timestamp":"2021-02-13 18:36:54.822534980Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_x2IuEyVl4pmJjhEaBlNCGWs","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241414.828777_205.1","section":"bucket","name":"ejuwhf-45","timestamp":"2021-02-13 18:36:54.828777477Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_xMWq_b8ZacmVHJHjS9aEQ0Y","ver":1},"status":{"status":"write"}}},{"id":"1_1613241414.844875_206.1","section":"bucket","name":"ejuwhf-45","timestamp":"2021-02-13 18:36:54.844875782Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_xMWq_b8ZacmVHJHjS9aEQ0Y","ver":1},"status":{"status":"complete"}}}] 2021-02-13T18:37:03.826 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['mdlog', 'list', '--period', 'c72c9bb6-7372-4355-b488-0f51f8a5cecb', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:37:03.826 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'mdlog', 'list', '--period', 'c72c9bb6-7372-4355-b488-0f51f8a5cecb', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:37:03.826 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 mdlog list --period c72c9bb6-7372-4355-b488-0f51f8a5cecb --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:37:03.915 INFO:teuthology.orchestra.run.gibba036.stdout:[{"id":"1_1613241414.718222_199.1","section":"bucket.instance","name":"ejuwhf-44:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4825.1","timestamp":"2021-02-13 18:36:54.718222131Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_hw5EkD84tA1hgLEiMagRdpw","ver":1},"status":{"status":"write"}}},{"id":"1_1613241414.734455_200.1","section":"bucket.instance","name":"ejuwhf-44:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4825.1","timestamp":"2021-02-13 18:36:54.734455728Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_hw5EkD84tA1hgLEiMagRdpw","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241414.740973_201.1","section":"bucket","name":"ejuwhf-44","timestamp":"2021-02-13 18:36:54.740973613Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_-xUQINeOXRwpAr2swwXXuom","ver":1},"status":{"status":"write"}}},{"id":"1_1613241414.757191_202.1","section":"bucket","name":"ejuwhf-44","timestamp":"2021-02-13 18:36:54.757191749Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_-xUQINeOXRwpAr2swwXXuom","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241414.806029_203.1","section":"bucket.instance","name":"ejuwhf-45:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4825.2","timestamp":"2021-02-13 18:36:54.806029958Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_x2IuEyVl4pmJjhEaBlNCGWs","ver":1},"status":{"status":"write"}}},{"id":"1_1613241414.822534_204.1","section":"bucket.instance","name":"ejuwhf-45:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4825.2","timestamp":"2021-02-13 18:36:54.822534980Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_x2IuEyVl4pmJjhEaBlNCGWs","ver":1},"status":{"status":"complete"}}},{"id":"1_1613241414.828777_205.1","section":"bucket","name":"ejuwhf-45","timestamp":"2021-02-13 18:36:54.828777477Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_xMWq_b8ZacmVHJHjS9aEQ0Y","ver":1},"status":{"status":"write"}}},{"id":"1_1613241414.844875_206.1","section":"bucket","name":"ejuwhf-45","timestamp":"2021-02-13 18:36:54.844875782Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_xMWq_b8ZacmVHJHjS9aEQ0Y","ver":1},"status":{"status":"complete"}}}] 2021-02-13T18:37:03.915 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'autotrim', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T18:37:03.915 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'autotrim', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T18:37:03.916 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog autotrim --cluster c1 --debug-rgw 0 --debug-ms 0 2021-02-13T18:37:04.034 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['mdlog', 'autotrim', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T18:37:04.034 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'mdlog', 'autotrim', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T18:37:04.034 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 mdlog autotrim --cluster c2 --debug-rgw 0 --debug-ms 0 2021-02-13T18:37:04.370 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'autotrim', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T18:37:04.370 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'autotrim', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T18:37:04.370 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog autotrim --cluster c1 --debug-rgw 0 --debug-ms 0 2021-02-13T18:37:04.461 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['mdlog', 'autotrim', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T18:37:04.461 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'mdlog', 'autotrim', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T18:37:04.462 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 mdlog autotrim --cluster c2 --debug-rgw 0 --debug-ms 0 2021-02-13T18:37:04.730 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'list', '--period', '138dc4ba-dc02-4957-87c3-e8bf2d80917c', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:37:04.730 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'list', '--period', '138dc4ba-dc02-4957-87c3-e8bf2d80917c', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:37:04.730 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog list --period 138dc4ba-dc02-4957-87c3-e8bf2d80917c --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:37:04.853 INFO:teuthology.orchestra.run.gibba025.stdout:[] 2021-02-13T18:37:04.853 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['mdlog', 'list', '--period', '138dc4ba-dc02-4957-87c3-e8bf2d80917c', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:37:04.854 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'mdlog', 'list', '--period', '138dc4ba-dc02-4957-87c3-e8bf2d80917c', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:37:04.854 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 mdlog list --period 138dc4ba-dc02-4957-87c3-e8bf2d80917c --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:37:04.938 INFO:teuthology.orchestra.run.gibba036.stdout:[] 2021-02-13T18:37:04.938 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'list', '--period', '138dc4ba-dc02-4957-87c3-e8bf2d80917c', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:37:04.938 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'list', '--period', '138dc4ba-dc02-4957-87c3-e8bf2d80917c', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:37:04.939 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog list --period 138dc4ba-dc02-4957-87c3-e8bf2d80917c --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:37:05.022 INFO:teuthology.orchestra.run.gibba025.stdout:[] 2021-02-13T18:37:05.023 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['mdlog', 'list', '--period', '138dc4ba-dc02-4957-87c3-e8bf2d80917c', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:37:05.023 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'mdlog', 'list', '--period', '138dc4ba-dc02-4957-87c3-e8bf2d80917c', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:37:05.023 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 mdlog list --period 138dc4ba-dc02-4957-87c3-e8bf2d80917c --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:37:05.146 INFO:teuthology.orchestra.run.gibba036.stdout:[] 2021-02-13T18:37:05.147 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'list', '--period', '87cf2a0e-b653-4b98-b23c-48172347acb4', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:37:05.147 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'list', '--period', '87cf2a0e-b653-4b98-b23c-48172347acb4', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:37:05.147 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog list --period 87cf2a0e-b653-4b98-b23c-48172347acb4 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:37:05.275 INFO:teuthology.orchestra.run.gibba025.stdout:[] 2021-02-13T18:37:05.275 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['mdlog', 'list', '--period', '87cf2a0e-b653-4b98-b23c-48172347acb4', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:37:05.275 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'mdlog', 'list', '--period', '87cf2a0e-b653-4b98-b23c-48172347acb4', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:37:05.275 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 mdlog list --period 87cf2a0e-b653-4b98-b23c-48172347acb4 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:37:05.394 INFO:teuthology.orchestra.run.gibba036.stdout:[] 2021-02-13T18:37:05.395 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'list', '--period', '87cf2a0e-b653-4b98-b23c-48172347acb4', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:37:05.395 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'list', '--period', '87cf2a0e-b653-4b98-b23c-48172347acb4', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:37:05.395 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog list --period 87cf2a0e-b653-4b98-b23c-48172347acb4 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:37:05.523 INFO:teuthology.orchestra.run.gibba025.stdout:[] 2021-02-13T18:37:05.523 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['mdlog', 'list', '--period', '87cf2a0e-b653-4b98-b23c-48172347acb4', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:37:05.524 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'mdlog', 'list', '--period', '87cf2a0e-b653-4b98-b23c-48172347acb4', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:37:05.524 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 mdlog list --period 87cf2a0e-b653-4b98-b23c-48172347acb4 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:37:05.607 INFO:teuthology.orchestra.run.gibba036.stdout:[] 2021-02-13T18:37:05.607 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'list', '--period', 'c72c9bb6-7372-4355-b488-0f51f8a5cecb', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:37:05.607 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'list', '--period', 'c72c9bb6-7372-4355-b488-0f51f8a5cecb', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:37:05.607 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog list --period c72c9bb6-7372-4355-b488-0f51f8a5cecb --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:37:05.730 INFO:teuthology.orchestra.run.gibba025.stdout:[] 2021-02-13T18:37:05.731 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['mdlog', 'list', '--period', 'c72c9bb6-7372-4355-b488-0f51f8a5cecb', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:37:05.731 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'mdlog', 'list', '--period', 'c72c9bb6-7372-4355-b488-0f51f8a5cecb', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:37:05.731 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 mdlog list --period c72c9bb6-7372-4355-b488-0f51f8a5cecb --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:37:05.815 INFO:teuthology.orchestra.run.gibba036.stdout:[] 2021-02-13T18:37:05.815 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'list', '--period', 'c72c9bb6-7372-4355-b488-0f51f8a5cecb', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:37:05.816 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'list', '--period', 'c72c9bb6-7372-4355-b488-0f51f8a5cecb', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:37:05.816 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog list --period c72c9bb6-7372-4355-b488-0f51f8a5cecb --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:37:05.942 INFO:teuthology.orchestra.run.gibba025.stdout:[] 2021-02-13T18:37:05.943 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['mdlog', 'list', '--period', 'c72c9bb6-7372-4355-b488-0f51f8a5cecb', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:37:05.943 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'mdlog', 'list', '--period', 'c72c9bb6-7372-4355-b488-0f51f8a5cecb', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:37:05.943 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 mdlog list --period c72c9bb6-7372-4355-b488-0f51f8a5cecb --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:37:06.040 INFO:teuthology.orchestra.run.gibba036.stdout:[] 2021-02-13T18:37:06.043 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.tests.test_multi_period_incremental_sync ... ok 2021-02-13T18:37:06.044 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=ejuwhf-46 2021-02-13T18:37:06.264 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=ejuwhf-47 2021-02-13T18:37:06.447 INFO:rgw_multi.tests:create bucket zone=test-zone3 name=ejuwhf-48 2021-02-13T18:37:06.784 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:37:06.785 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:37:06.785 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:37:06.907 INFO:teuthology.orchestra.run.gibba025.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613241426.640366_268.1","last_update":"2021-02-13 18:37:06.640366Z"},{"marker":"","last_update":"0.000000"}] 2021-02-13T18:37:06.907 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone2 source_zone=test-zone1 2021-02-13T18:37:06.907 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:37:06.908 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:37:06.908 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:37:07.002 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":9215454569906789344},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}},{"key":1,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1613241280.814980_234.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:34:40.814980Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}}]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:37:07.002 WARNING:rgw_multi.tests:data of zone test-zone2 behind zone test-zone1: shard=2 master=1_1613241426.640366_268.1 target=1_1613241280.814980_234.1 2021-02-13T18:37:12.003 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:37:12.003 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:37:12.003 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:37:12.095 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":9215454569906789344},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}},{"key":1,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1613241428.976090_273.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:37:08.976090Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}}]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:37:12.096 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone2 source_zone=test-zone1 2021-02-13T18:37:12.096 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:37:12.096 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:37:12.096 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:37:12.180 INFO:teuthology.orchestra.run.gibba025.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613241428.976090_273.1","last_update":"2021-02-13 18:37:08.976090Z"},{"marker":"","last_update":"0.000000"}] 2021-02-13T18:37:12.181 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone3 source_zone=test-zone1 2021-02-13T18:37:12.181 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:37:12.181 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:37:12.181 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 data sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:37:12.254 INFO:teuthology.orchestra.run.gibba025.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":14269803611187996617},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}},{"key":1,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1613241428.976090_273.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:37:08.976090Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}}]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:37:12.254 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone3 source_zone=test-zone1 2021-02-13T18:37:12.254 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:37:12.255 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:37:12.255 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:37:12.342 INFO:teuthology.orchestra.run.gibba025.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613241428.976090_273.1","last_update":"2021-02-13 18:37:08.976090Z"},{"marker":"","last_update":"0.000000"}] 2021-02-13T18:37:12.342 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone4 source_zone=test-zone1 2021-02-13T18:37:12.342 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:37:12.342 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:37:12.342 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:37:12.524 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":12459298034563774542},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}},{"key":1,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1613241428.976090_273.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:37:08.976090Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}}]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:37:12.524 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone4 source_zone=test-zone1 2021-02-13T18:37:12.525 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:37:12.525 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:37:12.525 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 datalog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:37:12.597 INFO:teuthology.orchestra.run.gibba036.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613241428.010277_87.1","last_update":"2021-02-13 18:37:08.010277Z"},{"marker":"","last_update":"0.000000"}] 2021-02-13T18:37:12.597 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone1 source_zone=test-zone2 2021-02-13T18:37:12.598 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:37:12.598 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:37:12.598 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 data sync status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:37:12.691 INFO:teuthology.orchestra.run.gibba025.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":8180628171309102746},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}},{"key":1,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1613241428.010277_87.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:37:08.010277Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}}]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:37:12.691 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone1 source_zone=test-zone2 2021-02-13T18:37:12.691 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:37:12.691 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:37:12.691 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 datalog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:37:12.775 INFO:teuthology.orchestra.run.gibba036.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613241428.010277_87.1","last_update":"2021-02-13 18:37:08.010277Z"},{"marker":"","last_update":"0.000000"}] 2021-02-13T18:37:12.775 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone3 source_zone=test-zone2 2021-02-13T18:37:12.775 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:37:12.775 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:37:12.776 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 data sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:37:12.901 INFO:teuthology.orchestra.run.gibba025.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":8104376224174622872},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}},{"key":1,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1613241428.010277_87.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:37:08.010277Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}}]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:37:12.901 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone3 source_zone=test-zone2 2021-02-13T18:37:12.901 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:37:12.902 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:37:12.902 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 datalog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:37:13.021 INFO:teuthology.orchestra.run.gibba036.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613241428.010277_87.1","last_update":"2021-02-13 18:37:08.010277Z"},{"marker":"","last_update":"0.000000"}] 2021-02-13T18:37:13.021 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone4 source_zone=test-zone2 2021-02-13T18:37:13.021 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:37:13.021 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:37:13.022 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:37:13.203 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:37:13.203 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:37:18.203 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:37:18.204 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:37:18.204 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:37:18.386 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:37:18.386 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:37:23.387 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:37:23.387 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:37:23.387 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:37:23.567 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:37:23.567 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:37:28.568 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:37:28.569 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:37:28.569 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:37:28.747 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:37:28.748 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:37:33.749 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:37:33.749 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:37:33.749 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:37:33.936 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:37:33.937 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:37:38.938 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:37:38.938 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:37:38.938 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:37:39.120 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:37:39.120 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:37:44.121 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:37:44.121 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:37:44.121 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:37:44.304 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:37:44.305 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:37:49.306 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:37:49.306 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:37:49.307 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:37:49.488 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:37:49.488 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:37:54.492 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:37:54.493 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:37:54.493 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:37:54.679 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:37:54.680 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:37:59.685 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:37:59.685 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:37:59.686 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:37:59.863 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:37:59.863 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:38:04.864 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:38:04.864 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:38:04.865 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:38:05.042 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:38:05.042 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:38:10.042 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:38:10.043 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:38:10.043 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:38:10.218 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:38:10.219 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:38:15.220 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:38:15.220 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:38:15.221 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:38:15.405 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:38:15.406 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:38:20.407 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:38:20.407 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:38:20.408 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:38:20.613 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:38:20.614 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:38:25.619 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:38:25.620 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:38:25.620 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:38:25.804 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:38:25.804 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:38:30.805 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:38:30.913 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:38:30.914 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:38:31.105 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:38:31.105 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:38:36.106 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:38:36.106 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:38:36.107 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:38:36.290 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:38:36.290 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:38:41.290 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:38:41.291 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:38:41.291 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:38:41.468 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:38:41.468 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:38:46.469 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:38:46.469 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:38:46.469 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:38:46.652 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:38:46.653 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:38:51.654 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:38:51.654 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:38:51.655 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:38:51.835 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:38:51.836 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:38:56.837 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:38:56.837 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:38:56.837 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:38:57.014 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:38:57.014 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:39:02.016 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:39:02.016 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:39:02.016 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:39:02.196 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:39:02.196 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:39:07.197 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:39:07.198 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:39:07.198 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:39:07.377 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:39:07.378 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:39:12.379 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:39:12.379 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:39:12.380 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:39:12.561 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:39:12.562 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:39:17.563 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:39:17.564 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:39:17.564 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:39:17.748 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:39:17.748 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:39:22.749 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:39:22.749 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:39:22.750 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:39:22.937 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:39:22.937 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:39:27.939 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:39:27.939 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:39:27.939 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:39:28.123 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:39:28.124 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:39:33.125 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:39:33.125 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:39:33.126 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:39:33.305 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:39:33.305 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:39:38.307 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:39:38.307 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:39:38.308 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:39:38.491 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:39:38.492 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:39:43.493 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:39:43.493 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:39:43.494 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:39:43.671 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:39:43.672 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:39:48.672 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:39:48.673 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:39:48.673 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:39:48.855 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:39:48.856 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:39:53.857 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:39:53.857 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:39:53.858 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:39:54.042 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:39:54.043 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:39:59.043 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:39:59.044 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:39:59.045 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:39:59.227 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:39:59.228 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:40:04.228 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:40:04.790 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:40:04.791 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:40:04.974 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:40:04.974 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:40:09.975 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:40:09.975 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:40:09.975 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:40:10.157 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:40:10.158 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:40:15.158 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:40:15.159 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:40:15.159 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:40:15.345 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:40:15.346 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:40:20.347 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:40:20.348 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:40:20.348 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:40:20.532 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:40:20.532 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:40:25.533 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:40:25.533 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:40:25.533 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:40:25.710 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:40:25.710 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:40:30.711 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:40:30.711 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:40:30.712 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:40:30.890 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:40:30.890 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:40:35.891 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:40:35.891 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:40:35.892 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:40:36.073 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:40:36.074 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:40:41.075 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:40:41.075 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:40:41.075 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:40:41.253 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:40:41.253 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:40:46.254 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:40:46.295 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:40:46.296 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:40:46.475 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:40:46.476 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:40:51.477 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:40:51.477 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:40:51.477 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:40:51.657 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:40:51.658 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:40:56.658 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:40:56.659 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:40:56.659 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:40:56.842 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:40:56.842 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:41:01.843 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:41:01.843 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:41:01.844 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:41:02.019 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:41:02.020 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:41:07.020 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:41:07.021 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:41:07.021 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:41:07.196 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:41:07.197 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:41:12.197 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:41:12.198 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:41:12.198 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:41:12.380 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:41:12.380 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:41:17.380 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:41:17.381 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:41:17.381 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:41:17.558 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:41:17.558 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:41:22.559 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:41:22.559 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:41:22.560 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:41:22.744 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:41:22.744 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:41:27.745 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:41:27.746 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:41:27.746 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:41:27.929 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:41:27.929 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:41:32.930 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:41:32.931 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:41:32.931 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:41:33.108 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:41:33.109 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:41:38.110 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:41:38.110 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:41:38.111 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:41:38.293 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:41:38.293 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:41:43.294 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:41:43.294 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:41:43.295 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:41:43.467 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:41:43.468 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:41:48.468 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:41:48.469 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:41:48.469 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:41:48.650 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:41:48.650 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:41:53.652 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:41:53.652 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:41:53.652 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:41:53.831 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:41:53.831 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:41:58.833 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:41:58.833 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:41:58.833 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:41:59.017 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:41:59.018 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:42:04.018 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:42:04.139 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:42:04.139 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:42:04.322 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:42:04.323 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:42:09.324 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:42:09.324 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:42:09.324 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:42:09.503 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:42:09.503 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:42:14.505 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:42:14.505 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:42:14.505 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:42:14.690 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:42:14.690 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:42:19.691 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:42:19.692 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:42:19.692 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:42:19.877 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:42:19.878 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:42:24.968 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.tests.test_datalog_autotrim ... FAIL 2021-02-13T18:42:24.969 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'modify', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--sync-from-all=false', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T18:42:24.969 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'modify', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--sync-from-all=false', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T18:42:24.969 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone modify --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --sync-from-all=false --cluster c2 --debug-rgw 0 --debug-ms 0 2021-02-13T18:42:25.016 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 18:42:25.012 7efe46793940 0 failed reading obj info from .rgw.root:zone_info.671230a8-4b04-4e98-83d8-0a04dcd55dc0: (2) No such file or directory 2021-02-13T18:42:25.017 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 18:42:25.012 7efe46793940 0 WARNING: could not read zone params for zone id=671230a8-4b04-4e98-83d8-0a04dcd55dc0 name=test-zone1 2021-02-13T18:42:25.017 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 18:42:25.012 7efe46793940 0 failed reading obj info from .rgw.root:zone_info.7441352a-0312-41b4-8a2a-b3cee61559db: (2) No such file or directory 2021-02-13T18:42:25.017 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 18:42:25.012 7efe46793940 0 WARNING: could not read zone params for zone id=7441352a-0312-41b4-8a2a-b3cee61559db name=test-zone3 2021-02-13T18:42:25.023 INFO:teuthology.orchestra.run.gibba036.stdout:{"id":"e658a22d-79d5-4296-b285-f122e7115b09","name":"test-zone2","domain_root":"test-zone2.rgw.meta:root","control_pool":"test-zone2.rgw.control","gc_pool":"test-zone2.rgw.log:gc","lc_pool":"test-zone2.rgw.log:lc","log_pool":"test-zone2.rgw.log","intent_log_pool":"test-zone2.rgw.log:intent","usage_log_pool":"test-zone2.rgw.log:usage","reshard_pool":"test-zone2.rgw.log:reshard","user_keys_pool":"test-zone2.rgw.meta:users.keys","user_email_pool":"test-zone2.rgw.meta:users.email","user_swift_pool":"test-zone2.rgw.meta:users.swift","user_uid_pool":"test-zone2.rgw.meta:users.uid","otp_pool":"test-zone2.rgw.otp","system_key":{"access_key":"UVQW931EG3AB4CYL","secret_key":"iSUph5ZNlZA0jRgR14y90OM0mpNVa9gv"},"placement_pools":[{"key":"default-placement","val":{"index_pool":"test-zone2.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"test-zone2.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"test-zone2.rgw.buckets.non-ec","index_type":0}}],"metadata_heap":"","realm_id":"c0c9dba8-b0a7-4e01-b0aa-e4c8b23f42b5"} 2021-02-13T18:42:25.023 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T18:42:25.023 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T18:42:25.024 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 period update --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c2 --debug-rgw 0 --debug-ms 0 2021-02-13T18:42:25.144 INFO:teuthology.orchestra.run.gibba036.stdout:Sending period to new master zone 671230a8-4b04-4e98-83d8-0a04dcd55dc0 2021-02-13T18:42:26.286 INFO:teuthology.orchestra.run.gibba036.stdout:{"id":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","epoch":2,"predecessor_uuid":"87cf2a0e-b653-4b98-b23c-48172347acb4","sync_status":["","","","1_1613241349.167298_97.1"],"period_map":{"id":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","zonegroups":[{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":"true","endpoints":["http://gibba025.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"671230a8-4b04-4e98-83d8-0a04dcd55dc0","zones":[{"id":"1bf208ef-d5d9-46b7-8924-f1c8f37c366c","name":"test-zone4","endpoints":["http://gibba036.front.sepia.ceph.com:8001"],"log_meta":"false","log_data":"true","bucket_index_max_shards":0,"read_only":"false","tier_type":"pubsub","sync_from_all":"false","sync_from":["test-zone1"],"redirect_zone":""},{"id":"671230a8-4b04-4e98-83d8-0a04dcd55dc0","name":"test-zone1","endpoints":["http://gibba025.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":0,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"7441352a-0312-41b4-8a2a-b3cee61559db","name":"test-zone3","endpoints":["http://gibba025.front.sepia.ceph.com:8001"],"log_meta":"false","log_data":"true","bucket_index_max_shards":0,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"e658a22d-79d5-4296-b285-f122e7115b09","name":"test-zone2","endpoints":["http://gibba036.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":0,"read_only":"false","tier_type":"","sync_from_all":"false","sync_from":[],"redirect_zone":""}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"c0c9dba8-b0a7-4e01-b0aa-e4c8b23f42b5"}],"short_zone_ids":[{"key":"1bf208ef-d5d9-46b7-8924-f1c8f37c366c","val":1463523823},{"key":"671230a8-4b04-4e98-83d8-0a04dcd55dc0","val":450442592},{"key":"7441352a-0312-41b4-8a2a-b3cee61559db","val":3844419010},{"key":"e658a22d-79d5-4296-b285-f122e7115b09","val":3525659260}]},"master_zonegroup":"test-zonegroup","master_zone":"671230a8-4b04-4e98-83d8-0a04dcd55dc0","period_config":{"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}},"realm_id":"c0c9dba8-b0a7-4e01-b0aa-e4c8b23f42b5","realm_name":"test-realm","realm_epoch":4} 2021-02-13T18:42:26.287 INFO:rgw_multi.tests:Set sync_from_all flag on zone test-zone2 to false 2021-02-13T18:43:26.288 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=ejuwhf-49 2021-02-13T18:43:26.427 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:43:26.428 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:43:26.429 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:43:26.539 INFO:teuthology.orchestra.run.gibba025.stderr:No --period given, using current period=c72c9bb6-7372-4355-b488-0f51f8a5cecb 2021-02-13T18:43:26.554 INFO:teuthology.orchestra.run.gibba025.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613241806.360050_256.1","last_update":"2021-02-13 18:43:26.360050Z"}] 2021-02-13T18:43:26.555 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-02-13T18:43:26.555 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:43:26.556 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:43:26.556 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:43:26.643 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613241426.554725_220.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:37:06.554725Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:43:26.643 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=3 master=1_1613241806.360050_256.1 target=1_1613241426.554725_220.1 2021-02-13T18:43:31.644 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:43:31.644 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:43:31.645 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:43:31.930 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613241426.554725_220.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:37:06.554725Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:43:31.930 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=3 master=1_1613241806.360050_256.1 target=1_1613241426.554725_220.1 2021-02-13T18:43:36.932 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:43:36.932 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:43:36.932 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:43:37.016 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613241426.554725_220.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:37:06.554725Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:43:37.017 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=3 master=1_1613241806.360050_256.1 target=1_1613241426.554725_220.1 2021-02-13T18:43:42.017 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:43:42.018 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:43:42.018 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:43:42.107 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613241426.554725_220.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:37:06.554725Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:43:42.107 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=3 master=1_1613241806.360050_256.1 target=1_1613241426.554725_220.1 2021-02-13T18:43:47.108 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:43:47.108 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:43:47.109 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:43:47.189 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613241426.554725_220.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:37:06.554725Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:43:47.259 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=3 master=1_1613241806.360050_256.1 target=1_1613241426.554725_220.1 2021-02-13T18:43:52.261 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:43:52.261 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:43:52.261 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:43:52.348 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613241426.554725_220.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:37:06.554725Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:43:52.348 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=3 master=1_1613241806.360050_256.1 target=1_1613241426.554725_220.1 2021-02-13T18:43:57.349 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:43:57.350 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:43:57.350 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:43:57.434 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613241426.554725_220.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:37:06.554725Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:43:57.434 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=3 master=1_1613241806.360050_256.1 target=1_1613241426.554725_220.1 2021-02-13T18:44:02.435 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:44:02.436 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:44:02.436 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:44:02.522 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613241806.360050_256.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:43:26.360050Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:44:02.522 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-02-13T18:44:02.522 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-02-13T18:44:02.522 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:44:02.523 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:44:02.523 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:44:02.611 INFO:teuthology.orchestra.run.gibba025.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613241806.360050_256.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:43:26.360050Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:44:02.611 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-02-13T18:44:02.611 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T18:44:02.611 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:44:02.611 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:44:02.612 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:44:02.795 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613241806.360050_256.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:43:26.360050Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:44:02.795 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T18:44:02.825 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'modify', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--redirect-zone=671230a8-4b04-4e98-83d8-0a04dcd55dc0', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T18:44:02.825 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'modify', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--redirect-zone=671230a8-4b04-4e98-83d8-0a04dcd55dc0', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T18:44:02.826 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone modify --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --redirect-zone=671230a8-4b04-4e98-83d8-0a04dcd55dc0 --cluster c2 --debug-rgw 0 --debug-ms 0 2021-02-13T18:44:02.901 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 18:44:02.897 7fa443a6e940 0 failed reading obj info from .rgw.root:zone_info.671230a8-4b04-4e98-83d8-0a04dcd55dc0: (2) No such file or directory 2021-02-13T18:44:02.901 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 18:44:02.897 7fa443a6e940 0 WARNING: could not read zone params for zone id=671230a8-4b04-4e98-83d8-0a04dcd55dc0 name=test-zone1 2021-02-13T18:44:02.901 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 18:44:02.897 7fa443a6e940 0 failed reading obj info from .rgw.root:zone_info.7441352a-0312-41b4-8a2a-b3cee61559db: (2) No such file or directory 2021-02-13T18:44:02.901 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 18:44:02.897 7fa443a6e940 0 WARNING: could not read zone params for zone id=7441352a-0312-41b4-8a2a-b3cee61559db name=test-zone3 2021-02-13T18:44:02.907 INFO:teuthology.orchestra.run.gibba036.stdout:{"id":"e658a22d-79d5-4296-b285-f122e7115b09","name":"test-zone2","domain_root":"test-zone2.rgw.meta:root","control_pool":"test-zone2.rgw.control","gc_pool":"test-zone2.rgw.log:gc","lc_pool":"test-zone2.rgw.log:lc","log_pool":"test-zone2.rgw.log","intent_log_pool":"test-zone2.rgw.log:intent","usage_log_pool":"test-zone2.rgw.log:usage","reshard_pool":"test-zone2.rgw.log:reshard","user_keys_pool":"test-zone2.rgw.meta:users.keys","user_email_pool":"test-zone2.rgw.meta:users.email","user_swift_pool":"test-zone2.rgw.meta:users.swift","user_uid_pool":"test-zone2.rgw.meta:users.uid","otp_pool":"test-zone2.rgw.otp","system_key":{"access_key":"UVQW931EG3AB4CYL","secret_key":"iSUph5ZNlZA0jRgR14y90OM0mpNVa9gv"},"placement_pools":[{"key":"default-placement","val":{"index_pool":"test-zone2.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"test-zone2.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"test-zone2.rgw.buckets.non-ec","index_type":0}}],"metadata_heap":"","realm_id":"c0c9dba8-b0a7-4e01-b0aa-e4c8b23f42b5"} 2021-02-13T18:44:02.907 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T18:44:02.908 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T18:44:02.908 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 period update --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c2 --debug-rgw 0 --debug-ms 0 2021-02-13T18:44:02.991 INFO:teuthology.orchestra.run.gibba036.stdout:Sending period to new master zone 671230a8-4b04-4e98-83d8-0a04dcd55dc0 2021-02-13T18:44:04.135 INFO:teuthology.orchestra.run.gibba036.stdout:{"id":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","epoch":3,"predecessor_uuid":"87cf2a0e-b653-4b98-b23c-48172347acb4","sync_status":["","","","1_1613241349.167298_97.1"],"period_map":{"id":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","zonegroups":[{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":"true","endpoints":["http://gibba025.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"671230a8-4b04-4e98-83d8-0a04dcd55dc0","zones":[{"id":"1bf208ef-d5d9-46b7-8924-f1c8f37c366c","name":"test-zone4","endpoints":["http://gibba036.front.sepia.ceph.com:8001"],"log_meta":"false","log_data":"true","bucket_index_max_shards":0,"read_only":"false","tier_type":"pubsub","sync_from_all":"false","sync_from":["test-zone1"],"redirect_zone":""},{"id":"671230a8-4b04-4e98-83d8-0a04dcd55dc0","name":"test-zone1","endpoints":["http://gibba025.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":0,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"7441352a-0312-41b4-8a2a-b3cee61559db","name":"test-zone3","endpoints":["http://gibba025.front.sepia.ceph.com:8001"],"log_meta":"false","log_data":"true","bucket_index_max_shards":0,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"e658a22d-79d5-4296-b285-f122e7115b09","name":"test-zone2","endpoints":["http://gibba036.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":0,"read_only":"false","tier_type":"","sync_from_all":"false","sync_from":[],"redirect_zone":"671230a8-4b04-4e98-83d8-0a04dcd55dc0"}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"c0c9dba8-b0a7-4e01-b0aa-e4c8b23f42b5"}],"short_zone_ids":[{"key":"1bf208ef-d5d9-46b7-8924-f1c8f37c366c","val":1463523823},{"key":"671230a8-4b04-4e98-83d8-0a04dcd55dc0","val":450442592},{"key":"7441352a-0312-41b4-8a2a-b3cee61559db","val":3844419010},{"key":"e658a22d-79d5-4296-b285-f122e7115b09","val":3525659260}]},"master_zonegroup":"test-zonegroup","master_zone":"671230a8-4b04-4e98-83d8-0a04dcd55dc0","period_config":{"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}},"realm_id":"c0c9dba8-b0a7-4e01-b0aa-e4c8b23f42b5","realm_name":"test-realm","realm_epoch":4} 2021-02-13T18:44:04.135 INFO:rgw_multi.tests:Set redirect_zone zone test-zone2 to "671230a8-4b04-4e98-83d8-0a04dcd55dc0" 2021-02-13T18:45:04.503 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'modify', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--sync-from-all=true', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T18:45:04.504 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'modify', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--sync-from-all=true', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T18:45:04.504 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone modify --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --sync-from-all=true --cluster c2 --debug-rgw 0 --debug-ms 0 2021-02-13T18:45:04.548 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 18:45:04.541 7f0446e87940 0 failed reading obj info from .rgw.root:zone_info.671230a8-4b04-4e98-83d8-0a04dcd55dc0: (2) No such file or directory 2021-02-13T18:45:04.549 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 18:45:04.541 7f0446e87940 0 WARNING: could not read zone params for zone id=671230a8-4b04-4e98-83d8-0a04dcd55dc0 name=test-zone1 2021-02-13T18:45:04.549 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 18:45:04.541 7f0446e87940 0 failed reading obj info from .rgw.root:zone_info.7441352a-0312-41b4-8a2a-b3cee61559db: (2) No such file or directory 2021-02-13T18:45:04.549 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 18:45:04.541 7f0446e87940 0 WARNING: could not read zone params for zone id=7441352a-0312-41b4-8a2a-b3cee61559db name=test-zone3 2021-02-13T18:45:04.555 INFO:teuthology.orchestra.run.gibba036.stdout:{"id":"e658a22d-79d5-4296-b285-f122e7115b09","name":"test-zone2","domain_root":"test-zone2.rgw.meta:root","control_pool":"test-zone2.rgw.control","gc_pool":"test-zone2.rgw.log:gc","lc_pool":"test-zone2.rgw.log:lc","log_pool":"test-zone2.rgw.log","intent_log_pool":"test-zone2.rgw.log:intent","usage_log_pool":"test-zone2.rgw.log:usage","reshard_pool":"test-zone2.rgw.log:reshard","user_keys_pool":"test-zone2.rgw.meta:users.keys","user_email_pool":"test-zone2.rgw.meta:users.email","user_swift_pool":"test-zone2.rgw.meta:users.swift","user_uid_pool":"test-zone2.rgw.meta:users.uid","otp_pool":"test-zone2.rgw.otp","system_key":{"access_key":"UVQW931EG3AB4CYL","secret_key":"iSUph5ZNlZA0jRgR14y90OM0mpNVa9gv"},"placement_pools":[{"key":"default-placement","val":{"index_pool":"test-zone2.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"test-zone2.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"test-zone2.rgw.buckets.non-ec","index_type":0}}],"metadata_heap":"","realm_id":"c0c9dba8-b0a7-4e01-b0aa-e4c8b23f42b5"} 2021-02-13T18:45:04.556 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T18:45:04.556 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T18:45:04.557 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 period update --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c2 --debug-rgw 0 --debug-ms 0 2021-02-13T18:45:04.705 INFO:teuthology.orchestra.run.gibba036.stdout:Sending period to new master zone 671230a8-4b04-4e98-83d8-0a04dcd55dc0 2021-02-13T18:45:05.839 INFO:teuthology.orchestra.run.gibba036.stdout:{"id":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","epoch":4,"predecessor_uuid":"87cf2a0e-b653-4b98-b23c-48172347acb4","sync_status":["","","","1_1613241349.167298_97.1"],"period_map":{"id":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","zonegroups":[{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":"true","endpoints":["http://gibba025.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"671230a8-4b04-4e98-83d8-0a04dcd55dc0","zones":[{"id":"1bf208ef-d5d9-46b7-8924-f1c8f37c366c","name":"test-zone4","endpoints":["http://gibba036.front.sepia.ceph.com:8001"],"log_meta":"false","log_data":"true","bucket_index_max_shards":0,"read_only":"false","tier_type":"pubsub","sync_from_all":"false","sync_from":["test-zone1"],"redirect_zone":""},{"id":"671230a8-4b04-4e98-83d8-0a04dcd55dc0","name":"test-zone1","endpoints":["http://gibba025.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":0,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"7441352a-0312-41b4-8a2a-b3cee61559db","name":"test-zone3","endpoints":["http://gibba025.front.sepia.ceph.com:8001"],"log_meta":"false","log_data":"true","bucket_index_max_shards":0,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"e658a22d-79d5-4296-b285-f122e7115b09","name":"test-zone2","endpoints":["http://gibba036.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":0,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":"671230a8-4b04-4e98-83d8-0a04dcd55dc0"}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"c0c9dba8-b0a7-4e01-b0aa-e4c8b23f42b5"}],"short_zone_ids":[{"key":"1bf208ef-d5d9-46b7-8924-f1c8f37c366c","val":1463523823},{"key":"671230a8-4b04-4e98-83d8-0a04dcd55dc0","val":450442592},{"key":"7441352a-0312-41b4-8a2a-b3cee61559db","val":3844419010},{"key":"e658a22d-79d5-4296-b285-f122e7115b09","val":3525659260}]},"master_zonegroup":"test-zonegroup","master_zone":"671230a8-4b04-4e98-83d8-0a04dcd55dc0","period_config":{"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}},"realm_id":"c0c9dba8-b0a7-4e01-b0aa-e4c8b23f42b5","realm_name":"test-realm","realm_epoch":4} 2021-02-13T18:45:05.840 INFO:rgw_multi.tests:Set sync_from_all flag on zone test-zone2 to true 2021-02-13T18:46:05.841 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'modify', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--redirect-zone=', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T18:46:05.841 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'modify', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--redirect-zone=', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T18:46:05.841 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone modify --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --redirect-zone= --cluster c2 --debug-rgw 0 --debug-ms 0 2021-02-13T18:46:05.887 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 18:46:05.881 7f3d93c79940 0 failed reading obj info from .rgw.root:zone_info.671230a8-4b04-4e98-83d8-0a04dcd55dc0: (2) No such file or directory 2021-02-13T18:46:05.888 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 18:46:05.881 7f3d93c79940 0 WARNING: could not read zone params for zone id=671230a8-4b04-4e98-83d8-0a04dcd55dc0 name=test-zone1 2021-02-13T18:46:05.888 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 18:46:05.881 7f3d93c79940 0 failed reading obj info from .rgw.root:zone_info.7441352a-0312-41b4-8a2a-b3cee61559db: (2) No such file or directory 2021-02-13T18:46:05.888 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 18:46:05.881 7f3d93c79940 0 WARNING: could not read zone params for zone id=7441352a-0312-41b4-8a2a-b3cee61559db name=test-zone3 2021-02-13T18:46:05.894 INFO:teuthology.orchestra.run.gibba036.stdout:{"id":"e658a22d-79d5-4296-b285-f122e7115b09","name":"test-zone2","domain_root":"test-zone2.rgw.meta:root","control_pool":"test-zone2.rgw.control","gc_pool":"test-zone2.rgw.log:gc","lc_pool":"test-zone2.rgw.log:lc","log_pool":"test-zone2.rgw.log","intent_log_pool":"test-zone2.rgw.log:intent","usage_log_pool":"test-zone2.rgw.log:usage","reshard_pool":"test-zone2.rgw.log:reshard","user_keys_pool":"test-zone2.rgw.meta:users.keys","user_email_pool":"test-zone2.rgw.meta:users.email","user_swift_pool":"test-zone2.rgw.meta:users.swift","user_uid_pool":"test-zone2.rgw.meta:users.uid","otp_pool":"test-zone2.rgw.otp","system_key":{"access_key":"UVQW931EG3AB4CYL","secret_key":"iSUph5ZNlZA0jRgR14y90OM0mpNVa9gv"},"placement_pools":[{"key":"default-placement","val":{"index_pool":"test-zone2.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"test-zone2.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"test-zone2.rgw.buckets.non-ec","index_type":0}}],"metadata_heap":"","realm_id":"c0c9dba8-b0a7-4e01-b0aa-e4c8b23f42b5"} 2021-02-13T18:46:05.894 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T18:46:05.894 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T18:46:05.894 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 period update --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c2 --debug-rgw 0 --debug-ms 0 2021-02-13T18:46:06.055 INFO:teuthology.orchestra.run.gibba036.stdout:Sending period to new master zone 671230a8-4b04-4e98-83d8-0a04dcd55dc0 2021-02-13T18:46:07.244 INFO:teuthology.orchestra.run.gibba036.stdout:{"id":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","epoch":5,"predecessor_uuid":"87cf2a0e-b653-4b98-b23c-48172347acb4","sync_status":["","","","1_1613241349.167298_97.1"],"period_map":{"id":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","zonegroups":[{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":"true","endpoints":["http://gibba025.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"671230a8-4b04-4e98-83d8-0a04dcd55dc0","zones":[{"id":"1bf208ef-d5d9-46b7-8924-f1c8f37c366c","name":"test-zone4","endpoints":["http://gibba036.front.sepia.ceph.com:8001"],"log_meta":"false","log_data":"true","bucket_index_max_shards":0,"read_only":"false","tier_type":"pubsub","sync_from_all":"false","sync_from":["test-zone1"],"redirect_zone":""},{"id":"671230a8-4b04-4e98-83d8-0a04dcd55dc0","name":"test-zone1","endpoints":["http://gibba025.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":0,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"7441352a-0312-41b4-8a2a-b3cee61559db","name":"test-zone3","endpoints":["http://gibba025.front.sepia.ceph.com:8001"],"log_meta":"false","log_data":"true","bucket_index_max_shards":0,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"e658a22d-79d5-4296-b285-f122e7115b09","name":"test-zone2","endpoints":["http://gibba036.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":0,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"c0c9dba8-b0a7-4e01-b0aa-e4c8b23f42b5"}],"short_zone_ids":[{"key":"1bf208ef-d5d9-46b7-8924-f1c8f37c366c","val":1463523823},{"key":"671230a8-4b04-4e98-83d8-0a04dcd55dc0","val":450442592},{"key":"7441352a-0312-41b4-8a2a-b3cee61559db","val":3844419010},{"key":"e658a22d-79d5-4296-b285-f122e7115b09","val":3525659260}]},"master_zonegroup":"test-zonegroup","master_zone":"671230a8-4b04-4e98-83d8-0a04dcd55dc0","period_config":{"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}},"realm_id":"c0c9dba8-b0a7-4e01-b0aa-e4c8b23f42b5","realm_name":"test-realm","realm_epoch":4} 2021-02-13T18:46:07.245 INFO:rgw_multi.tests:Set redirect_zone zone test-zone2 to "" 2021-02-13T18:47:07.246 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.tests.test_multi_zone_redirect ... ok 2021-02-13T18:47:07.247 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:47:07.247 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:47:07.248 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:47:07.312 INFO:teuthology.orchestra.run.gibba025.stderr:No --period given, using current period=c72c9bb6-7372-4355-b488-0f51f8a5cecb 2021-02-13T18:47:07.329 INFO:teuthology.orchestra.run.gibba025.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613241806.360050_256.1","last_update":"2021-02-13 18:43:26.360050Z"}] 2021-02-13T18:47:07.329 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-02-13T18:47:07.330 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:47:07.330 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:47:07.330 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:47:07.419 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613241806.360050_256.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:43:26.360050Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:47:07.419 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-02-13T18:47:07.419 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-02-13T18:47:07.419 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:47:07.420 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:47:07.420 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:47:07.538 INFO:teuthology.orchestra.run.gibba025.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613241806.360050_256.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:43:26.360050Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:47:07.538 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-02-13T18:47:07.539 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T18:47:07.539 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:47:07.539 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:47:07.539 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:47:07.756 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613241806.360050_256.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:43:26.360050Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:47:07.756 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T18:47:07.756 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'create', '--rgw-zone', 'remove', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--access-key', 'UVQW931EG3AB4CYL', '--secret', 'iSUph5ZNlZA0jRgR14y90OM0mpNVa9gv', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T18:47:07.756 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'create', '--rgw-zone', 'remove', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--access-key', 'UVQW931EG3AB4CYL', '--secret', 'iSUph5ZNlZA0jRgR14y90OM0mpNVa9gv', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T18:47:07.757 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone create --rgw-zone remove --rgw-zonegroup test-zonegroup --rgw-realm test-realm --access-key UVQW931EG3AB4CYL --secret iSUph5ZNlZA0jRgR14y90OM0mpNVa9gv --cluster c2 --debug-rgw 0 --debug-ms 0 2021-02-13T18:47:07.806 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 18:47:07.801 7f6f28a48940 0 failed reading obj info from .rgw.root:zone_info.671230a8-4b04-4e98-83d8-0a04dcd55dc0: (2) No such file or directory 2021-02-13T18:47:07.807 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 18:47:07.801 7f6f28a48940 0 WARNING: could not read zone params for zone id=671230a8-4b04-4e98-83d8-0a04dcd55dc0 name=test-zone1 2021-02-13T18:47:07.807 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 18:47:07.801 7f6f28a48940 0 failed reading obj info from .rgw.root:zone_info.7441352a-0312-41b4-8a2a-b3cee61559db: (2) No such file or directory 2021-02-13T18:47:07.807 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 18:47:07.801 7f6f28a48940 0 WARNING: could not read zone params for zone id=7441352a-0312-41b4-8a2a-b3cee61559db name=test-zone3 2021-02-13T18:47:07.810 INFO:teuthology.orchestra.run.gibba036.stdout:{"id":"8f3e73dd-2fde-4d48-8874-dfd0ddb6311f","name":"remove","domain_root":"remove.rgw.meta:root","control_pool":"remove.rgw.control","gc_pool":"remove.rgw.log:gc","lc_pool":"remove.rgw.log:lc","log_pool":"remove.rgw.log","intent_log_pool":"remove.rgw.log:intent","usage_log_pool":"remove.rgw.log:usage","reshard_pool":"remove.rgw.log:reshard","user_keys_pool":"remove.rgw.meta:users.keys","user_email_pool":"remove.rgw.meta:users.email","user_swift_pool":"remove.rgw.meta:users.swift","user_uid_pool":"remove.rgw.meta:users.uid","otp_pool":"remove.rgw.otp","system_key":{"access_key":"UVQW931EG3AB4CYL","secret_key":"iSUph5ZNlZA0jRgR14y90OM0mpNVa9gv"},"placement_pools":[{"key":"default-placement","val":{"index_pool":"remove.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"remove.rgw.buckets.data"}},"data_extra_pool":"remove.rgw.buckets.non-ec","index_type":0}}],"metadata_heap":"","realm_id":"c0c9dba8-b0a7-4e01-b0aa-e4c8b23f42b5"} 2021-02-13T18:47:07.811 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['period', 'update', '--rgw-zone', 'remove', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T18:47:07.811 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'period', 'update', '--rgw-zone', 'remove', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T18:47:07.811 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 period update --rgw-zone remove --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c2 --debug-rgw 0 --debug-ms 0 2021-02-13T18:47:12.977 INFO:teuthology.orchestra.run.gibba036.stdout:Sending period to new master zone 671230a8-4b04-4e98-83d8-0a04dcd55dc0 2021-02-13T18:47:14.043 INFO:teuthology.orchestra.run.gibba036.stdout:{"id":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","epoch":6,"predecessor_uuid":"87cf2a0e-b653-4b98-b23c-48172347acb4","sync_status":["","","","1_1613241349.167298_97.1"],"period_map":{"id":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","zonegroups":[{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":"true","endpoints":["http://gibba025.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"671230a8-4b04-4e98-83d8-0a04dcd55dc0","zones":[{"id":"1bf208ef-d5d9-46b7-8924-f1c8f37c366c","name":"test-zone4","endpoints":["http://gibba036.front.sepia.ceph.com:8001"],"log_meta":"false","log_data":"true","bucket_index_max_shards":0,"read_only":"false","tier_type":"pubsub","sync_from_all":"false","sync_from":["test-zone1"],"redirect_zone":""},{"id":"671230a8-4b04-4e98-83d8-0a04dcd55dc0","name":"test-zone1","endpoints":["http://gibba025.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":0,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"7441352a-0312-41b4-8a2a-b3cee61559db","name":"test-zone3","endpoints":["http://gibba025.front.sepia.ceph.com:8001"],"log_meta":"false","log_data":"true","bucket_index_max_shards":0,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"8f3e73dd-2fde-4d48-8874-dfd0ddb6311f","name":"remove","endpoints":[],"log_meta":"false","log_data":"true","bucket_index_max_shards":0,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"e658a22d-79d5-4296-b285-f122e7115b09","name":"test-zone2","endpoints":["http://gibba036.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":0,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"c0c9dba8-b0a7-4e01-b0aa-e4c8b23f42b5"}],"short_zone_ids":[{"key":"1bf208ef-d5d9-46b7-8924-f1c8f37c366c","val":1463523823},{"key":"671230a8-4b04-4e98-83d8-0a04dcd55dc0","val":450442592},{"key":"7441352a-0312-41b4-8a2a-b3cee61559db","val":3844419010},{"key":"8f3e73dd-2fde-4d48-8874-dfd0ddb6311f","val":3971352646},{"key":"e658a22d-79d5-4296-b285-f122e7115b09","val":3525659260}]},"master_zonegroup":"test-zonegroup","master_zone":"671230a8-4b04-4e98-83d8-0a04dcd55dc0","period_config":{"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}},"realm_id":"c0c9dba8-b0a7-4e01-b0aa-e4c8b23f42b5","realm_name":"test-realm","realm_epoch":4} 2021-02-13T18:47:14.043 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zonegroup', 'remove', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--rgw-zone', 'remove', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T18:47:14.044 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zonegroup', 'remove', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--rgw-zone', 'remove', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T18:47:14.044 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zonegroup remove --rgw-zonegroup test-zonegroup --rgw-realm test-realm --rgw-zone remove --cluster c1 --debug-rgw 0 --debug-ms 0 2021-02-13T18:47:14.089 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 18:47:14.084 7f1a8d09b940 0 failed reading obj info from .rgw.root:zone_info.1bf208ef-d5d9-46b7-8924-f1c8f37c366c: (2) No such file or directory 2021-02-13T18:47:14.089 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 18:47:14.084 7f1a8d09b940 0 WARNING: could not read zone params for zone id=1bf208ef-d5d9-46b7-8924-f1c8f37c366c name=test-zone4 2021-02-13T18:47:14.089 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 18:47:14.084 7f1a8d09b940 0 failed reading obj info from .rgw.root:zone_info.e658a22d-79d5-4296-b285-f122e7115b09: (2) No such file or directory 2021-02-13T18:47:14.089 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 18:47:14.084 7f1a8d09b940 0 WARNING: could not read zone params for zone id=e658a22d-79d5-4296-b285-f122e7115b09 name=test-zone2 2021-02-13T18:47:14.093 INFO:teuthology.orchestra.run.gibba025.stdout:{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":"true","endpoints":["http://gibba025.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"671230a8-4b04-4e98-83d8-0a04dcd55dc0","zones":[{"id":"1bf208ef-d5d9-46b7-8924-f1c8f37c366c","name":"test-zone4","endpoints":["http://gibba036.front.sepia.ceph.com:8001"],"log_meta":"false","log_data":"true","bucket_index_max_shards":0,"read_only":"false","tier_type":"pubsub","sync_from_all":"false","sync_from":["test-zone1"],"redirect_zone":""},{"id":"671230a8-4b04-4e98-83d8-0a04dcd55dc0","name":"test-zone1","endpoints":["http://gibba025.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":0,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"7441352a-0312-41b4-8a2a-b3cee61559db","name":"test-zone3","endpoints":["http://gibba025.front.sepia.ceph.com:8001"],"log_meta":"false","log_data":"true","bucket_index_max_shards":0,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"e658a22d-79d5-4296-b285-f122e7115b09","name":"test-zone2","endpoints":["http://gibba036.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":0,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"c0c9dba8-b0a7-4e01-b0aa-e4c8b23f42b5"} 2021-02-13T18:47:14.094 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zonegroup', 'remove', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--rgw-zone', 'remove', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T18:47:14.094 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zonegroup', 'remove', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--rgw-zone', 'remove', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T18:47:14.094 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zonegroup remove --rgw-zonegroup test-zonegroup --rgw-realm test-realm --rgw-zone remove --cluster c1 --debug-rgw 0 --debug-ms 0 2021-02-13T18:47:14.128 INFO:teuthology.orchestra.run.gibba025.stderr:zone name remove not found in zonegroup test-zonegroup 2021-02-13T18:47:14.130 DEBUG:teuthology.orchestra.run:got remote process result: 2 2021-02-13T18:47:14.131 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'delete', '--rgw-zone', 'remove', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T18:47:14.131 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'delete', '--rgw-zone', 'remove', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T18:47:14.131 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone delete --rgw-zone remove --cluster c2 --debug-rgw 0 --debug-ms 0 2021-02-13T18:47:14.215 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 18:47:14.209 7f126891b940 0 failed reading obj info from .rgw.root:zone_info.671230a8-4b04-4e98-83d8-0a04dcd55dc0: (2) No such file or directory 2021-02-13T18:47:14.216 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 18:47:14.209 7f126891b940 0 WARNING: could not read zone params for zone id=671230a8-4b04-4e98-83d8-0a04dcd55dc0 name=test-zone1 2021-02-13T18:47:14.216 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 18:47:14.209 7f126891b940 0 failed reading obj info from .rgw.root:zone_info.7441352a-0312-41b4-8a2a-b3cee61559db: (2) No such file or directory 2021-02-13T18:47:14.216 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 18:47:14.209 7f126891b940 0 WARNING: could not read zone params for zone id=7441352a-0312-41b4-8a2a-b3cee61559db name=test-zone3 2021-02-13T18:47:14.218 INFO:teuthology.orchestra.run.gibba036.stderr:2021-02-13 18:47:14.213 7f126891b940 0 zone id 8f3e73dd-2fde-4d48-8874-dfd0ddb6311f is not a part of zonegroup default 2021-02-13T18:47:14.224 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['period', 'update', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T18:47:14.224 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'period', 'update', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T18:47:14.224 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 period update --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c1 --debug-rgw 0 --debug-ms 0 2021-02-13T18:47:14.267 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 18:47:14.260 7f5be2e24940 0 WARNING: can't generate connection for zone 8f3e73dd-2fde-4d48-8874-dfd0ddb6311f id remove: no endpoints defined 2021-02-13T18:47:14.305 INFO:tasks.rgw.c1.client.1.gibba025.stdout:2021-02-13 18:47:14.300 7f5123778700 -1 failed to decode period 2021-02-13T18:47:14.306 INFO:tasks.rgw.c2.client.1.gibba036.stdout:2021-02-13 18:47:14.297 7fa40819e700 -1 failed to decode period 2021-02-13T18:47:14.306 INFO:tasks.rgw.c2.client.0.gibba036.stdout:2021-02-13 18:47:14.297 7f3542781700 -1 failed to decode period 2021-02-13T18:47:14.317 INFO:teuthology.orchestra.run.gibba025.stdout:{"id":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","epoch":7,"predecessor_uuid":"87cf2a0e-b653-4b98-b23c-48172347acb4","sync_status":["","","","1_1613241349.167298_97.1"],"period_map":{"id":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","zonegroups":[{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":"true","endpoints":["http://gibba025.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"671230a8-4b04-4e98-83d8-0a04dcd55dc0","zones":[{"id":"1bf208ef-d5d9-46b7-8924-f1c8f37c366c","name":"test-zone4","endpoints":["http://gibba036.front.sepia.ceph.com:8001"],"log_meta":"false","log_data":"true","bucket_index_max_shards":0,"read_only":"false","tier_type":"pubsub","sync_from_all":"false","sync_from":["test-zone1"],"redirect_zone":""},{"id":"671230a8-4b04-4e98-83d8-0a04dcd55dc0","name":"test-zone1","endpoints":["http://gibba025.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":0,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"7441352a-0312-41b4-8a2a-b3cee61559db","name":"test-zone3","endpoints":["http://gibba025.front.sepia.ceph.com:8001"],"log_meta":"false","log_data":"true","bucket_index_max_shards":0,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"e658a22d-79d5-4296-b285-f122e7115b09","name":"test-zone2","endpoints":["http://gibba036.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":0,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"c0c9dba8-b0a7-4e01-b0aa-e4c8b23f42b5"}],"short_zone_ids":[{"key":"1bf208ef-d5d9-46b7-8924-f1c8f37c366c","val":1463523823},{"key":"671230a8-4b04-4e98-83d8-0a04dcd55dc0","val":450442592},{"key":"7441352a-0312-41b4-8a2a-b3cee61559db","val":3844419010},{"key":"e658a22d-79d5-4296-b285-f122e7115b09","val":3525659260}]},"master_zonegroup":"test-zonegroup","master_zone":"671230a8-4b04-4e98-83d8-0a04dcd55dc0","period_config":{"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}},"realm_id":"c0c9dba8-b0a7-4e01-b0aa-e4c8b23f42b5","realm_name":"test-realm","realm_epoch":4} 2021-02-13T18:47:14.317 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.tests.test_zonegroup_remove ... ok 2021-02-13T18:47:14.317 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zonegroup', 'create', '--rgw-zonegroup', 'remove_zg', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T18:47:14.318 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zonegroup', 'create', '--rgw-zonegroup', 'remove_zg', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T18:47:14.318 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zonegroup create --rgw-zonegroup remove_zg --cluster c1 --debug-rgw 0 --debug-ms 0 2021-02-13T18:47:14.392 INFO:teuthology.orchestra.run.gibba025.stdout:{"id":"e8fc7bae-9fb5-44c6-bf1d-21723e12982b","name":"remove_zg","api_name":"remove_zg","is_master":"false","endpoints":[],"hostnames":[],"hostnames_s3website":[],"master_zone":"","zones":[],"placement_targets":[],"default_placement":"","realm_id":"c0c9dba8-b0a7-4e01-b0aa-e4c8b23f42b5"} 2021-02-13T18:47:14.392 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zone', 'create', '--rgw-zone', 'remove', '--rgw-zonegroup', 'remove_zg', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T18:47:14.392 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zone', 'create', '--rgw-zone', 'remove', '--rgw-zonegroup', 'remove_zg', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T18:47:14.392 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zone create --rgw-zone remove --rgw-zonegroup remove_zg --cluster c1 --debug-rgw 0 --debug-ms 0 2021-02-13T18:47:14.530 INFO:teuthology.orchestra.run.gibba025.stdout:{"id":"02372bda-8914-492f-b207-bdc5f31f55f5","name":"remove","domain_root":"remove.rgw.meta:root","control_pool":"remove.rgw.control","gc_pool":"remove.rgw.log:gc","lc_pool":"remove.rgw.log:lc","log_pool":"remove.rgw.log","intent_log_pool":"remove.rgw.log:intent","usage_log_pool":"remove.rgw.log:usage","reshard_pool":"remove.rgw.log:reshard","user_keys_pool":"remove.rgw.meta:users.keys","user_email_pool":"remove.rgw.meta:users.email","user_swift_pool":"remove.rgw.meta:users.swift","user_uid_pool":"remove.rgw.meta:users.uid","otp_pool":"remove.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"remove.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"remove.rgw.buckets.data"}},"data_extra_pool":"remove.rgw.buckets.non-ec","index_type":0}}],"metadata_heap":"","realm_id":"c0c9dba8-b0a7-4e01-b0aa-e4c8b23f42b5"} 2021-02-13T18:47:14.531 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['period', 'update', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T18:47:14.531 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'period', 'update', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T18:47:14.531 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 period update --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c1 --debug-rgw 0 --debug-ms 0 2021-02-13T18:47:14.851 INFO:tasks.rgw.c2.client.1.gibba036.stdout:2021-02-13 18:47:14.845 7fa40819e700 -1 failed to decode period 2021-02-13T18:47:14.852 INFO:tasks.rgw.c2.client.0.gibba036.stdout:2021-02-13 18:47:14.845 7f3542781700 -1 failed to decode period 2021-02-13T18:47:14.852 INFO:tasks.rgw.c1.client.1.gibba025.stdout:2021-02-13 18:47:14.844 7f5123778700 -1 failed to decode period 2021-02-13T18:47:14.868 INFO:teuthology.orchestra.run.gibba025.stdout:{"id":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","epoch":8,"predecessor_uuid":"87cf2a0e-b653-4b98-b23c-48172347acb4","sync_status":["","","","1_1613241349.167298_97.1"],"period_map":{"id":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","zonegroups":[{"id":"e8fc7bae-9fb5-44c6-bf1d-21723e12982b","name":"remove_zg","api_name":"remove_zg","is_master":"false","endpoints":[],"hostnames":[],"hostnames_s3website":[],"master_zone":"02372bda-8914-492f-b207-bdc5f31f55f5","zones":[{"id":"02372bda-8914-492f-b207-bdc5f31f55f5","name":"remove","endpoints":[],"log_meta":"false","log_data":"false","bucket_index_max_shards":0,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"c0c9dba8-b0a7-4e01-b0aa-e4c8b23f42b5"},{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":"true","endpoints":["http://gibba025.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"671230a8-4b04-4e98-83d8-0a04dcd55dc0","zones":[{"id":"1bf208ef-d5d9-46b7-8924-f1c8f37c366c","name":"test-zone4","endpoints":["http://gibba036.front.sepia.ceph.com:8001"],"log_meta":"false","log_data":"true","bucket_index_max_shards":0,"read_only":"false","tier_type":"pubsub","sync_from_all":"false","sync_from":["test-zone1"],"redirect_zone":""},{"id":"671230a8-4b04-4e98-83d8-0a04dcd55dc0","name":"test-zone1","endpoints":["http://gibba025.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":0,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"7441352a-0312-41b4-8a2a-b3cee61559db","name":"test-zone3","endpoints":["http://gibba025.front.sepia.ceph.com:8001"],"log_meta":"false","log_data":"true","bucket_index_max_shards":0,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"e658a22d-79d5-4296-b285-f122e7115b09","name":"test-zone2","endpoints":["http://gibba036.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":0,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"c0c9dba8-b0a7-4e01-b0aa-e4c8b23f42b5"}],"short_zone_ids":[{"key":"02372bda-8914-492f-b207-bdc5f31f55f5","val":2197243942},{"key":"1bf208ef-d5d9-46b7-8924-f1c8f37c366c","val":1463523823},{"key":"671230a8-4b04-4e98-83d8-0a04dcd55dc0","val":450442592},{"key":"7441352a-0312-41b4-8a2a-b3cee61559db","val":3844419010},{"key":"e658a22d-79d5-4296-b285-f122e7115b09","val":3525659260}]},"master_zonegroup":"test-zonegroup","master_zone":"671230a8-4b04-4e98-83d8-0a04dcd55dc0","period_config":{"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}},"realm_id":"c0c9dba8-b0a7-4e01-b0aa-e4c8b23f42b5","realm_name":"test-realm","realm_epoch":4} 2021-02-13T18:47:14.868 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zone', 'delete', '--rgw-zone', 'remove', '--rgw-zonegroup', 'remove_zg', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T18:47:14.868 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zone', 'delete', '--rgw-zone', 'remove', '--rgw-zonegroup', 'remove_zg', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T18:47:14.868 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zone delete --rgw-zone remove --rgw-zonegroup remove_zg --cluster c1 --debug-rgw 0 --debug-ms 0 2021-02-13T18:47:14.911 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 18:47:14.904 7f15e2bbf940 0 zone id 02372bda-8914-492f-b207-bdc5f31f55f5 is not a part of zonegroup test-zonegroup 2021-02-13T18:47:14.911 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 18:47:14.904 7f15e2bbf940 0 zone id 02372bda-8914-492f-b207-bdc5f31f55f5 is not a part of zonegroup default 2021-02-13T18:47:14.917 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['period', 'update', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T18:47:14.917 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'period', 'update', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T18:47:14.917 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 period update --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 2021-02-13T18:47:14.998 INFO:teuthology.orchestra.run.gibba025.stderr:2021-02-13 18:47:14.992 7f61192c5940 0 ERROR: zonegroup remove_zg has a non existent master zone 2021-02-13T18:47:15.001 DEBUG:teuthology.orchestra.run:got remote process result: 22 2021-02-13T18:47:15.001 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zonegroup', 'delete', '--rgw-zonegroup', 'remove_zg', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T18:47:15.001 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zonegroup', 'delete', '--rgw-zonegroup', 'remove_zg', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T18:47:15.001 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zonegroup delete --rgw-zonegroup remove_zg --cluster c1 --debug-rgw 0 --debug-ms 0 2021-02-13T18:47:15.080 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['period', 'update', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T18:47:15.080 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'period', 'update', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T18:47:15.080 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 period update --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c1 --debug-rgw 0 --debug-ms 0 2021-02-13T18:47:15.205 INFO:tasks.rgw.c1.client.1.gibba025.stdout:2021-02-13 18:47:15.200 7f5123778700 -1 failed to decode period 2021-02-13T18:47:15.205 INFO:tasks.rgw.c2.client.1.gibba036.stdout:2021-02-13 18:47:15.201 7fa40819e700 -1 failed to decode period 2021-02-13T18:47:15.205 INFO:tasks.rgw.c2.client.0.gibba036.stdout:2021-02-13 18:47:15.201 7f3542781700 -1 failed to decode period 2021-02-13T18:47:15.217 INFO:teuthology.orchestra.run.gibba025.stdout:{"id":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","epoch":9,"predecessor_uuid":"87cf2a0e-b653-4b98-b23c-48172347acb4","sync_status":["","","","1_1613241349.167298_97.1"],"period_map":{"id":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","zonegroups":[{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":"true","endpoints":["http://gibba025.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"671230a8-4b04-4e98-83d8-0a04dcd55dc0","zones":[{"id":"1bf208ef-d5d9-46b7-8924-f1c8f37c366c","name":"test-zone4","endpoints":["http://gibba036.front.sepia.ceph.com:8001"],"log_meta":"false","log_data":"true","bucket_index_max_shards":0,"read_only":"false","tier_type":"pubsub","sync_from_all":"false","sync_from":["test-zone1"],"redirect_zone":""},{"id":"671230a8-4b04-4e98-83d8-0a04dcd55dc0","name":"test-zone1","endpoints":["http://gibba025.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":0,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"7441352a-0312-41b4-8a2a-b3cee61559db","name":"test-zone3","endpoints":["http://gibba025.front.sepia.ceph.com:8001"],"log_meta":"false","log_data":"true","bucket_index_max_shards":0,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"e658a22d-79d5-4296-b285-f122e7115b09","name":"test-zone2","endpoints":["http://gibba036.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":0,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"c0c9dba8-b0a7-4e01-b0aa-e4c8b23f42b5"}],"short_zone_ids":[{"key":"1bf208ef-d5d9-46b7-8924-f1c8f37c366c","val":1463523823},{"key":"671230a8-4b04-4e98-83d8-0a04dcd55dc0","val":450442592},{"key":"7441352a-0312-41b4-8a2a-b3cee61559db","val":3844419010},{"key":"e658a22d-79d5-4296-b285-f122e7115b09","val":3525659260}]},"master_zonegroup":"test-zonegroup","master_zone":"671230a8-4b04-4e98-83d8-0a04dcd55dc0","period_config":{"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}},"realm_id":"c0c9dba8-b0a7-4e01-b0aa-e4c8b23f42b5","realm_name":"test-realm","realm_epoch":4} 2021-02-13T18:47:15.217 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.tests.test_zg_master_zone_delete ... ok 2021-02-13T18:47:15.218 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=ejuwhf-50 2021-02-13T18:47:15.559 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=ejuwhf-51 2021-02-13T18:47:15.602 INFO:rgw_multi.tests:create bucket zone=test-zone3 name=ejuwhf-52 2021-02-13T18:47:15.631 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=ejuwhf-53 2021-02-13T18:47:15.645 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=ejuwhf-54 2021-02-13T18:47:15.693 INFO:rgw_multi.tests:create bucket zone=test-zone3 name=ejuwhf-55 2021-02-13T18:47:19.011 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.tests.test_set_bucket_website ... tasks.rgw_multi.tests.test_set_bucket_policy ... ok 2021-02-13T18:47:19.012 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=ejuwhf-56 2021-02-13T18:47:19.666 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=ejuwhf-57 2021-02-13T18:47:20.494 INFO:rgw_multi.tests:create bucket zone=test-zone3 name=ejuwhf-58 2021-02-13T18:47:21.587 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'disable', '--bucket', 'ejuwhf-56', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T18:47:21.587 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'disable', '--bucket', 'ejuwhf-56', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T18:47:21.588 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync disable --bucket ejuwhf-56 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 2021-02-13T18:47:21.715 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'disable', '--bucket', 'ejuwhf-57', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T18:47:21.715 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'disable', '--bucket', 'ejuwhf-57', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T18:47:21.715 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync disable --bucket ejuwhf-57 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 2021-02-13T18:47:21.810 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'disable', '--bucket', 'ejuwhf-58', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T18:47:21.810 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'disable', '--bucket', 'ejuwhf-58', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-02-13T18:47:21.810 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync disable --bucket ejuwhf-58 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 2021-02-13T18:47:21.911 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['log', 'list', '--rgw-zone', 'test-zone1', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:47:21.911 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'log', 'list', '--rgw-zone', 'test-zone1', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:47:21.911 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 log list --rgw-zone test-zone1 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:47:21.990 INFO:teuthology.orchestra.run.gibba025.stdout:["bucket.sync-status.e658a22d-79d5-4296-b285-f122e7115b09:ejuwhf-37:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.46","obj_delete_at_hint.0000000078","meta.history","bucket.sync-status.e658a22d-79d5-4296-b285-f122e7115b09:ejuwhf-11:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.20","2021-02-13-17-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.1-ejuwhf-1","obj_delete_at_hint.0000000070","obj_delete_at_hint.0000000104","2021-02-13-18-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4825.1-ejuwhf-44","obj_delete_at_hint.0000000026","2021-02-13-18-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.27-ejuwhf-18","2021-02-13-18-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.34-ejuwhf-25","obj_delete_at_hint.0000000028","2021-02-13-18-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.49-ejuwhf-40","2021-02-13-18-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.37-ejuwhf-28","bucket.sync-status.7441352a-0312-41b4-8a2a-b3cee61559db:ejuwhf-19:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.28","obj_delete_at_hint.0000000040","meta.full-sync.index.0","2021-02-13-17-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.2-ejuwhf-2","data.full-sync.index.7441352a-0312-41b4-8a2a-b3cee61559db.3","obj_delete_at_hint.0000000015","bucket.sync-status.7441352a-0312-41b4-8a2a-b3cee61559db:ejuwhf-13:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.22","obj_delete_at_hint.0000000069","obj_delete_at_hint.0000000095","obj_delete_at_hint.0000000003","obj_delete_at_hint.0000000047","bucket.sync-status.e658a22d-79d5-4296-b285-f122e7115b09:ejuwhf-46:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4825.3","2021-02-13-18-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.24-ejuwhf-15","obj_delete_at_hint.0000000035","bucket.sync-status.7441352a-0312-41b4-8a2a-b3cee61559db:ejuwhf-14:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.23","obj_delete_at_hint.0000000037","obj_delete_at_hint.0000000024","obj_delete_at_hint.0000000000","obj_delete_at_hint.0000000031","2021-02-13-17-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.21-ejuwhf-12","2021-02-13-18-671230a8-4b04-4e98-83d8-0a04dcd55dc0.5112.8-ejuwhf-57","bucket.sync-status.e658a22d-79d5-4296-b285-f122e7115b09:ejuwhf-23:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.32","datalog.sync-status.shard.e658a22d-79d5-4296-b285-f122e7115b09.3","bucket.sync-status.7441352a-0312-41b4-8a2a-b3cee61559db:ejuwhf-37:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.46","bucket.sync-status.e658a22d-79d5-4296-b285-f122e7115b09:ejuwhf-15:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.24","obj_delete_at_hint.0000000076","obj_delete_at_hint.0000000113","obj_delete_at_hint.0000000005","obj_delete_at_hint.0000000011","obj_delete_at_hint.0000000058","obj_delete_at_hint.0000000052","2021-02-13-18-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.48-ejuwhf-39","2021-02-13-18-671230a8-4b04-4e98-83d8-0a04dcd55dc0.5112.6-ejuwhf-55","2021-02-13-17-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.20-ejuwhf-11","2021-02-13-18-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.31-ejuwhf-22","bucket.sync-status.e658a22d-79d5-4296-b285-f122e7115b09:ejuwhf-49:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4973.1","2021-02-13-18-671230a8-4b04-4e98-83d8-0a04dcd55dc0.5112.7-ejuwhf-56","obj_delete_at_hint.0000000088","obj_delete_at_hint.0000000080","obj_delete_at_hint.0000000090","obj_delete_at_hint.0000000110","2021-02-13-18-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.44-ejuwhf-35","2021-02-13-18-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.33-ejuwhf-24","obj_delete_at_hint.0000000096","obj_delete_at_hint.0000000087","obj_delete_at_hint.0000000008","obj_delete_at_hint.0000000006","obj_delete_at_hint.0000000029","obj_delete_at_hint.0000000089","obj_delete_at_hint.0000000022","bilog.trim","obj_delete_at_hint.0000000016","2021-02-13-17-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.4-ejuwhf-4","obj_delete_at_hint.0000000041","2021-02-13-18-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4825.3-ejuwhf-46","2021-02-13-18-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.45-ejuwhf-36","datalog.sync-status.shard.7441352a-0312-41b4-8a2a-b3cee61559db.3.retry","obj_delete_at_hint.0000000018","2021-02-13-17-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.19-ejuwhf-10","obj_delete_at_hint.0000000092","2021-02-13-18-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.39-ejuwhf-30","bucket.sync-status.e658a22d-79d5-4296-b285-f122e7115b09:ejuwhf-22:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.31","2021-02-13-18-e658a22d-79d5-4296-b285-f122e7115b09.7499.2-ejuwhf-43","2021-02-13-18-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.50-ejuwhf-41","data.full-sync.index.e658a22d-79d5-4296-b285-f122e7115b09.0","obj_delete_at_hint.0000000014","datalog.sync-status.shard.e658a22d-79d5-4296-b285-f122e7115b09.1","obj_delete_at_hint.0000000112","obj_delete_at_hint.0000000007","obj_delete_at_hint.0000000021","obj_delete_at_hint.0000000064","obj_delete_at_hint.0000000071","obj_delete_at_hint.0000000074","2021-02-13-17-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.16-ejuwhf-7","2021-02-13-18-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.29-ejuwhf-20","datalog.sync-status.shard.7441352a-0312-41b4-8a2a-b3cee61559db.1","bucket.sync-status.e658a22d-79d5-4296-b285-f122e7115b09:ejuwhf-20:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.29","obj_delete_at_hint.0000000081","obj_delete_at_hint.0000000009","obj_delete_at_hint.0000000121","bucket.sync-status.7441352a-0312-41b4-8a2a-b3cee61559db:ejuwhf-49:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4973.1","2021-02-13-17-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.5-ejuwhf-5","2021-02-13-18-671230a8-4b04-4e98-83d8-0a04dcd55dc0.5112.3-ejuwhf-52","obj_delete_at_hint.0000000125","bucket.sync-status.e658a22d-79d5-4296-b285-f122e7115b09:ejuwhf-25:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.34","obj_delete_at_hint.0000000082","meta.full-sync.index.1","obj_delete_at_hint.0000000105","obj_delete_at_hint.0000000059","bucket.sync-status.e658a22d-79d5-4296-b285-f122e7115b09:ejuwhf-10:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.19","2021-02-13-18-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.42-ejuwhf-33","obj_delete_at_hint.0000000077","obj_delete_at_hint.0000000032","bucket.sync-status.7441352a-0312-41b4-8a2a-b3cee61559db:ejuwhf-12:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.21","2021-02-13-18-671230a8-4b04-4e98-83d8-0a04dcd55dc0.5112.4-ejuwhf-53","2021-02-13-17-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.3-ejuwhf-3","datalog.sync-status.shard.e658a22d-79d5-4296-b285-f122e7115b09.0","obj_delete_at_hint.0000000053","obj_delete_at_hint.0000000091","datalog.sync-status.shard.e658a22d-79d5-4296-b285-f122e7115b09.2","obj_delete_at_hint.0000000065","bucket.sync-status.e658a22d-79d5-4296-b285-f122e7115b09:ejuwhf-14:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.23","obj_delete_at_hint.0000000083","obj_delete_at_hint.0000000010","bucket.sync-status.7441352a-0312-41b4-8a2a-b3cee61559db:ejuwhf-20:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.29","bucket.sync-status.e658a22d-79d5-4296-b285-f122e7115b09:ejuwhf-21:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.30","bucket.sync-status.e658a22d-79d5-4296-b285-f122e7115b09:ejuwhf-47:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4825.4","bucket.sync-status.e658a22d-79d5-4296-b285-f122e7115b09:ejuwhf-26:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.35","mdlog.sync-status.shard.2","datalog.sync-status.shard.7441352a-0312-41b4-8a2a-b3cee61559db.3","obj_delete_at_hint.0000000045","bucket.sync-status.e658a22d-79d5-4296-b285-f122e7115b09:ejuwhf-17:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.26","obj_delete_at_hint.0000000002","obj_delete_at_hint.0000000116","data.full-sync.index.7441352a-0312-41b4-8a2a-b3cee61559db.1","2021-02-13-18-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.36-ejuwhf-27","obj_delete_at_hint.0000000034","2021-02-13-18-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.25-ejuwhf-16","bucket.sync-status.7441352a-0312-41b4-8a2a-b3cee61559db:ejuwhf-36:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.45","obj_delete_at_hint.0000000101","mdlog.sync-status.shard.1","2021-02-13-18-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.30-ejuwhf-21","bucket.sync-status.7441352a-0312-41b4-8a2a-b3cee61559db:ejuwhf-47:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4825.4","bucket.sync-status.e658a22d-79d5-4296-b285-f122e7115b09:ejuwhf-36:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.45","obj_delete_at_hint.0000000079","obj_delete_at_hint.0000000049","obj_delete_at_hint.0000000117","obj_delete_at_hint.0000000044","obj_delete_at_hint.0000000066","obj_delete_at_hint.0000000068","obj_delete_at_hint.0000000085","obj_delete_at_hint.0000000073","obj_delete_at_hint.0000000038","datalog.sync-status.shard.7441352a-0312-41b4-8a2a-b3cee61559db.2.retry","meta.full-sync.index.3","obj_delete_at_hint.0000000118","obj_delete_at_hint.0000000036","obj_delete_at_hint.0000000103","mdlog.sync-status.shard.3","bucket.sync-status.7441352a-0312-41b4-8a2a-b3cee61559db:ejuwhf-11:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.20","bucket.sync-status.7441352a-0312-41b4-8a2a-b3cee61559db:ejuwhf-17:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.26","obj_delete_at_hint.0000000119","obj_delete_at_hint.0000000098","mdlog.sync-status.shard.0","2021-02-13-18-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.32-ejuwhf-23","obj_delete_at_hint.0000000027","mdlog.sync-status","obj_delete_at_hint.0000000019","bucket.sync-status.e658a22d-79d5-4296-b285-f122e7115b09:ejuwhf-13:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.22","obj_delete_at_hint.0000000039","datalog.sync-status.7441352a-0312-41b4-8a2a-b3cee61559db","2021-02-13-18-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.38-ejuwhf-29","2021-02-13-18-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.22-ejuwhf-13","obj_delete_at_hint.0000000100","2021-02-13-18-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4825.2-ejuwhf-45","obj_delete_at_hint.0000000093","obj_delete_at_hint.0000000004","obj_delete_at_hint.0000000063","obj_delete_at_hint.0000000122","datalog.sync-status.shard.7441352a-0312-41b4-8a2a-b3cee61559db.2","obj_delete_at_hint.0000000057","datalog.sync-status.shard.7441352a-0312-41b4-8a2a-b3cee61559db.0.retry","2021-02-13-17-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.17-ejuwhf-8","obj_delete_at_hint.0000000054","obj_delete_at_hint.0000000114","2021-02-13-18-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.35-ejuwhf-26","obj_delete_at_hint.0000000012","obj_delete_at_hint.0000000084","obj_delete_at_hint.0000000043","2021-02-13-18-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.41-ejuwhf-32","2021-02-13-17-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.18-ejuwhf-9","bucket.sync-status.7441352a-0312-41b4-8a2a-b3cee61559db:ejuwhf-38:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.47","bucket.sync-status.7441352a-0312-41b4-8a2a-b3cee61559db:ejuwhf-25:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.34","2021-02-13-18-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.28-ejuwhf-19","bucket.sync-status.7441352a-0312-41b4-8a2a-b3cee61559db:ejuwhf-15:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.24","obj_delete_at_hint.0000000111","obj_delete_at_hint.0000000048","data.full-sync.index.e658a22d-79d5-4296-b285-f122e7115b09.3","2021-02-13-18-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.47-ejuwhf-38","obj_delete_at_hint.0000000020","2021-02-13-18-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4973.1-ejuwhf-49","bucket.sync-status.7441352a-0312-41b4-8a2a-b3cee61559db:ejuwhf-26:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.35","data.full-sync.index.e658a22d-79d5-4296-b285-f122e7115b09.1","obj_delete_at_hint.0000000099","obj_delete_at_hint.0000000056","bucket.sync-status.7441352a-0312-41b4-8a2a-b3cee61559db:ejuwhf-24:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.33","bucket.sync-status.7441352a-0312-41b4-8a2a-b3cee61559db:ejuwhf-21:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.30","bucket.sync-status.7441352a-0312-41b4-8a2a-b3cee61559db:ejuwhf-22:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.31","obj_delete_at_hint.0000000072","obj_delete_at_hint.0000000062","bucket.sync-status.e658a22d-79d5-4296-b285-f122e7115b09:ejuwhf-16:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.25","obj_delete_at_hint.0000000115","obj_delete_at_hint.0000000033","datalog.sync-status.shard.7441352a-0312-41b4-8a2a-b3cee61559db.1.retry","bucket.sync-status.7441352a-0312-41b4-8a2a-b3cee61559db:ejuwhf-16:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.25","obj_delete_at_hint.0000000025","bucket.sync-status.e658a22d-79d5-4296-b285-f122e7115b09:ejuwhf-12:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.21","obj_delete_at_hint.0000000123","bucket.sync-status.e658a22d-79d5-4296-b285-f122e7115b09:ejuwhf-38:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.47","obj_delete_at_hint.0000000108","obj_delete_at_hint.0000000094","2021-02-13-18-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.43-ejuwhf-34","bucket.sync-status.e658a22d-79d5-4296-b285-f122e7115b09:ejuwhf-19:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.28","obj_delete_at_hint.0000000060","obj_delete_at_hint.0000000109","2021-02-13-17-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.6-ejuwhf-6","2021-02-13-18-671230a8-4b04-4e98-83d8-0a04dcd55dc0.5112.1-ejuwhf-50","obj_delete_at_hint.0000000013","2021-02-13-18-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.46-ejuwhf-37","2021-02-13-18-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.40-ejuwhf-31","2021-02-13-18-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4825.4-ejuwhf-47","bucket.sync-status.e658a22d-79d5-4296-b285-f122e7115b09:ejuwhf-24:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.33","obj_delete_at_hint.0000000051","obj_delete_at_hint.0000000106","2021-02-13-18-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.23-ejuwhf-14","bucket.sync-status.7441352a-0312-41b4-8a2a-b3cee61559db:ejuwhf-48:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4825.5","2021-02-13-18-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.26-ejuwhf-17","2021-02-13-18-671230a8-4b04-4e98-83d8-0a04dcd55dc0.5112.2-ejuwhf-51","obj_delete_at_hint.0000000017","2021-02-13-18-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4825.5-ejuwhf-48","obj_delete_at_hint.0000000023","obj_delete_at_hint.0000000107","2021-02-13-18-671230a8-4b04-4e98-83d8-0a04dcd55dc0.5112.5-ejuwhf-54","obj_delete_at_hint.0000000046","meta.full-sync.index.2","data_log.2","obj_delete_at_hint.0000000067","2021-02-13-18-e658a22d-79d5-4296-b285-f122e7115b09.7499.1-ejuwhf-42","bucket.sync-status.e658a22d-79d5-4296-b285-f122e7115b09:ejuwhf-48:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4825.5","datalog.sync-status.shard.e658a22d-79d5-4296-b285-f122e7115b09.2.retry","obj_delete_at_hint.0000000086","data.full-sync.index.7441352a-0312-41b4-8a2a-b3cee61559db.2","bucket.sync-status.7441352a-0312-41b4-8a2a-b3cee61559db:ejuwhf-23:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.32","2021-02-13-18-671230a8-4b04-4e98-83d8-0a04dcd55dc0.5112.9-ejuwhf-58","obj_delete_at_hint.0000000050","obj_delete_at_hint.0000000102","obj_delete_at_hint.0000000124","bucket.sync-status.7441352a-0312-41b4-8a2a-b3cee61559db:ejuwhf-10:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.19","obj_delete_at_hint.0000000001","datalog.sync-status.e658a22d-79d5-4296-b285-f122e7115b09","data.full-sync.index.7441352a-0312-41b4-8a2a-b3cee61559db.0","obj_delete_at_hint.0000000126","datalog.sync-status.shard.7441352a-0312-41b4-8a2a-b3cee61559db.0","obj_delete_at_hint.0000000055","obj_delete_at_hint.0000000061","bucket.sync-status.7441352a-0312-41b4-8a2a-b3cee61559db:ejuwhf-46:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4825.3","obj_delete_at_hint.0000000097","meta.log.c72c9bb6-7372-4355-b488-0f51f8a5cecb.3","obj_delete_at_hint.0000000042","obj_delete_at_hint.0000000075","obj_delete_at_hint.0000000120","obj_delete_at_hint.0000000030","data.full-sync.index.e658a22d-79d5-4296-b285-f122e7115b09.2"] 2021-02-13T18:47:22.005 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['log', 'list', '--rgw-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:47:22.005 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'log', 'list', '--rgw-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:47:22.006 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 log list --rgw-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:47:22.094 INFO:teuthology.orchestra.run.gibba036.stdout:["obj_delete_at_hint.0000000078","meta.history","2021-02-13-17-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.1-ejuwhf-1","data.full-sync.index.671230a8-4b04-4e98-83d8-0a04dcd55dc0.3","obj_delete_at_hint.0000000070","bucket.sync-status.671230a8-4b04-4e98-83d8-0a04dcd55dc0:ejuwhf-20:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.29","obj_delete_at_hint.0000000104","2021-02-13-18-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4825.1-ejuwhf-44","obj_delete_at_hint.0000000026","2021-02-13-18-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.34-ejuwhf-25","obj_delete_at_hint.0000000028","bucket.sync-status.671230a8-4b04-4e98-83d8-0a04dcd55dc0:ejuwhf-15:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.24","2021-02-13-18-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.49-ejuwhf-40","2021-02-13-18-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.37-ejuwhf-28","bucket.sync-status.7441352a-0312-41b4-8a2a-b3cee61559db:ejuwhf-19:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.28","obj_delete_at_hint.0000000040","meta.full-sync.index.0","2021-02-13-17-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.2-ejuwhf-2","data.full-sync.index.7441352a-0312-41b4-8a2a-b3cee61559db.3","obj_delete_at_hint.0000000015","bucket.sync-status.671230a8-4b04-4e98-83d8-0a04dcd55dc0:ejuwhf-14:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.23","bucket.sync-status.7441352a-0312-41b4-8a2a-b3cee61559db:ejuwhf-13:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.22","obj_delete_at_hint.0000000069","obj_delete_at_hint.0000000095","obj_delete_at_hint.0000000003","obj_delete_at_hint.0000000047","2021-02-13-18-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.24-ejuwhf-15","obj_delete_at_hint.0000000035","bucket.sync-status.7441352a-0312-41b4-8a2a-b3cee61559db:ejuwhf-14:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.23","obj_delete_at_hint.0000000037","obj_delete_at_hint.0000000024","data.full-sync.index.671230a8-4b04-4e98-83d8-0a04dcd55dc0.0","obj_delete_at_hint.0000000000","obj_delete_at_hint.0000000031","2021-02-13-17-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.21-ejuwhf-12","2021-02-13-18-671230a8-4b04-4e98-83d8-0a04dcd55dc0.5112.8-ejuwhf-57","bucket.sync-status.671230a8-4b04-4e98-83d8-0a04dcd55dc0:ejuwhf-48:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4825.5","datalog.sync-status.shard.671230a8-4b04-4e98-83d8-0a04dcd55dc0.3","bucket.sync-status.7441352a-0312-41b4-8a2a-b3cee61559db:ejuwhf-37:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.46","bucket.sync-status.671230a8-4b04-4e98-83d8-0a04dcd55dc0:ejuwhf-38:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.47","obj_delete_at_hint.0000000076","obj_delete_at_hint.0000000113","obj_delete_at_hint.0000000005","obj_delete_at_hint.0000000011","obj_delete_at_hint.0000000058","obj_delete_at_hint.0000000052","2021-02-13-18-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.48-ejuwhf-39","bucket.sync-status.671230a8-4b04-4e98-83d8-0a04dcd55dc0:ejuwhf-21:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.30","2021-02-13-17-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.20-ejuwhf-11","2021-02-13-18-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.31-ejuwhf-22","obj_delete_at_hint.0000000088","obj_delete_at_hint.0000000080","obj_delete_at_hint.0000000090","obj_delete_at_hint.0000000110","2021-02-13-18-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.33-ejuwhf-24","obj_delete_at_hint.0000000096","obj_delete_at_hint.0000000087","obj_delete_at_hint.0000000008","data.full-sync.index.671230a8-4b04-4e98-83d8-0a04dcd55dc0.2","obj_delete_at_hint.0000000006","obj_delete_at_hint.0000000029","obj_delete_at_hint.0000000089","obj_delete_at_hint.0000000022","datalog.sync-status.shard.671230a8-4b04-4e98-83d8-0a04dcd55dc0.1","bilog.trim","obj_delete_at_hint.0000000016","2021-02-13-17-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.4-ejuwhf-4","obj_delete_at_hint.0000000041","2021-02-13-18-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4825.3-ejuwhf-46","2021-02-13-18-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.45-ejuwhf-36","obj_delete_at_hint.0000000018","2021-02-13-17-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.19-ejuwhf-10","obj_delete_at_hint.0000000092","bucket.sync-status.671230a8-4b04-4e98-83d8-0a04dcd55dc0:ejuwhf-36:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.45","2021-02-13-18-e658a22d-79d5-4296-b285-f122e7115b09.7499.2-ejuwhf-43","2021-02-13-18-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.50-ejuwhf-41","obj_delete_at_hint.0000000014","bucket.sync-status.671230a8-4b04-4e98-83d8-0a04dcd55dc0:ejuwhf-49:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4973.1","datalog.sync-status.shard.671230a8-4b04-4e98-83d8-0a04dcd55dc0.2","obj_delete_at_hint.0000000112","obj_delete_at_hint.0000000007","obj_delete_at_hint.0000000021","obj_delete_at_hint.0000000064","obj_delete_at_hint.0000000071","obj_delete_at_hint.0000000074","2021-02-13-17-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.16-ejuwhf-7","2021-02-13-18-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.29-ejuwhf-20","datalog.sync-status.shard.7441352a-0312-41b4-8a2a-b3cee61559db.1","obj_delete_at_hint.0000000081","obj_delete_at_hint.0000000009","obj_delete_at_hint.0000000121","bucket.sync-status.7441352a-0312-41b4-8a2a-b3cee61559db:ejuwhf-49:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4973.1","2021-02-13-17-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.5-ejuwhf-5","obj_delete_at_hint.0000000125","obj_delete_at_hint.0000000082","meta.full-sync.index.1","obj_delete_at_hint.0000000105","obj_delete_at_hint.0000000059","bucket.sync-status.671230a8-4b04-4e98-83d8-0a04dcd55dc0:ejuwhf-47:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4825.4","datalog.sync-status.shard.671230a8-4b04-4e98-83d8-0a04dcd55dc0.2.retry","obj_delete_at_hint.0000000077","obj_delete_at_hint.0000000032","bucket.sync-status.7441352a-0312-41b4-8a2a-b3cee61559db:ejuwhf-12:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.21","2021-02-13-17-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.3-ejuwhf-3","obj_delete_at_hint.0000000053","obj_delete_at_hint.0000000091","datalog.sync-status.shard.671230a8-4b04-4e98-83d8-0a04dcd55dc0.0","obj_delete_at_hint.0000000065","obj_delete_at_hint.0000000083","obj_delete_at_hint.0000000010","bucket.sync-status.7441352a-0312-41b4-8a2a-b3cee61559db:ejuwhf-20:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.29","bucket.sync-status.671230a8-4b04-4e98-83d8-0a04dcd55dc0:ejuwhf-13:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.22","mdlog.sync-status.shard.2","datalog.sync-status.shard.7441352a-0312-41b4-8a2a-b3cee61559db.3","obj_delete_at_hint.0000000045","bucket.sync-status.671230a8-4b04-4e98-83d8-0a04dcd55dc0:ejuwhf-19:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.28","obj_delete_at_hint.0000000002","obj_delete_at_hint.0000000116","data.full-sync.index.7441352a-0312-41b4-8a2a-b3cee61559db.1","obj_delete_at_hint.0000000034","2021-02-13-18-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.25-ejuwhf-16","bucket.sync-status.7441352a-0312-41b4-8a2a-b3cee61559db:ejuwhf-36:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.45","obj_delete_at_hint.0000000101","bucket.sync-status.671230a8-4b04-4e98-83d8-0a04dcd55dc0:ejuwhf-37:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.46","mdlog.sync-status.shard.1","2021-02-13-18-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.30-ejuwhf-21","bucket.sync-status.7441352a-0312-41b4-8a2a-b3cee61559db:ejuwhf-47:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4825.4","obj_delete_at_hint.0000000079","obj_delete_at_hint.0000000049","obj_delete_at_hint.0000000117","obj_delete_at_hint.0000000044","bucket.sync-status.671230a8-4b04-4e98-83d8-0a04dcd55dc0:ejuwhf-23:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.32","obj_delete_at_hint.0000000066","obj_delete_at_hint.0000000068","obj_delete_at_hint.0000000085","bucket.sync-status.671230a8-4b04-4e98-83d8-0a04dcd55dc0:ejuwhf-25:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.34","obj_delete_at_hint.0000000073","obj_delete_at_hint.0000000038","datalog.sync-status.shard.7441352a-0312-41b4-8a2a-b3cee61559db.2.retry","meta.full-sync.index.3","obj_delete_at_hint.0000000118","obj_delete_at_hint.0000000036","obj_delete_at_hint.0000000103","mdlog.sync-status.shard.3","bucket.sync-status.7441352a-0312-41b4-8a2a-b3cee61559db:ejuwhf-11:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.20","bucket.sync-status.7441352a-0312-41b4-8a2a-b3cee61559db:ejuwhf-17:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.26","obj_delete_at_hint.0000000119","obj_delete_at_hint.0000000098","mdlog.sync-status.shard.0","2021-02-13-18-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.32-ejuwhf-23","obj_delete_at_hint.0000000027","mdlog.sync-status","obj_delete_at_hint.0000000019","obj_delete_at_hint.0000000039","datalog.sync-status.7441352a-0312-41b4-8a2a-b3cee61559db","2021-02-13-18-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.22-ejuwhf-13","obj_delete_at_hint.0000000100","2021-02-13-18-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4825.2-ejuwhf-45","bucket.sync-status.671230a8-4b04-4e98-83d8-0a04dcd55dc0:ejuwhf-10:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.19","obj_delete_at_hint.0000000093","obj_delete_at_hint.0000000004","obj_delete_at_hint.0000000063","obj_delete_at_hint.0000000122","datalog.sync-status.shard.7441352a-0312-41b4-8a2a-b3cee61559db.2","obj_delete_at_hint.0000000057","bucket.sync-status.671230a8-4b04-4e98-83d8-0a04dcd55dc0:ejuwhf-16:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.25","2021-02-13-17-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.17-ejuwhf-8","obj_delete_at_hint.0000000054","obj_delete_at_hint.0000000114","2021-02-13-18-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.35-ejuwhf-26","bucket.sync-status.671230a8-4b04-4e98-83d8-0a04dcd55dc0:ejuwhf-17:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.26","obj_delete_at_hint.0000000012","obj_delete_at_hint.0000000084","obj_delete_at_hint.0000000043","2021-02-13-17-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.18-ejuwhf-9","bucket.sync-status.7441352a-0312-41b4-8a2a-b3cee61559db:ejuwhf-38:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.47","bucket.sync-status.7441352a-0312-41b4-8a2a-b3cee61559db:ejuwhf-25:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.34","2021-02-13-18-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.28-ejuwhf-19","bucket.sync-status.7441352a-0312-41b4-8a2a-b3cee61559db:ejuwhf-15:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.24","obj_delete_at_hint.0000000111","obj_delete_at_hint.0000000048","2021-02-13-18-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.47-ejuwhf-38","obj_delete_at_hint.0000000020","2021-02-13-18-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4973.1-ejuwhf-49","bucket.sync-status.7441352a-0312-41b4-8a2a-b3cee61559db:ejuwhf-26:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.35","obj_delete_at_hint.0000000099","obj_delete_at_hint.0000000056","bucket.sync-status.7441352a-0312-41b4-8a2a-b3cee61559db:ejuwhf-24:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.33","bucket.sync-status.7441352a-0312-41b4-8a2a-b3cee61559db:ejuwhf-21:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.30","bucket.sync-status.7441352a-0312-41b4-8a2a-b3cee61559db:ejuwhf-22:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.31","obj_delete_at_hint.0000000072","obj_delete_at_hint.0000000062","obj_delete_at_hint.0000000115","obj_delete_at_hint.0000000033","bucket.sync-status.7441352a-0312-41b4-8a2a-b3cee61559db:ejuwhf-16:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.25","obj_delete_at_hint.0000000025","obj_delete_at_hint.0000000123","obj_delete_at_hint.0000000108","obj_delete_at_hint.0000000094","2021-02-13-18-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.43-ejuwhf-34","bucket.sync-status.671230a8-4b04-4e98-83d8-0a04dcd55dc0:ejuwhf-46:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4825.3","obj_delete_at_hint.0000000060","obj_delete_at_hint.0000000109","2021-02-13-17-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.6-ejuwhf-6","obj_delete_at_hint.0000000013","2021-02-13-18-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.46-ejuwhf-37","2021-02-13-18-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.40-ejuwhf-31","2021-02-13-18-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4825.4-ejuwhf-47","obj_delete_at_hint.0000000051","obj_delete_at_hint.0000000106","2021-02-13-18-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.23-ejuwhf-14","bucket.sync-status.7441352a-0312-41b4-8a2a-b3cee61559db:ejuwhf-48:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4825.5","2021-02-13-18-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.26-ejuwhf-17","bucket.sync-status.671230a8-4b04-4e98-83d8-0a04dcd55dc0:ejuwhf-26:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.35","2021-02-13-18-671230a8-4b04-4e98-83d8-0a04dcd55dc0.5112.2-ejuwhf-51","obj_delete_at_hint.0000000017","2021-02-13-18-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4825.5-ejuwhf-48","obj_delete_at_hint.0000000023","obj_delete_at_hint.0000000107","2021-02-13-18-671230a8-4b04-4e98-83d8-0a04dcd55dc0.5112.5-ejuwhf-54","obj_delete_at_hint.0000000046","meta.full-sync.index.2","data_log.2","obj_delete_at_hint.0000000067","2021-02-13-18-e658a22d-79d5-4296-b285-f122e7115b09.7499.1-ejuwhf-42","obj_delete_at_hint.0000000086","datalog.sync-status.671230a8-4b04-4e98-83d8-0a04dcd55dc0","data.full-sync.index.7441352a-0312-41b4-8a2a-b3cee61559db.2","bucket.sync-status.7441352a-0312-41b4-8a2a-b3cee61559db:ejuwhf-23:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.32","bucket.sync-status.671230a8-4b04-4e98-83d8-0a04dcd55dc0:ejuwhf-11:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.20","data.full-sync.index.671230a8-4b04-4e98-83d8-0a04dcd55dc0.1","bucket.sync-status.671230a8-4b04-4e98-83d8-0a04dcd55dc0:ejuwhf-12:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.21","obj_delete_at_hint.0000000050","obj_delete_at_hint.0000000102","obj_delete_at_hint.0000000124","bucket.sync-status.7441352a-0312-41b4-8a2a-b3cee61559db:ejuwhf-10:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.19","obj_delete_at_hint.0000000001","data.full-sync.index.7441352a-0312-41b4-8a2a-b3cee61559db.0","bucket.sync-status.671230a8-4b04-4e98-83d8-0a04dcd55dc0:ejuwhf-22:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.31","obj_delete_at_hint.0000000126","datalog.sync-status.shard.7441352a-0312-41b4-8a2a-b3cee61559db.0","obj_delete_at_hint.0000000055","obj_delete_at_hint.0000000061","bucket.sync-status.7441352a-0312-41b4-8a2a-b3cee61559db:ejuwhf-46:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4825.3","bucket.sync-status.671230a8-4b04-4e98-83d8-0a04dcd55dc0:ejuwhf-24:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.33","obj_delete_at_hint.0000000097","meta.log.c72c9bb6-7372-4355-b488-0f51f8a5cecb.3","obj_delete_at_hint.0000000042","obj_delete_at_hint.0000000075","obj_delete_at_hint.0000000120","obj_delete_at_hint.0000000030"] 2021-02-13T18:47:22.112 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['log', 'list', '--rgw-zone', 'test-zone3', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:47:22.113 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'log', 'list', '--rgw-zone', 'test-zone3', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:47:22.113 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 log list --rgw-zone test-zone3 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:47:22.240 INFO:teuthology.orchestra.run.gibba025.stdout:["bucket.sync-status.e658a22d-79d5-4296-b285-f122e7115b09:ejuwhf-37:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.46","obj_delete_at_hint.0000000078","meta.history","bucket.sync-status.e658a22d-79d5-4296-b285-f122e7115b09:ejuwhf-11:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.20","2021-02-13-17-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.1-ejuwhf-1","data.full-sync.index.671230a8-4b04-4e98-83d8-0a04dcd55dc0.3","obj_delete_at_hint.0000000070","bucket.sync-status.671230a8-4b04-4e98-83d8-0a04dcd55dc0:ejuwhf-20:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.29","obj_delete_at_hint.0000000104","2021-02-13-18-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4825.1-ejuwhf-44","obj_delete_at_hint.0000000026","2021-02-13-18-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.27-ejuwhf-18","2021-02-13-18-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.34-ejuwhf-25","obj_delete_at_hint.0000000028","bucket.sync-status.671230a8-4b04-4e98-83d8-0a04dcd55dc0:ejuwhf-15:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.24","2021-02-13-18-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.49-ejuwhf-40","obj_delete_at_hint.0000000040","meta.full-sync.index.0","2021-02-13-17-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.2-ejuwhf-2","obj_delete_at_hint.0000000015","bucket.sync-status.671230a8-4b04-4e98-83d8-0a04dcd55dc0:ejuwhf-14:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.23","obj_delete_at_hint.0000000069","obj_delete_at_hint.0000000095","obj_delete_at_hint.0000000003","obj_delete_at_hint.0000000047","bucket.sync-status.e658a22d-79d5-4296-b285-f122e7115b09:ejuwhf-46:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4825.3","2021-02-13-18-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.24-ejuwhf-15","obj_delete_at_hint.0000000035","obj_delete_at_hint.0000000037","obj_delete_at_hint.0000000024","data.full-sync.index.671230a8-4b04-4e98-83d8-0a04dcd55dc0.0","obj_delete_at_hint.0000000000","obj_delete_at_hint.0000000031","2021-02-13-17-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.21-ejuwhf-12","bucket.sync-status.671230a8-4b04-4e98-83d8-0a04dcd55dc0:ejuwhf-48:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4825.5","datalog.sync-status.shard.671230a8-4b04-4e98-83d8-0a04dcd55dc0.3","bucket.sync-status.e658a22d-79d5-4296-b285-f122e7115b09:ejuwhf-23:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.32","datalog.sync-status.shard.e658a22d-79d5-4296-b285-f122e7115b09.3","bucket.sync-status.e658a22d-79d5-4296-b285-f122e7115b09:ejuwhf-15:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.24","bucket.sync-status.671230a8-4b04-4e98-83d8-0a04dcd55dc0:ejuwhf-38:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.47","obj_delete_at_hint.0000000076","obj_delete_at_hint.0000000113","obj_delete_at_hint.0000000005","obj_delete_at_hint.0000000011","obj_delete_at_hint.0000000058","obj_delete_at_hint.0000000052","2021-02-13-18-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.48-ejuwhf-39","meta.log.138dc4ba-dc02-4957-87c3-e8bf2d80917c.2","bucket.sync-status.671230a8-4b04-4e98-83d8-0a04dcd55dc0:ejuwhf-21:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.30","2021-02-13-18-671230a8-4b04-4e98-83d8-0a04dcd55dc0.5112.6-ejuwhf-55","2021-02-13-17-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.20-ejuwhf-11","2021-02-13-18-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.31-ejuwhf-22","bucket.sync-status.e658a22d-79d5-4296-b285-f122e7115b09:ejuwhf-49:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4973.1","obj_delete_at_hint.0000000088","obj_delete_at_hint.0000000080","obj_delete_at_hint.0000000090","obj_delete_at_hint.0000000110","2021-02-13-18-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.44-ejuwhf-35","2021-02-13-18-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.33-ejuwhf-24","obj_delete_at_hint.0000000096","obj_delete_at_hint.0000000087","obj_delete_at_hint.0000000008","data.full-sync.index.671230a8-4b04-4e98-83d8-0a04dcd55dc0.2","obj_delete_at_hint.0000000006","obj_delete_at_hint.0000000029","obj_delete_at_hint.0000000089","obj_delete_at_hint.0000000022","datalog.sync-status.shard.671230a8-4b04-4e98-83d8-0a04dcd55dc0.1","bilog.trim","obj_delete_at_hint.0000000016","2021-02-13-17-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.4-ejuwhf-4","obj_delete_at_hint.0000000041","2021-02-13-18-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4825.3-ejuwhf-46","2021-02-13-18-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.45-ejuwhf-36","obj_delete_at_hint.0000000018","2021-02-13-17-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.19-ejuwhf-10","obj_delete_at_hint.0000000092","bucket.sync-status.671230a8-4b04-4e98-83d8-0a04dcd55dc0:ejuwhf-36:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.45","bucket.sync-status.e658a22d-79d5-4296-b285-f122e7115b09:ejuwhf-22:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.31","2021-02-13-18-e658a22d-79d5-4296-b285-f122e7115b09.7499.2-ejuwhf-43","2021-02-13-18-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.50-ejuwhf-41","data.full-sync.index.e658a22d-79d5-4296-b285-f122e7115b09.0","obj_delete_at_hint.0000000014","bucket.sync-status.671230a8-4b04-4e98-83d8-0a04dcd55dc0:ejuwhf-49:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4973.1","datalog.sync-status.shard.e658a22d-79d5-4296-b285-f122e7115b09.1","datalog.sync-status.shard.671230a8-4b04-4e98-83d8-0a04dcd55dc0.2","obj_delete_at_hint.0000000112","obj_delete_at_hint.0000000007","obj_delete_at_hint.0000000021","obj_delete_at_hint.0000000064","obj_delete_at_hint.0000000071","obj_delete_at_hint.0000000074","2021-02-13-17-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.16-ejuwhf-7","2021-02-13-18-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.29-ejuwhf-20","bucket.sync-status.e658a22d-79d5-4296-b285-f122e7115b09:ejuwhf-20:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.29","obj_delete_at_hint.0000000081","obj_delete_at_hint.0000000009","obj_delete_at_hint.0000000121","2021-02-13-17-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.5-ejuwhf-5","2021-02-13-18-671230a8-4b04-4e98-83d8-0a04dcd55dc0.5112.3-ejuwhf-52","obj_delete_at_hint.0000000125","bucket.sync-status.e658a22d-79d5-4296-b285-f122e7115b09:ejuwhf-25:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.34","obj_delete_at_hint.0000000082","meta.full-sync.index.1","obj_delete_at_hint.0000000105","obj_delete_at_hint.0000000059","bucket.sync-status.e658a22d-79d5-4296-b285-f122e7115b09:ejuwhf-10:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.19","bucket.sync-status.671230a8-4b04-4e98-83d8-0a04dcd55dc0:ejuwhf-47:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4825.4","meta.log.138dc4ba-dc02-4957-87c3-e8bf2d80917c.0","datalog.sync-status.shard.671230a8-4b04-4e98-83d8-0a04dcd55dc0.2.retry","obj_delete_at_hint.0000000077","obj_delete_at_hint.0000000032","2021-02-13-17-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.3-ejuwhf-3","datalog.sync-status.shard.e658a22d-79d5-4296-b285-f122e7115b09.0","obj_delete_at_hint.0000000053","obj_delete_at_hint.0000000091","datalog.sync-status.shard.671230a8-4b04-4e98-83d8-0a04dcd55dc0.0","datalog.sync-status.shard.e658a22d-79d5-4296-b285-f122e7115b09.2","obj_delete_at_hint.0000000065","bucket.sync-status.e658a22d-79d5-4296-b285-f122e7115b09:ejuwhf-14:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.23","obj_delete_at_hint.0000000083","obj_delete_at_hint.0000000010","bucket.sync-status.e658a22d-79d5-4296-b285-f122e7115b09:ejuwhf-21:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.30","bucket.sync-status.e658a22d-79d5-4296-b285-f122e7115b09:ejuwhf-47:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4825.4","bucket.sync-status.671230a8-4b04-4e98-83d8-0a04dcd55dc0:ejuwhf-13:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.22","bucket.sync-status.e658a22d-79d5-4296-b285-f122e7115b09:ejuwhf-26:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.35","mdlog.sync-status.shard.2","obj_delete_at_hint.0000000045","bucket.sync-status.671230a8-4b04-4e98-83d8-0a04dcd55dc0:ejuwhf-19:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.28","bucket.sync-status.e658a22d-79d5-4296-b285-f122e7115b09:ejuwhf-17:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.26","obj_delete_at_hint.0000000002","obj_delete_at_hint.0000000116","obj_delete_at_hint.0000000034","2021-02-13-18-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.25-ejuwhf-16","obj_delete_at_hint.0000000101","bucket.sync-status.671230a8-4b04-4e98-83d8-0a04dcd55dc0:ejuwhf-37:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.46","mdlog.sync-status.shard.1","2021-02-13-18-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.30-ejuwhf-21","bucket.sync-status.e658a22d-79d5-4296-b285-f122e7115b09:ejuwhf-36:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.45","obj_delete_at_hint.0000000079","obj_delete_at_hint.0000000049","obj_delete_at_hint.0000000117","obj_delete_at_hint.0000000044","bucket.sync-status.671230a8-4b04-4e98-83d8-0a04dcd55dc0:ejuwhf-23:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.32","obj_delete_at_hint.0000000066","obj_delete_at_hint.0000000068","obj_delete_at_hint.0000000085","bucket.sync-status.671230a8-4b04-4e98-83d8-0a04dcd55dc0:ejuwhf-25:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.34","obj_delete_at_hint.0000000073","obj_delete_at_hint.0000000038","meta.full-sync.index.3","obj_delete_at_hint.0000000118","obj_delete_at_hint.0000000036","obj_delete_at_hint.0000000103","mdlog.sync-status.shard.3","obj_delete_at_hint.0000000119","obj_delete_at_hint.0000000098","mdlog.sync-status.shard.0","2021-02-13-18-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.32-ejuwhf-23","obj_delete_at_hint.0000000027","mdlog.sync-status","obj_delete_at_hint.0000000019","bucket.sync-status.e658a22d-79d5-4296-b285-f122e7115b09:ejuwhf-13:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.22","obj_delete_at_hint.0000000039","2021-02-13-18-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.38-ejuwhf-29","2021-02-13-18-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.22-ejuwhf-13","obj_delete_at_hint.0000000100","2021-02-13-18-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4825.2-ejuwhf-45","bucket.sync-status.671230a8-4b04-4e98-83d8-0a04dcd55dc0:ejuwhf-10:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.19","obj_delete_at_hint.0000000093","obj_delete_at_hint.0000000004","obj_delete_at_hint.0000000063","obj_delete_at_hint.0000000122","obj_delete_at_hint.0000000057","bucket.sync-status.671230a8-4b04-4e98-83d8-0a04dcd55dc0:ejuwhf-16:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.25","2021-02-13-17-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.17-ejuwhf-8","obj_delete_at_hint.0000000054","obj_delete_at_hint.0000000114","2021-02-13-18-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.35-ejuwhf-26","bucket.sync-status.671230a8-4b04-4e98-83d8-0a04dcd55dc0:ejuwhf-17:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.26","obj_delete_at_hint.0000000012","obj_delete_at_hint.0000000084","obj_delete_at_hint.0000000043","2021-02-13-18-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.41-ejuwhf-32","2021-02-13-17-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.18-ejuwhf-9","2021-02-13-18-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.28-ejuwhf-19","obj_delete_at_hint.0000000111","obj_delete_at_hint.0000000048","data.full-sync.index.e658a22d-79d5-4296-b285-f122e7115b09.3","2021-02-13-18-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.47-ejuwhf-38","obj_delete_at_hint.0000000020","2021-02-13-18-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4973.1-ejuwhf-49","data.full-sync.index.e658a22d-79d5-4296-b285-f122e7115b09.1","obj_delete_at_hint.0000000099","obj_delete_at_hint.0000000056","obj_delete_at_hint.0000000072","obj_delete_at_hint.0000000062","bucket.sync-status.e658a22d-79d5-4296-b285-f122e7115b09:ejuwhf-16:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.25","obj_delete_at_hint.0000000115","obj_delete_at_hint.0000000033","obj_delete_at_hint.0000000025","bucket.sync-status.e658a22d-79d5-4296-b285-f122e7115b09:ejuwhf-12:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.21","obj_delete_at_hint.0000000123","bucket.sync-status.e658a22d-79d5-4296-b285-f122e7115b09:ejuwhf-38:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.47","obj_delete_at_hint.0000000108","obj_delete_at_hint.0000000094","bucket.sync-status.e658a22d-79d5-4296-b285-f122e7115b09:ejuwhf-19:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.28","bucket.sync-status.671230a8-4b04-4e98-83d8-0a04dcd55dc0:ejuwhf-46:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4825.3","obj_delete_at_hint.0000000060","obj_delete_at_hint.0000000109","2021-02-13-17-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.6-ejuwhf-6","obj_delete_at_hint.0000000013","2021-02-13-18-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.46-ejuwhf-37","2021-02-13-18-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4825.4-ejuwhf-47","bucket.sync-status.e658a22d-79d5-4296-b285-f122e7115b09:ejuwhf-24:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.33","obj_delete_at_hint.0000000051","obj_delete_at_hint.0000000106","2021-02-13-18-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.23-ejuwhf-14","2021-02-13-18-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.26-ejuwhf-17","bucket.sync-status.671230a8-4b04-4e98-83d8-0a04dcd55dc0:ejuwhf-26:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.35","obj_delete_at_hint.0000000017","2021-02-13-18-671230a8-4b04-4e98-83d8-0a04dcd55dc0.4825.5-ejuwhf-48","obj_delete_at_hint.0000000023","obj_delete_at_hint.0000000107","obj_delete_at_hint.0000000046","meta.full-sync.index.2","data_log.2","meta.log.138dc4ba-dc02-4957-87c3-e8bf2d80917c.3","obj_delete_at_hint.0000000067","2021-02-13-18-e658a22d-79d5-4296-b285-f122e7115b09.7499.1-ejuwhf-42","bucket.sync-status.e658a22d-79d5-4296-b285-f122e7115b09:ejuwhf-48:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4825.5","datalog.sync-status.shard.e658a22d-79d5-4296-b285-f122e7115b09.2.retry","obj_delete_at_hint.0000000086","datalog.sync-status.671230a8-4b04-4e98-83d8-0a04dcd55dc0","bucket.sync-status.671230a8-4b04-4e98-83d8-0a04dcd55dc0:ejuwhf-11:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.20","data.full-sync.index.671230a8-4b04-4e98-83d8-0a04dcd55dc0.1","bucket.sync-status.671230a8-4b04-4e98-83d8-0a04dcd55dc0:ejuwhf-12:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.21","meta.log.87cf2a0e-b653-4b98-b23c-48172347acb4.3","2021-02-13-18-671230a8-4b04-4e98-83d8-0a04dcd55dc0.5112.9-ejuwhf-58","obj_delete_at_hint.0000000050","obj_delete_at_hint.0000000102","obj_delete_at_hint.0000000124","obj_delete_at_hint.0000000001","datalog.sync-status.e658a22d-79d5-4296-b285-f122e7115b09","bucket.sync-status.671230a8-4b04-4e98-83d8-0a04dcd55dc0:ejuwhf-22:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.31","obj_delete_at_hint.0000000126","obj_delete_at_hint.0000000055","obj_delete_at_hint.0000000061","bucket.sync-status.671230a8-4b04-4e98-83d8-0a04dcd55dc0:ejuwhf-24:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.33","obj_delete_at_hint.0000000097","meta.log.c72c9bb6-7372-4355-b488-0f51f8a5cecb.3","obj_delete_at_hint.0000000042","obj_delete_at_hint.0000000075","obj_delete_at_hint.0000000120","obj_delete_at_hint.0000000030","data.full-sync.index.e658a22d-79d5-4296-b285-f122e7115b09.2"] 2021-02-13T18:47:22.256 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['log', 'list', '--rgw-zone', 'test-zone4', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:47:22.256 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'log', 'list', '--rgw-zone', 'test-zone4', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:47:22.257 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 log list --rgw-zone test-zone4 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:47:22.387 INFO:teuthology.orchestra.run.gibba036.stdout:["obj_delete_at_hint.0000000078","meta.history","data.full-sync.index.671230a8-4b04-4e98-83d8-0a04dcd55dc0.3","obj_delete_at_hint.0000000070","bucket.sync-status.671230a8-4b04-4e98-83d8-0a04dcd55dc0:ejuwhf-20:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.29","obj_delete_at_hint.0000000104","obj_delete_at_hint.0000000026","obj_delete_at_hint.0000000028","bucket.sync-status.671230a8-4b04-4e98-83d8-0a04dcd55dc0:ejuwhf-15:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.24","obj_delete_at_hint.0000000040","meta.full-sync.index.0","obj_delete_at_hint.0000000015","bucket.sync-status.671230a8-4b04-4e98-83d8-0a04dcd55dc0:ejuwhf-14:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.23","obj_delete_at_hint.0000000069","obj_delete_at_hint.0000000095","obj_delete_at_hint.0000000003","obj_delete_at_hint.0000000047","obj_delete_at_hint.0000000035","obj_delete_at_hint.0000000037","obj_delete_at_hint.0000000024","data.full-sync.index.671230a8-4b04-4e98-83d8-0a04dcd55dc0.0","obj_delete_at_hint.0000000000","obj_delete_at_hint.0000000031","bucket.sync-status.671230a8-4b04-4e98-83d8-0a04dcd55dc0:ejuwhf-48:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4825.5","datalog.sync-status.shard.671230a8-4b04-4e98-83d8-0a04dcd55dc0.3","bucket.sync-status.671230a8-4b04-4e98-83d8-0a04dcd55dc0:ejuwhf-38:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.47","obj_delete_at_hint.0000000076","obj_delete_at_hint.0000000113","obj_delete_at_hint.0000000005","obj_delete_at_hint.0000000011","obj_delete_at_hint.0000000058","obj_delete_at_hint.0000000052","meta.log.138dc4ba-dc02-4957-87c3-e8bf2d80917c.2","bucket.sync-status.671230a8-4b04-4e98-83d8-0a04dcd55dc0:ejuwhf-21:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.30","obj_delete_at_hint.0000000088","obj_delete_at_hint.0000000080","obj_delete_at_hint.0000000090","obj_delete_at_hint.0000000110","obj_delete_at_hint.0000000096","obj_delete_at_hint.0000000087","obj_delete_at_hint.0000000008","data.full-sync.index.671230a8-4b04-4e98-83d8-0a04dcd55dc0.2","obj_delete_at_hint.0000000006","obj_delete_at_hint.0000000029","obj_delete_at_hint.0000000089","obj_delete_at_hint.0000000022","datalog.sync-status.shard.671230a8-4b04-4e98-83d8-0a04dcd55dc0.1","bilog.trim","obj_delete_at_hint.0000000016","obj_delete_at_hint.0000000041","obj_delete_at_hint.0000000018","obj_delete_at_hint.0000000092","bucket.sync-status.671230a8-4b04-4e98-83d8-0a04dcd55dc0:ejuwhf-36:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.45","obj_delete_at_hint.0000000014","bucket.sync-status.671230a8-4b04-4e98-83d8-0a04dcd55dc0:ejuwhf-49:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4973.1","datalog.sync-status.shard.671230a8-4b04-4e98-83d8-0a04dcd55dc0.2","obj_delete_at_hint.0000000112","obj_delete_at_hint.0000000007","obj_delete_at_hint.0000000021","obj_delete_at_hint.0000000064","obj_delete_at_hint.0000000071","obj_delete_at_hint.0000000074","obj_delete_at_hint.0000000081","obj_delete_at_hint.0000000009","obj_delete_at_hint.0000000121","obj_delete_at_hint.0000000125","obj_delete_at_hint.0000000082","meta.full-sync.index.1","obj_delete_at_hint.0000000105","obj_delete_at_hint.0000000059","bucket.sync-status.671230a8-4b04-4e98-83d8-0a04dcd55dc0:ejuwhf-47:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4825.4","meta.log.138dc4ba-dc02-4957-87c3-e8bf2d80917c.0","datalog.sync-status.shard.671230a8-4b04-4e98-83d8-0a04dcd55dc0.2.retry","obj_delete_at_hint.0000000077","obj_delete_at_hint.0000000032","obj_delete_at_hint.0000000053","obj_delete_at_hint.0000000091","datalog.sync-status.shard.671230a8-4b04-4e98-83d8-0a04dcd55dc0.0","obj_delete_at_hint.0000000065","obj_delete_at_hint.0000000083","obj_delete_at_hint.0000000010","bucket.sync-status.671230a8-4b04-4e98-83d8-0a04dcd55dc0:ejuwhf-13:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.22","mdlog.sync-status.shard.2","obj_delete_at_hint.0000000045","bucket.sync-status.671230a8-4b04-4e98-83d8-0a04dcd55dc0:ejuwhf-19:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.28","obj_delete_at_hint.0000000002","obj_delete_at_hint.0000000116","obj_delete_at_hint.0000000034","obj_delete_at_hint.0000000101","bucket.sync-status.671230a8-4b04-4e98-83d8-0a04dcd55dc0:ejuwhf-37:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.46","mdlog.sync-status.shard.1","obj_delete_at_hint.0000000079","obj_delete_at_hint.0000000049","obj_delete_at_hint.0000000117","obj_delete_at_hint.0000000044","bucket.sync-status.671230a8-4b04-4e98-83d8-0a04dcd55dc0:ejuwhf-23:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.32","obj_delete_at_hint.0000000066","obj_delete_at_hint.0000000068","obj_delete_at_hint.0000000085","bucket.sync-status.671230a8-4b04-4e98-83d8-0a04dcd55dc0:ejuwhf-25:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.34","obj_delete_at_hint.0000000073","obj_delete_at_hint.0000000038","meta.full-sync.index.3","obj_delete_at_hint.0000000118","obj_delete_at_hint.0000000036","obj_delete_at_hint.0000000103","mdlog.sync-status.shard.3","obj_delete_at_hint.0000000119","obj_delete_at_hint.0000000098","mdlog.sync-status.shard.0","obj_delete_at_hint.0000000027","mdlog.sync-status","obj_delete_at_hint.0000000019","obj_delete_at_hint.0000000039","obj_delete_at_hint.0000000100","bucket.sync-status.671230a8-4b04-4e98-83d8-0a04dcd55dc0:ejuwhf-10:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.19","obj_delete_at_hint.0000000093","obj_delete_at_hint.0000000004","obj_delete_at_hint.0000000063","obj_delete_at_hint.0000000122","obj_delete_at_hint.0000000057","bucket.sync-status.671230a8-4b04-4e98-83d8-0a04dcd55dc0:ejuwhf-16:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.25","obj_delete_at_hint.0000000054","obj_delete_at_hint.0000000114","bucket.sync-status.671230a8-4b04-4e98-83d8-0a04dcd55dc0:ejuwhf-17:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.26","obj_delete_at_hint.0000000012","obj_delete_at_hint.0000000084","obj_delete_at_hint.0000000043","obj_delete_at_hint.0000000111","obj_delete_at_hint.0000000048","obj_delete_at_hint.0000000020","obj_delete_at_hint.0000000099","obj_delete_at_hint.0000000056","obj_delete_at_hint.0000000072","obj_delete_at_hint.0000000062","obj_delete_at_hint.0000000115","obj_delete_at_hint.0000000033","obj_delete_at_hint.0000000025","obj_delete_at_hint.0000000123","obj_delete_at_hint.0000000108","obj_delete_at_hint.0000000094","bucket.sync-status.671230a8-4b04-4e98-83d8-0a04dcd55dc0:ejuwhf-46:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4825.3","obj_delete_at_hint.0000000060","obj_delete_at_hint.0000000109","obj_delete_at_hint.0000000013","obj_delete_at_hint.0000000051","obj_delete_at_hint.0000000106","bucket.sync-status.671230a8-4b04-4e98-83d8-0a04dcd55dc0:ejuwhf-26:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.35","obj_delete_at_hint.0000000017","obj_delete_at_hint.0000000023","obj_delete_at_hint.0000000107","obj_delete_at_hint.0000000046","meta.full-sync.index.2","meta.log.138dc4ba-dc02-4957-87c3-e8bf2d80917c.3","obj_delete_at_hint.0000000067","obj_delete_at_hint.0000000086","datalog.sync-status.671230a8-4b04-4e98-83d8-0a04dcd55dc0","bucket.sync-status.671230a8-4b04-4e98-83d8-0a04dcd55dc0:ejuwhf-11:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.20","data.full-sync.index.671230a8-4b04-4e98-83d8-0a04dcd55dc0.1","bucket.sync-status.671230a8-4b04-4e98-83d8-0a04dcd55dc0:ejuwhf-12:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.21","meta.log.87cf2a0e-b653-4b98-b23c-48172347acb4.3","obj_delete_at_hint.0000000050","obj_delete_at_hint.0000000102","obj_delete_at_hint.0000000124","obj_delete_at_hint.0000000001","bucket.sync-status.671230a8-4b04-4e98-83d8-0a04dcd55dc0:ejuwhf-22:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.31","obj_delete_at_hint.0000000126","obj_delete_at_hint.0000000055","obj_delete_at_hint.0000000061","bucket.sync-status.671230a8-4b04-4e98-83d8-0a04dcd55dc0:ejuwhf-24:671230a8-4b04-4e98-83d8-0a04dcd55dc0.4336.33","obj_delete_at_hint.0000000097","meta.log.c72c9bb6-7372-4355-b488-0f51f8a5cecb.3","obj_delete_at_hint.0000000042","obj_delete_at_hint.0000000075","obj_delete_at_hint.0000000120","obj_delete_at_hint.0000000030"] 2021-02-13T18:47:22.481 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:47:22.481 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:47:22.481 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:47:22.602 INFO:teuthology.orchestra.run.gibba025.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613242041.895875_322.1","last_update":"2021-02-13 18:47:21.895875Z"},{"marker":"","last_update":"0.000000"}] 2021-02-13T18:47:22.602 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone2 source_zone=test-zone1 2021-02-13T18:47:22.602 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:47:22.602 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:47:22.603 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:47:22.687 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":9215454569906789344},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}},{"key":1,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1613241904.294235_291.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:45:04.294235Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}}]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:47:22.687 WARNING:rgw_multi.tests:data of zone test-zone2 behind zone test-zone1: shard=2 master=1_1613242041.895875_322.1 target=1_1613241904.294235_291.1 2021-02-13T18:47:27.688 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:47:27.688 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:47:27.689 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:47:27.783 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":9215454569906789344},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}},{"key":1,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1613241904.294235_291.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:45:04.294235Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}}]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:47:27.784 WARNING:rgw_multi.tests:data of zone test-zone2 behind zone test-zone1: shard=2 master=1_1613242041.895875_322.1 target=1_1613241904.294235_291.1 2021-02-13T18:47:32.785 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:47:32.785 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:47:32.786 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:47:32.877 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":9215454569906789344},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}},{"key":1,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1613241904.294235_291.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:45:04.294235Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}}]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:47:32.877 WARNING:rgw_multi.tests:data of zone test-zone2 behind zone test-zone1: shard=2 master=1_1613242041.895875_322.1 target=1_1613241904.294235_291.1 2021-02-13T18:47:37.878 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:47:37.878 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:47:37.878 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:47:37.969 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":9215454569906789344},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}},{"key":1,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1613241904.294235_291.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:45:04.294235Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}}]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:47:37.970 WARNING:rgw_multi.tests:data of zone test-zone2 behind zone test-zone1: shard=2 master=1_1613242041.895875_322.1 target=1_1613241904.294235_291.1 2021-02-13T18:47:42.970 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:47:42.971 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:47:42.971 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:47:43.057 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":9215454569906789344},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}},{"key":1,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1613241904.294235_291.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:45:04.294235Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}}]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:47:43.058 WARNING:rgw_multi.tests:data of zone test-zone2 behind zone test-zone1: shard=2 master=1_1613242041.895875_322.1 target=1_1613241904.294235_291.1 2021-02-13T18:47:48.059 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:47:48.059 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:47:48.059 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:47:48.165 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":9215454569906789344},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}},{"key":1,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1613241904.294235_291.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:45:04.294235Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}}]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:47:48.166 WARNING:rgw_multi.tests:data of zone test-zone2 behind zone test-zone1: shard=2 master=1_1613242041.895875_322.1 target=1_1613241904.294235_291.1 2021-02-13T18:47:53.167 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:47:53.167 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:47:53.168 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:47:53.251 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":9215454569906789344},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}},{"key":1,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1613241904.294235_291.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:45:04.294235Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}}]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:47:53.252 WARNING:rgw_multi.tests:data of zone test-zone2 behind zone test-zone1: shard=2 master=1_1613242041.895875_322.1 target=1_1613241904.294235_291.1 2021-02-13T18:47:58.253 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:47:58.253 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:47:58.254 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:47:58.343 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":9215454569906789344},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}},{"key":1,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1613241904.294235_291.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:45:04.294235Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}}]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:47:58.343 WARNING:rgw_multi.tests:data of zone test-zone2 behind zone test-zone1: shard=2 master=1_1613242041.895875_322.1 target=1_1613241904.294235_291.1 2021-02-13T18:48:03.344 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:48:03.345 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:48:03.345 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:48:03.435 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":9215454569906789344},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}},{"key":1,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1613241904.294235_291.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:45:04.294235Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}}]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:48:03.435 WARNING:rgw_multi.tests:data of zone test-zone2 behind zone test-zone1: shard=2 master=1_1613242041.895875_322.1 target=1_1613241904.294235_291.1 2021-02-13T18:48:08.437 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:48:08.437 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:48:08.438 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:48:08.528 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":9215454569906789344},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}},{"key":1,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1613241904.294235_291.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:45:04.294235Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}}]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:48:08.528 WARNING:rgw_multi.tests:data of zone test-zone2 behind zone test-zone1: shard=2 master=1_1613242041.895875_322.1 target=1_1613241904.294235_291.1 2021-02-13T18:48:13.529 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:48:13.530 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:48:13.530 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:48:13.618 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":9215454569906789344},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}},{"key":1,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1613241904.294235_291.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:45:04.294235Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}}]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:48:13.619 WARNING:rgw_multi.tests:data of zone test-zone2 behind zone test-zone1: shard=2 master=1_1613242041.895875_322.1 target=1_1613241904.294235_291.1 2021-02-13T18:48:18.620 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:48:18.620 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:48:18.621 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:48:18.711 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":9215454569906789344},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}},{"key":1,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1613242041.895875_322.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:47:21.895875Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}}]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:48:18.711 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone2 source_zone=test-zone1 2021-02-13T18:48:18.711 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:48:18.711 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:48:18.711 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:48:18.790 INFO:teuthology.orchestra.run.gibba025.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613242041.895875_322.1","last_update":"2021-02-13 18:47:21.895875Z"},{"marker":"","last_update":"0.000000"}] 2021-02-13T18:48:18.790 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone3 source_zone=test-zone1 2021-02-13T18:48:18.790 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:48:18.790 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:48:18.791 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 data sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:48:18.862 INFO:teuthology.orchestra.run.gibba025.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":14269803611187996617},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}},{"key":1,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1613242041.895875_322.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:47:21.895875Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}}]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:48:18.863 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone3 source_zone=test-zone1 2021-02-13T18:48:18.863 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:48:18.863 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:48:18.863 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:48:18.944 INFO:teuthology.orchestra.run.gibba025.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613242041.895875_322.1","last_update":"2021-02-13 18:47:21.895875Z"},{"marker":"","last_update":"0.000000"}] 2021-02-13T18:48:18.945 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone4 source_zone=test-zone1 2021-02-13T18:48:18.945 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:48:18.945 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:48:18.945 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:48:19.163 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":12459298034563774542},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}},{"key":1,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1613242041.895875_322.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:47:21.895875Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}}]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:48:19.163 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone4 source_zone=test-zone1 2021-02-13T18:48:19.163 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:48:19.163 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:48:19.163 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 datalog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:48:19.251 INFO:teuthology.orchestra.run.gibba036.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613241928.837424_104.1","last_update":"2021-02-13 18:45:28.837424Z"},{"marker":"","last_update":"0.000000"}] 2021-02-13T18:48:19.252 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone1 source_zone=test-zone2 2021-02-13T18:48:19.252 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:48:19.252 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:48:19.252 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 data sync status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:48:19.343 INFO:teuthology.orchestra.run.gibba025.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":8180628171309102746},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}},{"key":1,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1613241928.837424_104.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:45:28.837424Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}}]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:48:19.344 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone1 source_zone=test-zone2 2021-02-13T18:48:19.344 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:48:19.344 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:48:19.344 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 datalog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:48:19.425 INFO:teuthology.orchestra.run.gibba036.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613241928.837424_104.1","last_update":"2021-02-13 18:45:28.837424Z"},{"marker":"","last_update":"0.000000"}] 2021-02-13T18:48:19.425 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone3 source_zone=test-zone2 2021-02-13T18:48:19.425 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:48:19.425 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:48:19.426 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 data sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:48:19.548 INFO:teuthology.orchestra.run.gibba025.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":8104376224174622872},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}},{"key":1,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1613241928.837424_104.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:45:28.837424Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000"}}]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:48:19.548 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone3 source_zone=test-zone2 2021-02-13T18:48:19.549 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:48:19.549 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:48:19.549 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 datalog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:48:19.643 INFO:teuthology.orchestra.run.gibba036.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613241928.837424_104.1","last_update":"2021-02-13 18:45:28.837424Z"},{"marker":"","last_update":"0.000000"}] 2021-02-13T18:48:19.643 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone4 source_zone=test-zone2 2021-02-13T18:48:19.643 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:48:19.643 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:48:19.643 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:48:19.839 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:48:19.840 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:48:24.841 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:48:24.841 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:48:24.842 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:48:25.023 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:48:25.023 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:48:30.024 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:48:30.024 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:48:30.024 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:48:30.204 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:48:30.205 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:48:35.205 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:48:35.206 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:48:35.206 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:48:35.390 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:48:35.390 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:48:40.396 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:48:40.396 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:48:40.396 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:48:40.582 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:48:40.582 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:48:45.591 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:48:45.592 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:48:45.592 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:48:45.777 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:48:45.777 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:48:50.778 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:48:50.778 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:48:50.779 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:48:50.961 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:48:50.961 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:48:55.962 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:48:55.963 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:48:55.963 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:48:56.144 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:48:56.145 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:49:01.146 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:49:01.146 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:49:01.147 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:49:01.329 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:49:01.330 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:49:06.335 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:49:06.336 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:49:06.336 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:49:06.530 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:49:06.530 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:49:11.531 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:49:11.531 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:49:11.532 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:49:11.711 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:49:11.711 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:49:16.712 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:49:16.712 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:49:16.712 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:49:16.896 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:49:16.896 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:49:21.897 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:49:21.898 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:49:21.898 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:49:22.073 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:49:22.073 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:49:27.074 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:49:27.074 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:49:27.074 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:49:27.256 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:49:27.256 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:49:32.257 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:49:32.258 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:49:32.258 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:49:32.435 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:49:32.436 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:49:37.436 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:49:37.437 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:49:37.438 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:49:37.625 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:49:37.626 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:49:42.627 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:49:42.627 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:49:42.628 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:49:42.811 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:49:42.812 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:49:47.813 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:49:47.813 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:49:47.813 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:49:47.999 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:49:47.999 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:49:53.001 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:49:53.001 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:49:53.001 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:49:53.187 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:49:53.187 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:49:58.188 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:49:58.189 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:49:58.189 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:49:58.373 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:49:58.373 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:50:03.374 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:50:03.375 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:50:03.375 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:50:03.560 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:50:03.560 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:50:08.562 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:50:08.562 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:50:08.562 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:50:08.746 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:50:08.746 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:50:13.747 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:50:13.748 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:50:13.748 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:50:13.926 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:50:13.926 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:50:18.927 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:50:18.928 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:50:18.928 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:50:19.112 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:50:19.112 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:50:24.113 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:50:24.114 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:50:24.114 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:50:24.292 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:50:24.293 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:50:29.294 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:50:29.294 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:50:29.295 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:50:29.482 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:50:29.482 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:50:34.483 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:50:34.483 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:50:34.483 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:50:34.669 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:50:34.669 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:50:39.670 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:50:39.670 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:50:39.671 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:50:39.851 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:50:39.852 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:50:44.852 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:50:44.853 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:50:44.853 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:50:45.034 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:50:45.034 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:50:50.034 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:50:50.035 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:50:50.035 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:50:50.207 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:50:50.208 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:50:55.209 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:50:55.209 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:50:55.209 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:50:55.393 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:50:55.394 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:51:00.394 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:51:00.394 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:51:00.395 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:51:00.576 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:51:00.576 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:51:05.577 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:51:05.577 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:51:05.578 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:51:05.762 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:51:05.762 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:51:10.764 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:51:10.764 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:51:10.765 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:51:10.947 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:51:10.947 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:51:15.949 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:51:15.949 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:51:15.949 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:51:16.133 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:51:16.133 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:51:21.134 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:51:21.134 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:51:21.134 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:51:21.312 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:51:21.312 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:51:26.314 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:51:26.314 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:51:26.315 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:51:26.493 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:51:26.494 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:51:31.495 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:51:31.495 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:51:31.496 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:51:31.706 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:51:31.706 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:51:36.707 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:51:36.707 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:51:36.708 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:51:36.893 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:51:36.893 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:51:41.894 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:51:41.894 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:51:41.894 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:51:42.078 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:51:42.078 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:51:47.080 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:51:47.080 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:51:47.081 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:51:47.261 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:51:47.261 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:51:52.262 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:51:52.262 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:51:52.263 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:51:52.448 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:51:52.448 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:51:57.449 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:51:57.450 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:51:57.450 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:51:57.631 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:51:57.631 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:52:02.632 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:52:02.948 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:52:02.948 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:52:03.126 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:52:03.127 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:52:08.127 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:52:08.128 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:52:08.128 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:52:08.319 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:52:08.319 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:52:13.320 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:52:13.321 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:52:13.321 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:52:13.497 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:52:13.497 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:52:18.498 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:52:18.498 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:52:18.498 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:52:18.681 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:52:18.681 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:52:23.682 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:52:23.682 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:52:23.683 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:52:23.859 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:52:23.860 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:52:28.861 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:52:28.861 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:52:28.861 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:52:29.046 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:52:29.046 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:52:34.047 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:52:34.047 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:52:34.048 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:52:34.227 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:52:34.227 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:52:39.227 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:52:39.228 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:52:39.228 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:52:39.413 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:52:39.413 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:52:44.414 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:52:44.415 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:52:44.415 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:52:44.596 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:52:44.597 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:52:49.598 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:52:49.598 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:52:49.599 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:52:49.777 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:52:49.777 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:52:54.778 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:52:54.778 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:52:54.778 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:52:54.953 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:52:54.954 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:52:59.955 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:52:59.956 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:52:59.956 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:53:00.139 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:53:00.139 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:53:05.140 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:53:05.288 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:53:05.289 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:53:05.467 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:53:05.468 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:53:10.469 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:53:10.469 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:53:10.469 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:53:10.657 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:53:10.658 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:53:15.659 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:53:15.659 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:53:15.659 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:53:15.846 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:53:15.847 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:53:20.847 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:53:20.848 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:53:20.848 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:53:21.031 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:53:21.032 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:53:26.033 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:53:26.033 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:53:26.033 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:53:26.213 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"init","num_shards":0,"instance_id":0},"markers":[]},"full_sync":{"total":0,"complete":0}} 2021-02-13T18:53:26.213 ERROR:rgw_multi.tests:len(log_status)=4 len(sync_status)=0 2021-02-13T18:53:31.240 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.tests.test_bucket_sync_disable ... FAIL 2021-02-13T18:53:31.241 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=ejuwhf-59 2021-02-13T18:53:31.314 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=ejuwhf-60 2021-02-13T18:53:31.426 INFO:rgw_multi.tests:create bucket zone=test-zone3 name=ejuwhf-61 2021-02-13T18:53:32.143 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-59', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:53:32.143 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-59', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:53:32.143 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ejuwhf-59 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:53:32.265 INFO:teuthology.orchestra.run.gibba025.stdout:{"markers":[{"key":0,"val":"00000000008.10.5"}]} 2021-02-13T18:53:32.266 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=ejuwhf-59 2021-02-13T18:53:32.266 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:53:32.266 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:53:32.266 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ejuwhf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:53:32.339 INFO:teuthology.orchestra.run.gibba036.stderr:could not get bucket info for bucket=ejuwhf-59 2021-02-13T18:53:32.339 INFO:teuthology.orchestra.run.gibba036.stderr:ERROR: could not init bucket: (2) No such file or directory 2021-02-13T18:53:32.353 DEBUG:teuthology.orchestra.run:got remote process result: 2 2021-02-13T18:53:32.353 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:53:32.353 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:53:32.354 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ejuwhf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:53:32.426 INFO:teuthology.orchestra.run.gibba036.stderr:could not get bucket info for bucket=2021-02-13 18:53:32.423 7fdef87a9940 -1 ERROR: get_bucket_instance_from_oid failed: -2ejuwhf-59 2021-02-13T18:53:32.426 INFO:teuthology.orchestra.run.gibba036.stderr: 2021-02-13T18:53:32.426 INFO:teuthology.orchestra.run.gibba036.stderr:ERROR: could not init bucket: (2) No such file or directory 2021-02-13T18:53:32.439 DEBUG:teuthology.orchestra.run:got remote process result: 2 2021-02-13T18:53:32.439 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:53:32.439 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:53:32.440 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ejuwhf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:53:32.523 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:53:32.524 WARNING:rgw_multi.tests:bucket ejuwhf-59 zone test-zone2 behind zone test-zone1: shard=0 master=00000000008.10.5 target= 2021-02-13T18:53:37.525 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:53:37.525 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:53:37.525 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ejuwhf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:53:37.614 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj4","instance":"","ns":""},"count":4},"inc_marker":{"position":"0#00000000008.10.5"}}}] 2021-02-13T18:53:37.615 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=ejuwhf-59 2021-02-13T18:53:37.615 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-59', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:53:37.615 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-59', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:53:37.615 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ejuwhf-59 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:53:37.694 INFO:teuthology.orchestra.run.gibba025.stdout:{"markers":[{"key":0,"val":"00000000008.10.5"}]} 2021-02-13T18:53:37.694 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=ejuwhf-59 2021-02-13T18:53:37.695 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-59', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:53:37.695 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-59', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:53:37.695 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ejuwhf-59 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:53:37.783 INFO:teuthology.orchestra.run.gibba025.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj4","instance":"","ns":""},"count":4},"inc_marker":{"position":"0#00000000008.10.5"}}}] 2021-02-13T18:53:37.783 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=ejuwhf-59 2021-02-13T18:53:37.783 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-59', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:53:37.783 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-59', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:53:37.784 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ejuwhf-59 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:53:37.876 INFO:teuthology.orchestra.run.gibba025.stdout:{"markers":[{"key":0,"val":"00000000008.10.5"}]} 2021-02-13T18:53:37.877 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone4 source_zone=test-zone1 bucket=ejuwhf-59 2021-02-13T18:53:37.877 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:53:37.877 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:53:37.877 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ejuwhf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:53:38.057 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj4","instance":"","ns":""},"count":4},"inc_marker":{"position":"0#00000000008.10.5"}}}] 2021-02-13T18:53:38.057 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone4 source_zone=test-zone1 bucket=ejuwhf-59 2021-02-13T18:53:38.058 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:53:38.058 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:53:38.058 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ejuwhf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:53:38.135 INFO:teuthology.orchestra.run.gibba036.stdout:{"markers":[{"key":0,"val":"00000000008.10.5"}]} 2021-02-13T18:53:38.135 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=ejuwhf-59 2021-02-13T18:53:38.135 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:53:38.135 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:53:38.136 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-59 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:53:38.220 INFO:teuthology.orchestra.run.gibba025.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj4","instance":"","ns":""},"count":4},"inc_marker":{"position":"0#00000000008.10.5"}}}] 2021-02-13T18:53:38.221 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=ejuwhf-59 2021-02-13T18:53:38.221 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:53:38.221 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:53:38.221 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ejuwhf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:53:38.339 INFO:teuthology.orchestra.run.gibba036.stdout:{"markers":[{"key":0,"val":"00000000008.10.5"}]} 2021-02-13T18:53:38.340 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone2 bucket=ejuwhf-59 2021-02-13T18:53:38.340 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:53:38.340 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:53:38.340 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-59 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:53:38.429 INFO:teuthology.orchestra.run.gibba025.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj4","instance":"","ns":""},"count":4},"inc_marker":{"position":"0#00000000008.10.5"}}}] 2021-02-13T18:53:38.430 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone2 bucket=ejuwhf-59 2021-02-13T18:53:38.430 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:53:38.430 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:53:38.430 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ejuwhf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:53:38.553 INFO:teuthology.orchestra.run.gibba036.stdout:{"markers":[{"key":0,"val":"00000000008.10.5"}]} 2021-02-13T18:53:38.553 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone4 source_zone=test-zone2 bucket=ejuwhf-59 2021-02-13T18:53:38.554 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:53:38.554 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:53:38.554 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:53:38.732 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:53:38.733 WARNING:rgw_multi.tests:bucket ejuwhf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.10.5 target= 2021-02-13T18:53:43.734 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:53:43.734 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:53:43.734 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:53:43.921 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:53:43.921 WARNING:rgw_multi.tests:bucket ejuwhf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.10.5 target= 2021-02-13T18:53:48.923 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:53:48.923 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:53:48.923 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:53:49.110 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:53:49.110 WARNING:rgw_multi.tests:bucket ejuwhf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.10.5 target= 2021-02-13T18:53:54.111 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:53:54.111 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:53:54.112 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:53:54.297 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:53:54.297 WARNING:rgw_multi.tests:bucket ejuwhf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.10.5 target= 2021-02-13T18:53:59.298 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:53:59.299 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:53:59.299 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:53:59.483 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:53:59.484 WARNING:rgw_multi.tests:bucket ejuwhf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.10.5 target= 2021-02-13T18:54:04.485 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:54:04.485 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:54:04.485 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:54:04.666 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:54:04.666 WARNING:rgw_multi.tests:bucket ejuwhf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.10.5 target= 2021-02-13T18:54:09.667 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:54:09.667 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:54:09.668 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:54:09.853 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:54:09.853 WARNING:rgw_multi.tests:bucket ejuwhf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.10.5 target= 2021-02-13T18:54:14.854 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:54:14.854 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:54:14.855 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:54:15.032 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:54:15.033 WARNING:rgw_multi.tests:bucket ejuwhf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.10.5 target= 2021-02-13T18:54:20.034 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:54:20.034 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:54:20.034 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:54:20.212 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:54:20.212 WARNING:rgw_multi.tests:bucket ejuwhf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.10.5 target= 2021-02-13T18:54:25.214 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:54:25.214 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:54:25.214 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:54:25.399 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:54:25.399 WARNING:rgw_multi.tests:bucket ejuwhf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.10.5 target= 2021-02-13T18:54:30.400 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:54:30.400 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:54:30.401 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:54:30.585 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:54:30.585 WARNING:rgw_multi.tests:bucket ejuwhf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.10.5 target= 2021-02-13T18:54:35.586 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:54:35.586 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:54:35.587 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:54:35.765 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:54:35.765 WARNING:rgw_multi.tests:bucket ejuwhf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.10.5 target= 2021-02-13T18:54:40.766 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:54:40.767 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:54:40.767 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:54:40.946 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:54:40.947 WARNING:rgw_multi.tests:bucket ejuwhf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.10.5 target= 2021-02-13T18:54:45.947 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:54:45.948 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:54:45.948 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:54:46.134 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:54:46.135 WARNING:rgw_multi.tests:bucket ejuwhf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.10.5 target= 2021-02-13T18:54:51.135 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:54:51.136 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:54:51.136 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:54:51.315 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:54:51.316 WARNING:rgw_multi.tests:bucket ejuwhf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.10.5 target= 2021-02-13T18:54:56.316 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:54:56.317 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:54:56.317 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:54:56.503 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:54:56.504 WARNING:rgw_multi.tests:bucket ejuwhf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.10.5 target= 2021-02-13T18:55:01.504 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:55:01.504 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:55:01.505 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:55:01.689 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:55:01.690 WARNING:rgw_multi.tests:bucket ejuwhf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.10.5 target= 2021-02-13T18:55:06.691 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:55:06.691 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:55:06.691 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:55:06.878 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:55:06.878 WARNING:rgw_multi.tests:bucket ejuwhf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.10.5 target= 2021-02-13T18:55:11.879 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:55:11.880 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:55:11.880 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:55:12.065 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:55:12.065 WARNING:rgw_multi.tests:bucket ejuwhf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.10.5 target= 2021-02-13T18:55:17.066 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:55:17.066 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:55:17.067 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:55:17.252 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:55:17.253 WARNING:rgw_multi.tests:bucket ejuwhf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.10.5 target= 2021-02-13T18:55:22.253 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:55:22.254 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:55:22.254 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:55:22.437 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:55:22.437 WARNING:rgw_multi.tests:bucket ejuwhf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.10.5 target= 2021-02-13T18:55:27.438 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:55:27.439 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:55:27.439 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:55:27.625 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:55:27.625 WARNING:rgw_multi.tests:bucket ejuwhf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.10.5 target= 2021-02-13T18:55:32.627 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:55:32.627 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:55:32.627 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:55:32.805 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:55:32.806 WARNING:rgw_multi.tests:bucket ejuwhf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.10.5 target= 2021-02-13T18:55:37.807 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:55:37.807 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:55:37.807 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:55:37.996 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:55:37.997 WARNING:rgw_multi.tests:bucket ejuwhf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.10.5 target= 2021-02-13T18:55:42.997 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:55:42.998 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:55:42.998 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:55:43.183 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:55:43.184 WARNING:rgw_multi.tests:bucket ejuwhf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.10.5 target= 2021-02-13T18:55:48.184 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:55:48.185 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:55:48.185 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:55:48.363 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:55:48.364 WARNING:rgw_multi.tests:bucket ejuwhf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.10.5 target= 2021-02-13T18:55:53.365 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:55:53.365 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:55:53.365 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:55:53.548 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:55:53.548 WARNING:rgw_multi.tests:bucket ejuwhf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.10.5 target= 2021-02-13T18:55:58.549 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:55:58.550 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:55:58.550 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:55:58.731 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:55:58.731 WARNING:rgw_multi.tests:bucket ejuwhf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.10.5 target= 2021-02-13T18:56:03.732 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:56:03.732 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:56:03.733 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:56:03.909 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:56:03.910 WARNING:rgw_multi.tests:bucket ejuwhf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.10.5 target= 2021-02-13T18:56:08.910 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:56:08.910 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:56:08.911 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:56:09.098 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:56:09.098 WARNING:rgw_multi.tests:bucket ejuwhf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.10.5 target= 2021-02-13T18:56:14.099 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:56:14.099 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:56:14.099 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:56:14.278 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:56:14.278 WARNING:rgw_multi.tests:bucket ejuwhf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.10.5 target= 2021-02-13T18:56:19.279 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:56:19.279 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:56:19.280 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:56:19.458 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:56:19.459 WARNING:rgw_multi.tests:bucket ejuwhf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.10.5 target= 2021-02-13T18:56:24.460 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:56:24.460 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:56:24.461 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:56:24.648 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:56:24.648 WARNING:rgw_multi.tests:bucket ejuwhf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.10.5 target= 2021-02-13T18:56:29.649 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:56:29.649 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:56:29.650 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:56:29.835 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:56:29.836 WARNING:rgw_multi.tests:bucket ejuwhf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.10.5 target= 2021-02-13T18:56:34.837 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:56:34.837 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:56:34.838 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:56:35.023 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:56:35.024 WARNING:rgw_multi.tests:bucket ejuwhf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.10.5 target= 2021-02-13T18:56:40.025 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:56:40.025 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:56:40.025 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:56:40.203 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:56:40.203 WARNING:rgw_multi.tests:bucket ejuwhf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.10.5 target= 2021-02-13T18:56:45.204 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:56:45.205 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:56:45.205 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:56:45.392 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:56:45.392 WARNING:rgw_multi.tests:bucket ejuwhf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.10.5 target= 2021-02-13T18:56:50.393 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:56:50.394 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:56:50.394 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:56:50.580 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:56:50.581 WARNING:rgw_multi.tests:bucket ejuwhf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.10.5 target= 2021-02-13T18:56:55.582 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:56:55.582 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:56:55.582 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:56:55.760 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:56:55.761 WARNING:rgw_multi.tests:bucket ejuwhf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.10.5 target= 2021-02-13T18:57:00.761 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:57:00.761 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:57:00.762 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:57:00.946 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:57:00.946 WARNING:rgw_multi.tests:bucket ejuwhf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.10.5 target= 2021-02-13T18:57:05.948 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:57:05.948 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:57:05.948 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:57:06.127 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:57:06.127 WARNING:rgw_multi.tests:bucket ejuwhf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.10.5 target= 2021-02-13T18:57:11.129 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:57:11.129 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:57:11.129 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:57:11.309 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:57:11.309 WARNING:rgw_multi.tests:bucket ejuwhf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.10.5 target= 2021-02-13T18:57:16.311 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:57:16.311 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:57:16.311 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:57:16.498 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:57:16.499 WARNING:rgw_multi.tests:bucket ejuwhf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.10.5 target= 2021-02-13T18:57:21.499 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:57:21.500 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:57:21.500 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:57:21.679 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:57:21.679 WARNING:rgw_multi.tests:bucket ejuwhf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.10.5 target= 2021-02-13T18:57:26.680 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:57:26.681 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:57:26.681 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:57:26.864 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:57:26.865 WARNING:rgw_multi.tests:bucket ejuwhf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.10.5 target= 2021-02-13T18:57:31.866 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:57:31.866 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:57:31.866 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:57:32.264 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:57:32.267 WARNING:rgw_multi.tests:bucket ejuwhf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.10.5 target= 2021-02-13T18:57:37.269 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:57:37.269 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:57:37.269 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:57:37.455 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:57:37.455 WARNING:rgw_multi.tests:bucket ejuwhf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.10.5 target= 2021-02-13T18:57:42.455 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:57:42.456 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:57:42.456 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:57:42.636 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:57:42.637 WARNING:rgw_multi.tests:bucket ejuwhf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.10.5 target= 2021-02-13T18:57:47.638 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:57:47.638 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:57:47.638 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:57:47.828 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:57:47.828 WARNING:rgw_multi.tests:bucket ejuwhf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.10.5 target= 2021-02-13T18:57:52.829 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:57:52.829 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:57:52.829 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:57:53.013 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:57:53.013 WARNING:rgw_multi.tests:bucket ejuwhf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.10.5 target= 2021-02-13T18:57:58.015 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:57:58.015 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:57:58.016 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:57:58.203 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:57:58.204 WARNING:rgw_multi.tests:bucket ejuwhf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.10.5 target= 2021-02-13T18:58:03.204 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:58:03.205 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:58:03.205 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:58:03.388 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:58:03.493 WARNING:rgw_multi.tests:bucket ejuwhf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.10.5 target= 2021-02-13T18:58:08.493 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:58:08.493 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:58:08.494 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:58:08.677 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:58:08.677 WARNING:rgw_multi.tests:bucket ejuwhf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.10.5 target= 2021-02-13T18:58:13.678 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:58:13.678 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:58:13.679 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:58:13.863 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:58:13.864 WARNING:rgw_multi.tests:bucket ejuwhf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.10.5 target= 2021-02-13T18:58:18.864 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:58:18.865 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:58:18.865 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:58:19.050 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:58:19.050 WARNING:rgw_multi.tests:bucket ejuwhf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.10.5 target= 2021-02-13T18:58:24.052 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:58:24.052 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:58:24.053 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:58:24.234 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:58:24.234 WARNING:rgw_multi.tests:bucket ejuwhf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.10.5 target= 2021-02-13T18:58:29.236 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:58:29.236 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:58:29.236 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:58:29.428 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:58:29.428 WARNING:rgw_multi.tests:bucket ejuwhf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.10.5 target= 2021-02-13T18:58:34.430 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:58:34.430 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:58:34.430 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:58:34.615 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:58:34.616 WARNING:rgw_multi.tests:bucket ejuwhf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.10.5 target= 2021-02-13T18:58:39.616 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:58:39.617 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:58:39.617 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:58:39.796 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:58:39.797 WARNING:rgw_multi.tests:bucket ejuwhf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.10.5 target= 2021-02-13T18:58:44.798 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:58:44.798 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-59', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:58:44.799 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-59 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:58:44.975 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:58:44.975 WARNING:rgw_multi.tests:bucket ejuwhf-59 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.10.5 target= 2021-02-13T18:58:49.977 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.tests.test_bucket_sync_enable_right_after_disable ... FAIL 2021-02-13T18:58:49.978 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=ejuwhf-62 2021-02-13T18:58:50.019 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=ejuwhf-63 2021-02-13T18:58:50.065 INFO:rgw_multi.tests:create bucket zone=test-zone3 name=ejuwhf-64 2021-02-13T18:58:50.823 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:58:50.823 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:58:50.823 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:58:50.925 INFO:teuthology.orchestra.run.gibba025.stderr:No --period given, using current period=c72c9bb6-7372-4355-b488-0f51f8a5cecb 2021-02-13T18:58:50.940 INFO:teuthology.orchestra.run.gibba025.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613242730.128502_495.1","last_update":"2021-02-13 18:58:50.128502Z"}] 2021-02-13T18:58:50.940 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-02-13T18:58:50.940 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:58:50.940 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:58:50.941 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:58:51.027 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613242411.488753_453.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:53:31.488753Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:58:51.027 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=3 master=1_1613242730.128502_495.1 target=1_1613242411.488753_453.1 2021-02-13T18:58:56.028 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:58:56.028 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:58:56.029 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:58:56.118 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613242730.128502_495.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:58:50.128502Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:58:56.118 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-02-13T18:58:56.119 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-02-13T18:58:56.119 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:58:56.119 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:58:56.119 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:58:56.202 INFO:teuthology.orchestra.run.gibba025.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613242730.128502_495.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:58:50.128502Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:58:56.203 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-02-13T18:58:56.203 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T18:58:56.203 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:58:56.203 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:58:56.203 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:58:56.383 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613242730.128502_495.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 18:58:50.128502Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T18:58:56.384 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T18:58:56.384 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-62', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:58:56.384 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-62', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:58:56.384 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ejuwhf-62 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:58:56.465 INFO:teuthology.orchestra.run.gibba025.stdout:{"markers":[{"key":0,"val":"00000000008.18.5"}]} 2021-02-13T18:58:56.465 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=ejuwhf-62 2021-02-13T18:58:56.466 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:58:56.466 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:58:56.466 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ejuwhf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:58:56.559 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj4","instance":"","ns":""},"count":4},"inc_marker":{"position":"0#00000000008.18.5"}}}] 2021-02-13T18:58:56.560 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=ejuwhf-62 2021-02-13T18:58:56.560 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-62', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:58:56.560 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-62', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:58:56.560 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ejuwhf-62 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:58:56.680 INFO:teuthology.orchestra.run.gibba025.stdout:{"markers":[{"key":0,"val":"00000000008.18.5"}]} 2021-02-13T18:58:56.681 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=ejuwhf-62 2021-02-13T18:58:56.681 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-62', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:58:56.681 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-62', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:58:56.681 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ejuwhf-62 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:58:56.767 INFO:teuthology.orchestra.run.gibba025.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj4","instance":"","ns":""},"count":4},"inc_marker":{"position":"0#00000000008.18.5"}}}] 2021-02-13T18:58:56.767 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=ejuwhf-62 2021-02-13T18:58:56.767 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-62', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:58:56.767 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-62', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:58:56.767 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ejuwhf-62 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:58:56.863 INFO:teuthology.orchestra.run.gibba025.stdout:{"markers":[{"key":0,"val":"00000000008.18.5"}]} 2021-02-13T18:58:56.863 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone4 source_zone=test-zone1 bucket=ejuwhf-62 2021-02-13T18:58:56.864 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:58:56.864 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:58:56.864 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ejuwhf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:58:57.082 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj4","instance":"","ns":""},"count":4},"inc_marker":{"position":"0#00000000008.18.5"}}}] 2021-02-13T18:58:57.083 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone4 source_zone=test-zone1 bucket=ejuwhf-62 2021-02-13T18:58:57.083 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:58:57.083 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:58:57.083 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ejuwhf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:58:57.199 INFO:teuthology.orchestra.run.gibba036.stdout:{"markers":[{"key":0,"val":"00000000008.17.5"}]} 2021-02-13T18:58:57.200 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=ejuwhf-62 2021-02-13T18:58:57.200 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:58:57.200 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:58:57.200 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-62 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:58:57.327 INFO:teuthology.orchestra.run.gibba025.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj4","instance":"","ns":""},"count":4},"inc_marker":{"position":"0#00000000008.17.5"}}}] 2021-02-13T18:58:57.327 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=ejuwhf-62 2021-02-13T18:58:57.327 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:58:57.328 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:58:57.328 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ejuwhf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:58:57.449 INFO:teuthology.orchestra.run.gibba036.stdout:{"markers":[{"key":0,"val":"00000000008.17.5"}]} 2021-02-13T18:58:57.449 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone2 bucket=ejuwhf-62 2021-02-13T18:58:57.449 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:58:57.450 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:58:57.450 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-62 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:58:57.539 INFO:teuthology.orchestra.run.gibba025.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj4","instance":"","ns":""},"count":4},"inc_marker":{"position":"0#00000000008.17.5"}}}] 2021-02-13T18:58:57.539 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone2 bucket=ejuwhf-62 2021-02-13T18:58:57.540 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:58:57.540 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:58:57.540 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ejuwhf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:58:57.661 INFO:teuthology.orchestra.run.gibba036.stdout:{"markers":[{"key":0,"val":"00000000008.17.5"}]} 2021-02-13T18:58:57.662 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone4 source_zone=test-zone2 bucket=ejuwhf-62 2021-02-13T18:58:57.662 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:58:57.662 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:58:57.662 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:58:57.837 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:58:57.837 WARNING:rgw_multi.tests:bucket ejuwhf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.17.5 target= 2021-02-13T18:59:02.838 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:59:02.838 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:59:02.839 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:59:03.024 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:59:03.024 WARNING:rgw_multi.tests:bucket ejuwhf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.17.5 target= 2021-02-13T18:59:08.025 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:59:08.025 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:59:08.025 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:59:08.207 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:59:08.207 WARNING:rgw_multi.tests:bucket ejuwhf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.17.5 target= 2021-02-13T18:59:13.208 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:59:13.209 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:59:13.209 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:59:13.394 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:59:13.395 WARNING:rgw_multi.tests:bucket ejuwhf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.17.5 target= 2021-02-13T18:59:18.396 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:59:18.396 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:59:18.396 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:59:18.619 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:59:18.619 WARNING:rgw_multi.tests:bucket ejuwhf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.17.5 target= 2021-02-13T18:59:23.620 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:59:23.620 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:59:23.620 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:59:23.800 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:59:23.801 WARNING:rgw_multi.tests:bucket ejuwhf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.17.5 target= 2021-02-13T18:59:28.802 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:59:28.803 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:59:28.803 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:59:28.985 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:59:28.985 WARNING:rgw_multi.tests:bucket ejuwhf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.17.5 target= 2021-02-13T18:59:33.986 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:59:33.986 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:59:33.987 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:59:34.166 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:59:34.166 WARNING:rgw_multi.tests:bucket ejuwhf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.17.5 target= 2021-02-13T18:59:39.167 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:59:39.167 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:59:39.167 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:59:39.389 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:59:39.389 WARNING:rgw_multi.tests:bucket ejuwhf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.17.5 target= 2021-02-13T18:59:44.390 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:59:44.390 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:59:44.390 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:59:44.568 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:59:44.569 WARNING:rgw_multi.tests:bucket ejuwhf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.17.5 target= 2021-02-13T18:59:49.570 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:59:49.570 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:59:49.570 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:59:49.757 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:59:49.758 WARNING:rgw_multi.tests:bucket ejuwhf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.17.5 target= 2021-02-13T18:59:54.758 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:59:54.758 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:59:54.759 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T18:59:54.938 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T18:59:54.938 WARNING:rgw_multi.tests:bucket ejuwhf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.17.5 target= 2021-02-13T18:59:59.939 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:59:59.940 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T18:59:59.940 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:00:00.120 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:00:00.121 WARNING:rgw_multi.tests:bucket ejuwhf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.17.5 target= 2021-02-13T19:00:05.122 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:00:05.127 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:00:05.128 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:00:05.352 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:00:05.353 WARNING:rgw_multi.tests:bucket ejuwhf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.17.5 target= 2021-02-13T19:00:10.353 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:00:10.354 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:00:10.354 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:00:10.533 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:00:10.533 WARNING:rgw_multi.tests:bucket ejuwhf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.17.5 target= 2021-02-13T19:00:15.534 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:00:15.535 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:00:15.535 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:00:15.719 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:00:15.720 WARNING:rgw_multi.tests:bucket ejuwhf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.17.5 target= 2021-02-13T19:00:20.721 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:00:20.721 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:00:20.722 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:00:20.909 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:00:20.909 WARNING:rgw_multi.tests:bucket ejuwhf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.17.5 target= 2021-02-13T19:00:25.911 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:00:25.911 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:00:25.911 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:00:26.096 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:00:26.097 WARNING:rgw_multi.tests:bucket ejuwhf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.17.5 target= 2021-02-13T19:00:31.098 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:00:31.098 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:00:31.098 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:00:31.281 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:00:31.282 WARNING:rgw_multi.tests:bucket ejuwhf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.17.5 target= 2021-02-13T19:00:36.283 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:00:36.283 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:00:36.284 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:00:36.464 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:00:36.465 WARNING:rgw_multi.tests:bucket ejuwhf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.17.5 target= 2021-02-13T19:00:41.466 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:00:41.466 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:00:41.466 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:00:41.646 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:00:41.646 WARNING:rgw_multi.tests:bucket ejuwhf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.17.5 target= 2021-02-13T19:00:46.647 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:00:46.647 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:00:46.647 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:00:46.833 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:00:46.833 WARNING:rgw_multi.tests:bucket ejuwhf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.17.5 target= 2021-02-13T19:00:51.834 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:00:51.835 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:00:51.835 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:00:52.019 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:00:52.020 WARNING:rgw_multi.tests:bucket ejuwhf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.17.5 target= 2021-02-13T19:00:57.021 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:00:57.021 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:00:57.021 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:00:57.206 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:00:57.206 WARNING:rgw_multi.tests:bucket ejuwhf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.17.5 target= 2021-02-13T19:01:02.207 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:01:02.207 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:01:02.208 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:01:02.392 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:01:02.392 WARNING:rgw_multi.tests:bucket ejuwhf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.17.5 target= 2021-02-13T19:01:07.394 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:01:07.394 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:01:07.394 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:01:07.582 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:01:07.582 WARNING:rgw_multi.tests:bucket ejuwhf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.17.5 target= 2021-02-13T19:01:12.583 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:01:12.584 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:01:12.584 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:01:12.769 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:01:12.770 WARNING:rgw_multi.tests:bucket ejuwhf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.17.5 target= 2021-02-13T19:01:17.770 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:01:17.771 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:01:17.771 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:01:17.956 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:01:17.957 WARNING:rgw_multi.tests:bucket ejuwhf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.17.5 target= 2021-02-13T19:01:22.958 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:01:22.958 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:01:22.958 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:01:23.144 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:01:23.145 WARNING:rgw_multi.tests:bucket ejuwhf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.17.5 target= 2021-02-13T19:01:28.146 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:01:28.146 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:01:28.146 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:01:28.333 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:01:28.334 WARNING:rgw_multi.tests:bucket ejuwhf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.17.5 target= 2021-02-13T19:01:33.335 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:01:33.335 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:01:33.335 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:01:33.521 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:01:33.522 WARNING:rgw_multi.tests:bucket ejuwhf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.17.5 target= 2021-02-13T19:01:38.523 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:01:38.524 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:01:38.524 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:01:38.707 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:01:38.708 WARNING:rgw_multi.tests:bucket ejuwhf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.17.5 target= 2021-02-13T19:01:43.709 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:01:43.709 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:01:43.709 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:01:43.893 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:01:43.894 WARNING:rgw_multi.tests:bucket ejuwhf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.17.5 target= 2021-02-13T19:01:48.895 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:01:48.895 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:01:48.896 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:01:49.080 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:01:49.080 WARNING:rgw_multi.tests:bucket ejuwhf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.17.5 target= 2021-02-13T19:01:54.081 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:01:54.081 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:01:54.081 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:01:54.260 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:01:54.261 WARNING:rgw_multi.tests:bucket ejuwhf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.17.5 target= 2021-02-13T19:01:59.262 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:01:59.262 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:01:59.263 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:01:59.444 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:01:59.444 WARNING:rgw_multi.tests:bucket ejuwhf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.17.5 target= 2021-02-13T19:02:04.445 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:02:04.445 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:02:04.445 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:02:04.627 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:02:04.628 WARNING:rgw_multi.tests:bucket ejuwhf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.17.5 target= 2021-02-13T19:02:09.629 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:02:09.629 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:02:09.630 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:02:09.817 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:02:09.817 WARNING:rgw_multi.tests:bucket ejuwhf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.17.5 target= 2021-02-13T19:02:14.818 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:02:14.818 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:02:14.819 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:02:15.003 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:02:15.004 WARNING:rgw_multi.tests:bucket ejuwhf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.17.5 target= 2021-02-13T19:02:20.004 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:02:20.005 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:02:20.005 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:02:20.182 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:02:20.183 WARNING:rgw_multi.tests:bucket ejuwhf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.17.5 target= 2021-02-13T19:02:25.183 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:02:25.184 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:02:25.184 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:02:25.364 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:02:25.365 WARNING:rgw_multi.tests:bucket ejuwhf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.17.5 target= 2021-02-13T19:02:30.365 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:02:30.366 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:02:30.366 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:02:30.543 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:02:30.544 WARNING:rgw_multi.tests:bucket ejuwhf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.17.5 target= 2021-02-13T19:02:35.544 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:02:35.545 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:02:35.545 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:02:35.725 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:02:35.725 WARNING:rgw_multi.tests:bucket ejuwhf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.17.5 target= 2021-02-13T19:02:40.726 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:02:40.727 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:02:40.727 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:02:40.914 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:02:40.914 WARNING:rgw_multi.tests:bucket ejuwhf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.17.5 target= 2021-02-13T19:02:45.916 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:02:45.916 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:02:45.916 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:02:46.102 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:02:46.103 WARNING:rgw_multi.tests:bucket ejuwhf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.17.5 target= 2021-02-13T19:02:51.103 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:02:51.104 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:02:51.104 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:02:51.290 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:02:51.291 WARNING:rgw_multi.tests:bucket ejuwhf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.17.5 target= 2021-02-13T19:02:56.291 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:02:56.292 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:02:56.292 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:02:56.471 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:02:56.472 WARNING:rgw_multi.tests:bucket ejuwhf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.17.5 target= 2021-02-13T19:03:01.472 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:03:01.473 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:03:01.473 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:03:01.659 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:03:01.659 WARNING:rgw_multi.tests:bucket ejuwhf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.17.5 target= 2021-02-13T19:03:06.661 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:03:06.661 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:03:06.662 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:03:06.840 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:03:06.841 WARNING:rgw_multi.tests:bucket ejuwhf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.17.5 target= 2021-02-13T19:03:11.841 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:03:11.842 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:03:11.842 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:03:12.029 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:03:12.029 WARNING:rgw_multi.tests:bucket ejuwhf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.17.5 target= 2021-02-13T19:03:17.030 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:03:17.031 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:03:17.031 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:03:17.218 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:03:17.219 WARNING:rgw_multi.tests:bucket ejuwhf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.17.5 target= 2021-02-13T19:03:22.220 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:03:22.220 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:03:22.220 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:03:22.404 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:03:22.405 WARNING:rgw_multi.tests:bucket ejuwhf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.17.5 target= 2021-02-13T19:03:27.406 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:03:27.406 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:03:27.406 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:03:27.591 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:03:27.592 WARNING:rgw_multi.tests:bucket ejuwhf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.17.5 target= 2021-02-13T19:03:32.593 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:03:32.593 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:03:32.594 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:03:32.780 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:03:32.781 WARNING:rgw_multi.tests:bucket ejuwhf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.17.5 target= 2021-02-13T19:03:37.781 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:03:37.781 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:03:37.782 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:03:37.955 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:03:37.956 WARNING:rgw_multi.tests:bucket ejuwhf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.17.5 target= 2021-02-13T19:03:42.957 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:03:42.958 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:03:42.958 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:03:43.141 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:03:43.175 WARNING:rgw_multi.tests:bucket ejuwhf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.17.5 target= 2021-02-13T19:03:48.176 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:03:48.176 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:03:48.176 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:03:48.360 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:03:48.360 WARNING:rgw_multi.tests:bucket ejuwhf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.17.5 target= 2021-02-13T19:03:53.361 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:03:53.361 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:03:53.361 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:03:53.546 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:03:53.547 WARNING:rgw_multi.tests:bucket ejuwhf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.17.5 target= 2021-02-13T19:03:58.548 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:03:58.548 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:03:58.548 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:03:58.733 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:03:58.733 WARNING:rgw_multi.tests:bucket ejuwhf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.17.5 target= 2021-02-13T19:04:03.734 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:04:03.734 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:04:03.735 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:04:03.923 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:04:03.924 WARNING:rgw_multi.tests:bucket ejuwhf-62 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.17.5 target= 2021-02-13T19:04:08.926 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.tests.test_bucket_sync_disable_enable ... FAIL 2021-02-13T19:04:08.927 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=ejuwhf-65 2021-02-13T19:04:09.011 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=ejuwhf-66 2021-02-13T19:04:09.141 INFO:rgw_multi.tests:create bucket zone=test-zone3 name=ejuwhf-67 2021-02-13T19:04:11.003 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-65', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:04:11.003 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-65', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:04:11.003 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ejuwhf-65 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:04:11.126 INFO:teuthology.orchestra.run.gibba025.stdout:{"markers":[{"key":0,"val":"00000000018.25.5"}]} 2021-02-13T19:04:11.126 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=ejuwhf-65 2021-02-13T19:04:11.126 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:04:11.126 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:04:11.127 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ejuwhf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:04:11.219 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:04:11.220 WARNING:rgw_multi.tests:bucket ejuwhf-65 zone test-zone2 behind zone test-zone1: shard=0 master=00000000018.25.5 target= 2021-02-13T19:04:16.221 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:04:16.221 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:04:16.222 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ejuwhf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:04:16.309 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"MULTIPART","instance":"","ns":""},"count":1},"inc_marker":{"position":"0#00000000018.25.5"}}}] 2021-02-13T19:04:16.310 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=ejuwhf-65 2021-02-13T19:04:16.310 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-65', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:04:16.310 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-65', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:04:16.311 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ejuwhf-65 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:04:16.392 INFO:teuthology.orchestra.run.gibba025.stdout:{"markers":[{"key":0,"val":"00000000018.25.5"}]} 2021-02-13T19:04:16.393 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=ejuwhf-65 2021-02-13T19:04:16.393 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-65', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:04:16.393 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-65', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:04:16.393 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ejuwhf-65 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:04:16.485 INFO:teuthology.orchestra.run.gibba025.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"MULTIPART","instance":"","ns":""},"count":1},"inc_marker":{"position":"0#00000000018.25.5"}}}] 2021-02-13T19:04:16.485 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=ejuwhf-65 2021-02-13T19:04:16.486 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-65', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:04:16.486 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-65', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:04:16.486 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ejuwhf-65 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:04:16.584 INFO:teuthology.orchestra.run.gibba025.stdout:{"markers":[{"key":0,"val":"00000000018.25.5"}]} 2021-02-13T19:04:16.585 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone4 source_zone=test-zone1 bucket=ejuwhf-65 2021-02-13T19:04:16.585 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:04:16.585 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:04:16.585 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ejuwhf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:04:16.773 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"MULTIPART","instance":"","ns":""},"count":1},"inc_marker":{"position":"0#00000000018.25.5"}}}] 2021-02-13T19:04:16.774 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone4 source_zone=test-zone1 bucket=ejuwhf-65 2021-02-13T19:04:16.774 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:04:16.774 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:04:16.774 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ejuwhf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:04:16.857 INFO:teuthology.orchestra.run.gibba036.stdout:{"markers":[{"key":0,"val":"00000000002.13.5"}]} 2021-02-13T19:04:16.858 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=ejuwhf-65 2021-02-13T19:04:16.858 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:04:16.858 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:04:16.858 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-65 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:04:16.944 INFO:teuthology.orchestra.run.gibba025.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"MULTIPART","instance":"","ns":""},"count":1},"inc_marker":{"position":"0#00000000002.13.5"}}}] 2021-02-13T19:04:16.945 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=ejuwhf-65 2021-02-13T19:04:16.945 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:04:16.945 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:04:16.945 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ejuwhf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:04:17.066 INFO:teuthology.orchestra.run.gibba036.stdout:{"markers":[{"key":0,"val":"00000000002.13.5"}]} 2021-02-13T19:04:17.067 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone2 bucket=ejuwhf-65 2021-02-13T19:04:17.067 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:04:17.067 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:04:17.067 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-65 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:04:17.193 INFO:teuthology.orchestra.run.gibba025.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"MULTIPART","instance":"","ns":""},"count":1},"inc_marker":{"position":"0#00000000002.13.5"}}}] 2021-02-13T19:04:17.194 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone2 bucket=ejuwhf-65 2021-02-13T19:04:17.194 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:04:17.194 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:04:17.194 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ejuwhf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:04:17.276 INFO:teuthology.orchestra.run.gibba036.stdout:{"markers":[{"key":0,"val":"00000000002.13.5"}]} 2021-02-13T19:04:17.277 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone4 source_zone=test-zone2 bucket=ejuwhf-65 2021-02-13T19:04:17.277 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:04:17.277 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:04:17.277 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:04:17.453 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:04:17.454 WARNING:rgw_multi.tests:bucket ejuwhf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.13.5 target= 2021-02-13T19:04:22.454 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:04:22.455 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:04:22.455 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:04:22.642 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:04:22.642 WARNING:rgw_multi.tests:bucket ejuwhf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.13.5 target= 2021-02-13T19:04:27.643 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:04:27.643 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:04:27.644 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:04:27.824 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:04:27.824 WARNING:rgw_multi.tests:bucket ejuwhf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.13.5 target= 2021-02-13T19:04:32.825 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:04:32.826 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:04:32.826 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:04:33.010 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:04:33.011 WARNING:rgw_multi.tests:bucket ejuwhf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.13.5 target= 2021-02-13T19:04:38.012 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:04:38.012 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:04:38.013 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:04:38.199 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:04:38.199 WARNING:rgw_multi.tests:bucket ejuwhf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.13.5 target= 2021-02-13T19:04:43.200 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:04:43.201 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:04:43.201 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:04:43.388 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:04:43.388 WARNING:rgw_multi.tests:bucket ejuwhf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.13.5 target= 2021-02-13T19:04:48.389 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:04:48.389 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:04:48.389 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:04:48.576 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:04:48.576 WARNING:rgw_multi.tests:bucket ejuwhf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.13.5 target= 2021-02-13T19:04:53.577 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:04:53.577 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:04:53.578 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:04:53.759 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:04:53.760 WARNING:rgw_multi.tests:bucket ejuwhf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.13.5 target= 2021-02-13T19:04:58.761 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:04:58.761 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:04:58.762 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:04:58.946 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:04:58.946 WARNING:rgw_multi.tests:bucket ejuwhf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.13.5 target= 2021-02-13T19:05:03.947 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:05:03.948 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:05:03.948 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:05:04.136 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:05:04.136 WARNING:rgw_multi.tests:bucket ejuwhf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.13.5 target= 2021-02-13T19:05:09.137 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:05:09.138 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:05:09.138 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:05:09.317 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:05:09.318 WARNING:rgw_multi.tests:bucket ejuwhf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.13.5 target= 2021-02-13T19:05:14.318 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:05:14.318 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:05:14.319 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:05:14.508 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:05:14.509 WARNING:rgw_multi.tests:bucket ejuwhf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.13.5 target= 2021-02-13T19:05:19.509 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:05:19.510 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:05:19.510 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:05:19.700 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:05:19.701 WARNING:rgw_multi.tests:bucket ejuwhf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.13.5 target= 2021-02-13T19:05:24.702 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:05:24.702 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:05:24.703 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:05:24.889 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:05:24.890 WARNING:rgw_multi.tests:bucket ejuwhf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.13.5 target= 2021-02-13T19:05:29.890 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:05:29.891 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:05:29.891 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:05:30.069 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:05:30.069 WARNING:rgw_multi.tests:bucket ejuwhf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.13.5 target= 2021-02-13T19:05:35.071 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:05:35.071 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:05:35.071 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:05:35.253 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:05:35.254 WARNING:rgw_multi.tests:bucket ejuwhf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.13.5 target= 2021-02-13T19:05:40.254 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:05:40.255 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:05:40.255 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:05:40.435 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:05:40.435 WARNING:rgw_multi.tests:bucket ejuwhf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.13.5 target= 2021-02-13T19:05:45.437 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:05:45.437 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:05:45.437 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:05:45.618 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:05:45.619 WARNING:rgw_multi.tests:bucket ejuwhf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.13.5 target= 2021-02-13T19:05:50.620 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:05:50.620 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:05:50.620 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:05:50.810 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:05:50.810 WARNING:rgw_multi.tests:bucket ejuwhf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.13.5 target= 2021-02-13T19:05:55.811 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:05:55.811 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:05:55.812 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:05:55.999 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:05:55.999 WARNING:rgw_multi.tests:bucket ejuwhf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.13.5 target= 2021-02-13T19:06:01.000 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:06:01.000 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:06:01.001 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:06:01.188 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:06:01.189 WARNING:rgw_multi.tests:bucket ejuwhf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.13.5 target= 2021-02-13T19:06:06.190 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:06:06.190 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:06:06.191 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:06:06.371 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:06:06.372 WARNING:rgw_multi.tests:bucket ejuwhf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.13.5 target= 2021-02-13T19:06:11.373 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:06:11.373 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:06:11.374 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:06:11.560 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:06:11.561 WARNING:rgw_multi.tests:bucket ejuwhf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.13.5 target= 2021-02-13T19:06:16.562 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:06:16.562 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:06:16.562 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:06:16.748 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:06:16.748 WARNING:rgw_multi.tests:bucket ejuwhf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.13.5 target= 2021-02-13T19:06:21.749 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:06:21.749 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:06:21.749 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:06:21.921 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:06:21.922 WARNING:rgw_multi.tests:bucket ejuwhf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.13.5 target= 2021-02-13T19:06:26.923 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:06:26.923 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:06:26.924 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:06:27.106 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:06:27.107 WARNING:rgw_multi.tests:bucket ejuwhf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.13.5 target= 2021-02-13T19:06:32.108 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:06:32.108 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:06:32.109 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:06:32.296 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:06:32.296 WARNING:rgw_multi.tests:bucket ejuwhf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.13.5 target= 2021-02-13T19:06:37.297 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:06:37.297 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:06:37.297 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:06:37.482 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:06:37.483 WARNING:rgw_multi.tests:bucket ejuwhf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.13.5 target= 2021-02-13T19:06:42.483 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:06:42.484 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:06:42.484 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:06:42.667 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:06:42.667 WARNING:rgw_multi.tests:bucket ejuwhf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.13.5 target= 2021-02-13T19:06:47.668 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:06:47.668 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:06:47.669 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:06:47.848 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:06:47.848 WARNING:rgw_multi.tests:bucket ejuwhf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.13.5 target= 2021-02-13T19:06:52.849 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:06:52.849 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:06:52.850 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:06:53.034 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:06:53.035 WARNING:rgw_multi.tests:bucket ejuwhf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.13.5 target= 2021-02-13T19:06:58.036 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:06:58.036 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:06:58.036 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:06:58.224 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:06:58.225 WARNING:rgw_multi.tests:bucket ejuwhf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.13.5 target= 2021-02-13T19:07:03.226 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:07:03.226 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:07:03.226 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:07:03.406 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:07:03.406 WARNING:rgw_multi.tests:bucket ejuwhf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.13.5 target= 2021-02-13T19:07:08.408 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:07:08.408 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:07:08.408 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:07:08.595 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:07:08.596 WARNING:rgw_multi.tests:bucket ejuwhf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.13.5 target= 2021-02-13T19:07:13.596 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:07:13.596 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:07:13.597 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:07:13.775 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:07:13.775 WARNING:rgw_multi.tests:bucket ejuwhf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.13.5 target= 2021-02-13T19:07:18.776 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:07:18.776 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:07:18.776 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:07:18.964 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:07:18.965 WARNING:rgw_multi.tests:bucket ejuwhf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.13.5 target= 2021-02-13T19:07:23.965 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:07:23.966 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:07:23.966 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:07:24.154 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:07:24.154 WARNING:rgw_multi.tests:bucket ejuwhf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.13.5 target= 2021-02-13T19:07:29.154 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:07:29.155 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:07:29.155 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:07:29.340 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:07:29.341 WARNING:rgw_multi.tests:bucket ejuwhf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.13.5 target= 2021-02-13T19:07:34.341 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:07:34.342 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:07:34.342 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:07:34.530 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:07:34.531 WARNING:rgw_multi.tests:bucket ejuwhf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.13.5 target= 2021-02-13T19:07:39.531 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:07:39.532 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:07:39.532 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:07:39.715 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:07:39.716 WARNING:rgw_multi.tests:bucket ejuwhf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.13.5 target= 2021-02-13T19:07:44.717 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:07:44.717 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:07:44.718 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:07:44.904 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:07:44.904 WARNING:rgw_multi.tests:bucket ejuwhf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.13.5 target= 2021-02-13T19:07:49.906 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:07:49.906 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:07:49.906 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:07:50.087 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:07:50.088 WARNING:rgw_multi.tests:bucket ejuwhf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.13.5 target= 2021-02-13T19:07:55.089 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:07:55.090 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:07:55.090 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:07:55.270 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:07:55.270 WARNING:rgw_multi.tests:bucket ejuwhf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.13.5 target= 2021-02-13T19:08:00.271 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:08:00.271 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:08:00.271 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:08:00.460 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:08:00.460 WARNING:rgw_multi.tests:bucket ejuwhf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.13.5 target= 2021-02-13T19:08:05.462 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:08:05.462 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:08:05.462 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:08:05.649 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:08:05.649 WARNING:rgw_multi.tests:bucket ejuwhf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.13.5 target= 2021-02-13T19:08:10.650 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:08:10.650 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:08:10.650 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:08:10.838 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:08:10.838 WARNING:rgw_multi.tests:bucket ejuwhf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.13.5 target= 2021-02-13T19:08:15.839 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:08:15.840 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:08:15.840 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:08:16.021 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:08:16.021 WARNING:rgw_multi.tests:bucket ejuwhf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.13.5 target= 2021-02-13T19:08:21.023 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:08:21.023 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:08:21.023 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:08:21.212 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:08:21.212 WARNING:rgw_multi.tests:bucket ejuwhf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.13.5 target= 2021-02-13T19:08:26.215 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:08:26.215 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:08:26.215 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:08:26.404 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:08:26.404 WARNING:rgw_multi.tests:bucket ejuwhf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.13.5 target= 2021-02-13T19:08:31.405 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:08:31.406 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:08:31.406 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:08:31.597 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:08:31.598 WARNING:rgw_multi.tests:bucket ejuwhf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.13.5 target= 2021-02-13T19:08:36.599 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:08:36.599 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:08:36.599 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:08:36.787 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:08:36.787 WARNING:rgw_multi.tests:bucket ejuwhf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.13.5 target= 2021-02-13T19:08:41.788 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:08:41.788 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:08:41.788 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:08:41.979 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:08:41.980 WARNING:rgw_multi.tests:bucket ejuwhf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.13.5 target= 2021-02-13T19:08:46.981 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:08:46.981 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:08:46.982 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:08:47.170 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:08:47.170 WARNING:rgw_multi.tests:bucket ejuwhf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.13.5 target= 2021-02-13T19:08:52.171 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:08:52.171 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:08:52.172 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:08:52.356 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:08:52.357 WARNING:rgw_multi.tests:bucket ejuwhf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.13.5 target= 2021-02-13T19:08:57.357 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:08:57.357 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:08:57.358 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:08:57.539 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:08:57.539 WARNING:rgw_multi.tests:bucket ejuwhf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.13.5 target= 2021-02-13T19:09:02.540 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:09:02.540 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:09:02.540 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:09:02.721 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:09:02.721 WARNING:rgw_multi.tests:bucket ejuwhf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.13.5 target= 2021-02-13T19:09:07.722 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:09:07.722 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:09:07.723 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:09:07.902 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:09:07.903 WARNING:rgw_multi.tests:bucket ejuwhf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.13.5 target= 2021-02-13T19:09:12.903 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:09:12.904 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:09:12.904 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:09:13.086 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:09:13.087 WARNING:rgw_multi.tests:bucket ejuwhf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.13.5 target= 2021-02-13T19:09:18.088 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:09:18.088 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:09:18.089 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:09:18.270 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:09:18.271 WARNING:rgw_multi.tests:bucket ejuwhf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.13.5 target= 2021-02-13T19:09:23.271 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:09:23.272 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:09:23.272 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:09:23.453 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:09:23.453 WARNING:rgw_multi.tests:bucket ejuwhf-65 zone test-zone4 behind zone test-zone2: shard=0 master=00000000002.13.5 target= 2021-02-13T19:09:28.456 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.tests.test_multipart_object_sync ... FAIL 2021-02-13T19:09:28.457 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=ejuwhf-68 2021-02-13T19:09:28.631 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:09:28.631 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:09:28.631 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:09:28.737 INFO:teuthology.orchestra.run.gibba025.stderr:No --period given, using current period=c72c9bb6-7372-4355-b488-0f51f8a5cecb 2021-02-13T19:09:28.752 INFO:teuthology.orchestra.run.gibba025.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613243368.518051_533.1","last_update":"2021-02-13 19:09:28.518051Z"}] 2021-02-13T19:09:28.752 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-02-13T19:09:28.752 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:09:28.752 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:09:28.753 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:09:28.875 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243368.518051_533.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:09:28.518051Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:09:28.875 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-02-13T19:09:28.875 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-02-13T19:09:28.876 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:09:28.876 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:09:28.876 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:09:29.000 INFO:teuthology.orchestra.run.gibba025.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243049.217323_512.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:04:09.217323Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:09:29.001 WARNING:rgw_multi.tests:zone test-zone3 behind master: shard=3 master=1_1613243368.518051_533.1 target=1_1613243049.217323_512.1 2021-02-13T19:09:34.003 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:09:34.003 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:09:34.003 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:09:34.083 INFO:teuthology.orchestra.run.gibba025.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243368.518051_533.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:09:28.518051Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:09:34.083 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-02-13T19:09:34.083 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T19:09:34.083 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:09:34.084 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:09:34.084 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:09:34.264 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243368.518051_533.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:09:28.518051Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:09:34.264 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T19:09:34.264 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-68', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:09:34.264 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-68', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:09:34.265 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ejuwhf-68 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:09:34.391 INFO:teuthology.orchestra.run.gibba025.stdout:{"markers":[{"key":0,"val":"00000000004.10.5"}]} 2021-02-13T19:09:34.391 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=ejuwhf-68 2021-02-13T19:09:34.392 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-68', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:09:34.392 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-68', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:09:34.392 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ejuwhf-68 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:09:34.524 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"testobj-sse-kms","instance":"","ns":""},"count":2},"inc_marker":{"position":"0#00000000004.10.5"}}}] 2021-02-13T19:09:34.524 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=ejuwhf-68 2021-02-13T19:09:34.626 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.tests.test_encrypted_object_sync ... ok 2021-02-13T19:09:34.627 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=ejuwhf-69 2021-02-13T19:09:35.035 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:09:35.035 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:09:35.035 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:09:35.138 INFO:teuthology.orchestra.run.gibba025.stderr:No --period given, using current period=c72c9bb6-7372-4355-b488-0f51f8a5cecb 2021-02-13T19:09:35.154 INFO:teuthology.orchestra.run.gibba025.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613243374.827809_537.1","last_update":"2021-02-13 19:09:34.827809Z"}] 2021-02-13T19:09:35.154 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-02-13T19:09:35.154 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:09:35.154 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:09:35.155 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:09:35.238 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243368.518051_533.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:09:28.518051Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:09:35.239 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=3 master=1_1613243374.827809_537.1 target=1_1613243368.518051_533.1 2021-02-13T19:09:40.239 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:09:40.240 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:09:40.240 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:09:40.328 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243374.827809_537.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:09:34.827809Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:09:40.329 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-02-13T19:09:40.329 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-02-13T19:09:40.329 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:09:40.329 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:09:40.330 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:09:40.412 INFO:teuthology.orchestra.run.gibba025.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243374.827809_537.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:09:34.827809Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:09:40.412 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-02-13T19:09:40.412 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T19:09:40.412 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:09:40.412 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:09:40.413 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:09:40.592 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243374.827809_537.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:09:34.827809Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:09:40.593 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T19:09:40.593 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-69', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:09:40.593 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-69', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:09:40.593 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ejuwhf-69 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:09:40.717 INFO:teuthology.orchestra.run.gibba025.stdout:{"markers":[{"key":0,"val":"00000000008.10.5"}]} 2021-02-13T19:09:40.717 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=ejuwhf-69 2021-02-13T19:09:40.718 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:09:40.718 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:09:40.718 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ejuwhf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:09:40.847 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"d","instance":"","ns":""},"count":4},"inc_marker":{"position":"0#00000000008.10.5"}}}] 2021-02-13T19:09:40.848 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=ejuwhf-69 2021-02-13T19:09:40.848 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-69', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:09:40.848 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-69', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:09:40.848 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ejuwhf-69 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:09:40.932 INFO:teuthology.orchestra.run.gibba025.stdout:{"markers":[{"key":0,"val":"00000000008.10.5"}]} 2021-02-13T19:09:40.932 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=ejuwhf-69 2021-02-13T19:09:40.933 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-69', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:09:40.933 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-69', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:09:40.933 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ejuwhf-69 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:09:41.030 INFO:teuthology.orchestra.run.gibba025.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"d","instance":"","ns":""},"count":4},"inc_marker":{"position":"0#00000000008.10.5"}}}] 2021-02-13T19:09:41.030 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=ejuwhf-69 2021-02-13T19:09:41.030 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-69', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:09:41.031 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-69', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:09:41.031 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ejuwhf-69 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:09:41.130 INFO:teuthology.orchestra.run.gibba025.stdout:{"markers":[{"key":0,"val":"00000000008.10.5"}]} 2021-02-13T19:09:41.131 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone4 source_zone=test-zone1 bucket=ejuwhf-69 2021-02-13T19:09:41.131 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:09:41.131 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:09:41.131 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ejuwhf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:09:41.317 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"d","instance":"","ns":""},"count":4},"inc_marker":{"position":"0#00000000008.10.5"}}}] 2021-02-13T19:09:41.317 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone4 source_zone=test-zone1 bucket=ejuwhf-69 2021-02-13T19:09:41.317 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:09:41.318 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:09:41.318 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ejuwhf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:09:41.399 INFO:teuthology.orchestra.run.gibba036.stdout:{"markers":[{"key":0,"val":"00000000008.12.5"}]} 2021-02-13T19:09:41.399 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=ejuwhf-69 2021-02-13T19:09:41.399 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:09:41.400 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:09:41.400 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-69 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:09:41.533 INFO:teuthology.orchestra.run.gibba025.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"d","instance":"","ns":""},"count":4},"inc_marker":{"position":"0#00000000008.12.5"}}}] 2021-02-13T19:09:41.533 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=ejuwhf-69 2021-02-13T19:09:41.533 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:09:41.533 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:09:41.534 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ejuwhf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:09:41.621 INFO:teuthology.orchestra.run.gibba036.stdout:{"markers":[{"key":0,"val":"00000000008.12.5"}]} 2021-02-13T19:09:41.621 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone2 bucket=ejuwhf-69 2021-02-13T19:09:41.621 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:09:41.621 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:09:41.622 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-69 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:09:41.713 INFO:teuthology.orchestra.run.gibba025.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"d","instance":"","ns":""},"count":4},"inc_marker":{"position":"0#00000000008.12.5"}}}] 2021-02-13T19:09:41.713 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone2 bucket=ejuwhf-69 2021-02-13T19:09:41.713 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:09:41.713 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:09:41.714 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ejuwhf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:09:41.838 INFO:teuthology.orchestra.run.gibba036.stdout:{"markers":[{"key":0,"val":"00000000008.12.5"}]} 2021-02-13T19:09:41.839 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone4 source_zone=test-zone2 bucket=ejuwhf-69 2021-02-13T19:09:41.839 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:09:41.839 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:09:41.839 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:09:42.017 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:09:42.017 WARNING:rgw_multi.tests:bucket ejuwhf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.12.5 target= 2021-02-13T19:09:47.018 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:09:47.018 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:09:47.019 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:09:47.206 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:09:47.206 WARNING:rgw_multi.tests:bucket ejuwhf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.12.5 target= 2021-02-13T19:09:52.208 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:09:52.208 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:09:52.208 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:09:52.396 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:09:52.397 WARNING:rgw_multi.tests:bucket ejuwhf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.12.5 target= 2021-02-13T19:09:57.398 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:09:57.398 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:09:57.398 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:09:57.581 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:09:57.582 WARNING:rgw_multi.tests:bucket ejuwhf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.12.5 target= 2021-02-13T19:10:02.582 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:10:02.583 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:10:02.583 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:10:02.769 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:10:02.770 WARNING:rgw_multi.tests:bucket ejuwhf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.12.5 target= 2021-02-13T19:10:07.771 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:10:07.771 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:10:07.771 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:10:07.993 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:10:07.993 WARNING:rgw_multi.tests:bucket ejuwhf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.12.5 target= 2021-02-13T19:10:12.995 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:10:12.996 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:10:12.996 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:10:13.180 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:10:13.181 WARNING:rgw_multi.tests:bucket ejuwhf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.12.5 target= 2021-02-13T19:10:18.181 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:10:18.182 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:10:18.182 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:10:18.357 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:10:18.358 WARNING:rgw_multi.tests:bucket ejuwhf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.12.5 target= 2021-02-13T19:10:23.359 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:10:23.359 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:10:23.359 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:10:23.545 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:10:23.545 WARNING:rgw_multi.tests:bucket ejuwhf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.12.5 target= 2021-02-13T19:10:28.547 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:10:28.547 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:10:28.547 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:10:28.724 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:10:28.725 WARNING:rgw_multi.tests:bucket ejuwhf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.12.5 target= 2021-02-13T19:10:33.726 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:10:33.727 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:10:33.727 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:10:33.902 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:10:33.902 WARNING:rgw_multi.tests:bucket ejuwhf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.12.5 target= 2021-02-13T19:10:38.904 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:10:38.904 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:10:38.904 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:10:39.089 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:10:39.090 WARNING:rgw_multi.tests:bucket ejuwhf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.12.5 target= 2021-02-13T19:10:44.090 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:10:44.091 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:10:44.091 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:10:44.273 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:10:44.273 WARNING:rgw_multi.tests:bucket ejuwhf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.12.5 target= 2021-02-13T19:10:49.274 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:10:49.275 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:10:49.275 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:10:49.463 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:10:49.464 WARNING:rgw_multi.tests:bucket ejuwhf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.12.5 target= 2021-02-13T19:10:54.465 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:10:54.465 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:10:54.465 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:10:54.649 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:10:54.650 WARNING:rgw_multi.tests:bucket ejuwhf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.12.5 target= 2021-02-13T19:10:59.650 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:10:59.651 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:10:59.651 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:10:59.838 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:10:59.838 WARNING:rgw_multi.tests:bucket ejuwhf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.12.5 target= 2021-02-13T19:11:04.840 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:11:04.840 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:11:04.840 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:11:05.022 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:11:05.023 WARNING:rgw_multi.tests:bucket ejuwhf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.12.5 target= 2021-02-13T19:11:10.024 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:11:10.024 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:11:10.025 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:11:10.223 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:11:10.224 WARNING:rgw_multi.tests:bucket ejuwhf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.12.5 target= 2021-02-13T19:11:15.225 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:11:15.225 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:11:15.226 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:11:15.413 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:11:15.413 WARNING:rgw_multi.tests:bucket ejuwhf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.12.5 target= 2021-02-13T19:11:20.415 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:11:20.415 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:11:20.415 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:11:20.602 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:11:20.603 WARNING:rgw_multi.tests:bucket ejuwhf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.12.5 target= 2021-02-13T19:11:25.604 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:11:25.604 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:11:25.604 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:11:25.787 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:11:25.787 WARNING:rgw_multi.tests:bucket ejuwhf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.12.5 target= 2021-02-13T19:11:30.788 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:11:30.788 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:11:30.789 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:11:30.968 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:11:30.968 WARNING:rgw_multi.tests:bucket ejuwhf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.12.5 target= 2021-02-13T19:11:35.969 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:11:35.969 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:11:35.970 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:11:36.151 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:11:36.152 WARNING:rgw_multi.tests:bucket ejuwhf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.12.5 target= 2021-02-13T19:11:41.153 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:11:41.153 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:11:41.153 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:11:41.343 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:11:41.344 WARNING:rgw_multi.tests:bucket ejuwhf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.12.5 target= 2021-02-13T19:11:46.344 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:11:46.344 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:11:46.345 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:11:46.523 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:11:46.523 WARNING:rgw_multi.tests:bucket ejuwhf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.12.5 target= 2021-02-13T19:11:51.524 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:11:51.525 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:11:51.525 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:11:51.714 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:11:51.714 WARNING:rgw_multi.tests:bucket ejuwhf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.12.5 target= 2021-02-13T19:11:56.715 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:11:56.716 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:11:56.716 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:11:56.901 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:11:56.903 WARNING:rgw_multi.tests:bucket ejuwhf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.12.5 target= 2021-02-13T19:12:01.904 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:12:01.904 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:12:01.904 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:12:02.092 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:12:02.093 WARNING:rgw_multi.tests:bucket ejuwhf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.12.5 target= 2021-02-13T19:12:07.094 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:12:07.094 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:12:07.095 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:12:07.280 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:12:07.280 WARNING:rgw_multi.tests:bucket ejuwhf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.12.5 target= 2021-02-13T19:12:12.281 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:12:12.281 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:12:12.282 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:12:12.470 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:12:12.471 WARNING:rgw_multi.tests:bucket ejuwhf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.12.5 target= 2021-02-13T19:12:17.472 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:12:17.473 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:12:17.473 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:12:17.658 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:12:17.659 WARNING:rgw_multi.tests:bucket ejuwhf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.12.5 target= 2021-02-13T19:12:22.659 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:12:22.660 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:12:22.660 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:12:22.848 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:12:22.848 WARNING:rgw_multi.tests:bucket ejuwhf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.12.5 target= 2021-02-13T19:12:27.849 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:12:27.849 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:12:27.850 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:12:28.039 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:12:28.040 WARNING:rgw_multi.tests:bucket ejuwhf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.12.5 target= 2021-02-13T19:12:33.041 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:12:33.041 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:12:33.042 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:12:33.226 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:12:33.226 WARNING:rgw_multi.tests:bucket ejuwhf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.12.5 target= 2021-02-13T19:12:38.227 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:12:38.227 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:12:38.227 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:12:38.414 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:12:38.415 WARNING:rgw_multi.tests:bucket ejuwhf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.12.5 target= 2021-02-13T19:12:43.416 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:12:43.417 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:12:43.417 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:12:43.595 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:12:43.596 WARNING:rgw_multi.tests:bucket ejuwhf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.12.5 target= 2021-02-13T19:12:48.597 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:12:48.597 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:12:48.597 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:12:48.777 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:12:48.777 WARNING:rgw_multi.tests:bucket ejuwhf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.12.5 target= 2021-02-13T19:12:53.777 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:12:53.778 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:12:53.778 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:12:53.961 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:12:53.962 WARNING:rgw_multi.tests:bucket ejuwhf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.12.5 target= 2021-02-13T19:12:58.963 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:12:58.963 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:12:58.964 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:12:59.152 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:12:59.153 WARNING:rgw_multi.tests:bucket ejuwhf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.12.5 target= 2021-02-13T19:13:04.154 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:13:04.154 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:13:04.154 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:13:04.335 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:13:04.336 WARNING:rgw_multi.tests:bucket ejuwhf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.12.5 target= 2021-02-13T19:13:09.337 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:13:09.337 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:13:09.337 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:13:09.523 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:13:09.523 WARNING:rgw_multi.tests:bucket ejuwhf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.12.5 target= 2021-02-13T19:13:14.524 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:13:14.525 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:13:14.525 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:13:14.711 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:13:14.712 WARNING:rgw_multi.tests:bucket ejuwhf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.12.5 target= 2021-02-13T19:13:19.713 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:13:19.713 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:13:19.714 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:13:19.902 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:13:19.903 WARNING:rgw_multi.tests:bucket ejuwhf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.12.5 target= 2021-02-13T19:13:24.904 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:13:24.904 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:13:24.905 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:13:25.083 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:13:25.084 WARNING:rgw_multi.tests:bucket ejuwhf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.12.5 target= 2021-02-13T19:13:30.084 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:13:30.084 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:13:30.085 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:13:30.270 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:13:30.271 WARNING:rgw_multi.tests:bucket ejuwhf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.12.5 target= 2021-02-13T19:13:35.271 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:13:35.272 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:13:35.272 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:13:35.459 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:13:35.459 WARNING:rgw_multi.tests:bucket ejuwhf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.12.5 target= 2021-02-13T19:13:40.461 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:13:40.461 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:13:40.462 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:13:40.644 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:13:40.644 WARNING:rgw_multi.tests:bucket ejuwhf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.12.5 target= 2021-02-13T19:13:45.644 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:13:45.645 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:13:45.645 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:13:45.832 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:13:45.833 WARNING:rgw_multi.tests:bucket ejuwhf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.12.5 target= 2021-02-13T19:13:50.834 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:13:50.835 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:13:50.835 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:13:51.018 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:13:51.018 WARNING:rgw_multi.tests:bucket ejuwhf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.12.5 target= 2021-02-13T19:13:56.019 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:13:56.019 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:13:56.020 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:13:56.193 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:13:56.194 WARNING:rgw_multi.tests:bucket ejuwhf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.12.5 target= 2021-02-13T19:14:01.194 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:14:01.195 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:14:01.195 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:14:01.415 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:14:01.416 WARNING:rgw_multi.tests:bucket ejuwhf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.12.5 target= 2021-02-13T19:14:06.417 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:14:06.417 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:14:06.418 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:14:06.603 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:14:06.603 WARNING:rgw_multi.tests:bucket ejuwhf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.12.5 target= 2021-02-13T19:14:11.604 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:14:11.605 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:14:11.605 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:14:11.791 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:14:11.791 WARNING:rgw_multi.tests:bucket ejuwhf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.12.5 target= 2021-02-13T19:14:16.792 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:14:16.792 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:14:16.793 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:14:16.982 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:14:16.983 WARNING:rgw_multi.tests:bucket ejuwhf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.12.5 target= 2021-02-13T19:14:21.984 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:14:21.984 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:14:21.985 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:14:22.171 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:14:22.172 WARNING:rgw_multi.tests:bucket ejuwhf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.12.5 target= 2021-02-13T19:14:27.172 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:14:27.173 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:14:27.173 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:14:27.361 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:14:27.361 WARNING:rgw_multi.tests:bucket ejuwhf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.12.5 target= 2021-02-13T19:14:32.362 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:14:32.363 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:14:32.363 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:14:32.550 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:14:32.550 WARNING:rgw_multi.tests:bucket ejuwhf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.12.5 target= 2021-02-13T19:14:37.551 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:14:37.552 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:14:37.552 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:14:37.742 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:14:37.742 WARNING:rgw_multi.tests:bucket ejuwhf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.12.5 target= 2021-02-13T19:14:42.743 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:14:42.744 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:14:42.744 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:14:42.926 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:14:42.926 WARNING:rgw_multi.tests:bucket ejuwhf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.12.5 target= 2021-02-13T19:14:47.927 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:14:47.927 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-69', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:14:47.927 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-69 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:14:48.109 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:14:48.109 WARNING:rgw_multi.tests:bucket ejuwhf-69 zone test-zone4 behind zone test-zone2: shard=0 master=00000000008.12.5 target= 2021-02-13T19:14:53.126 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.tests.test_bucket_index_log_trim ... FAIL 2021-02-13T19:14:53.166 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.tests.test_bucket_creation_time ... ok 2021-02-13T19:14:53.166 INFO:tasks.rgw_multisite_tests: 2021-02-13T19:14:53.166 INFO:tasks.rgw_multisite_tests:====================================================================== 2021-02-13T19:14:53.166 INFO:tasks.rgw_multisite_tests:FAIL: tasks.rgw_multi.tests.test_object_sync 2021-02-13T19:14:53.166 INFO:tasks.rgw_multisite_tests:---------------------------------------------------------------------- 2021-02-13T19:14:53.166 INFO:tasks.rgw_multisite_tests:Traceback (most recent call last): 2021-02-13T19:14:53.167 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/git.ceph.com_git_teuthology_87d40f79d7da6caf6da06c190938773bf745140c/virtualenv/lib/python3.6/site-packages/nose/case.py", line 198, in runTest 2021-02-13T19:14:53.167 INFO:tasks.rgw_multisite_tests: self.test(*self.arg) 2021-02-13T19:14:53.167 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/github.com_ceph_ceph-c_7194982cc16a1fd51df59ee58e1c54797c4465d1/qa/tasks/rgw_multi/tests.py", line 618, in test_object_sync 2021-02-13T19:14:53.167 INFO:tasks.rgw_multisite_tests: zone_bucket_checkpoint(target_conn.zone, source_conn.zone, bucket.name) 2021-02-13T19:14:53.167 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/github.com_ceph_ceph-c_7194982cc16a1fd51df59ee58e1c54797c4465d1/qa/tasks/rgw_multi/tests.py", line 401, in zone_bucket_checkpoint 2021-02-13T19:14:53.167 INFO:tasks.rgw_multisite_tests: (target_zone.name, source_zone.name, bucket_name) 2021-02-13T19:14:53.167 INFO:tasks.rgw_multisite_tests:AssertionError: failed bucket checkpoint for target_zone=test-zone4 source_zone=test-zone2 bucket=ejuwhf-11 2021-02-13T19:14:53.167 INFO:tasks.rgw_multisite_tests: 2021-02-13T19:14:53.167 INFO:tasks.rgw_multisite_tests:====================================================================== 2021-02-13T19:14:53.167 INFO:tasks.rgw_multisite_tests:FAIL: tasks.rgw_multi.tests.test_object_delete 2021-02-13T19:14:53.167 INFO:tasks.rgw_multisite_tests:---------------------------------------------------------------------- 2021-02-13T19:14:53.167 INFO:tasks.rgw_multisite_tests:Traceback (most recent call last): 2021-02-13T19:14:53.167 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/git.ceph.com_git_teuthology_87d40f79d7da6caf6da06c190938773bf745140c/virtualenv/lib/python3.6/site-packages/nose/case.py", line 198, in runTest 2021-02-13T19:14:53.167 INFO:tasks.rgw_multisite_tests: self.test(*self.arg) 2021-02-13T19:14:53.167 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/github.com_ceph_ceph-c_7194982cc16a1fd51df59ee58e1c54797c4465d1/qa/tasks/rgw_multi/tests.py", line 642, in test_object_delete 2021-02-13T19:14:53.168 INFO:tasks.rgw_multisite_tests: zone_bucket_checkpoint(target_conn.zone, source_conn.zone, bucket.name) 2021-02-13T19:14:53.168 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/github.com_ceph_ceph-c_7194982cc16a1fd51df59ee58e1c54797c4465d1/qa/tasks/rgw_multi/tests.py", line 401, in zone_bucket_checkpoint 2021-02-13T19:14:53.168 INFO:tasks.rgw_multisite_tests: (target_zone.name, source_zone.name, bucket_name) 2021-02-13T19:14:53.168 INFO:tasks.rgw_multisite_tests:AssertionError: failed bucket checkpoint for target_zone=test-zone4 source_zone=test-zone2 bucket=ejuwhf-14 2021-02-13T19:14:53.168 INFO:tasks.rgw_multisite_tests: 2021-02-13T19:14:53.168 INFO:tasks.rgw_multisite_tests:====================================================================== 2021-02-13T19:14:53.168 INFO:tasks.rgw_multisite_tests:FAIL: tasks.rgw_multi.tests.test_versioned_object_incremental_sync 2021-02-13T19:14:53.168 INFO:tasks.rgw_multisite_tests:---------------------------------------------------------------------- 2021-02-13T19:14:53.168 INFO:tasks.rgw_multisite_tests:Traceback (most recent call last): 2021-02-13T19:14:53.168 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/git.ceph.com_git_teuthology_87d40f79d7da6caf6da06c190938773bf745140c/virtualenv/lib/python3.6/site-packages/nose/case.py", line 198, in runTest 2021-02-13T19:14:53.168 INFO:tasks.rgw_multisite_tests: self.test(*self.arg) 2021-02-13T19:14:53.168 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/github.com_ceph_ceph-c_7194982cc16a1fd51df59ee58e1c54797c4465d1/qa/tasks/rgw_multi/tests.py", line 680, in test_versioned_object_incremental_sync 2021-02-13T19:14:53.168 INFO:tasks.rgw_multisite_tests: zone_bucket_checkpoint(target_conn.zone, source_conn.zone, bucket.name) 2021-02-13T19:14:53.168 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/github.com_ceph_ceph-c_7194982cc16a1fd51df59ee58e1c54797c4465d1/qa/tasks/rgw_multi/tests.py", line 401, in zone_bucket_checkpoint 2021-02-13T19:14:53.168 INFO:tasks.rgw_multisite_tests: (target_zone.name, source_zone.name, bucket_name) 2021-02-13T19:14:53.169 INFO:tasks.rgw_multisite_tests:AssertionError: failed bucket checkpoint for target_zone=test-zone4 source_zone=test-zone2 bucket=ejuwhf-17 2021-02-13T19:14:53.169 INFO:tasks.rgw_multisite_tests: 2021-02-13T19:14:53.169 INFO:tasks.rgw_multisite_tests:====================================================================== 2021-02-13T19:14:53.169 INFO:tasks.rgw_multisite_tests:FAIL: tasks.rgw_multi.tests.test_concurrent_versioned_object_incremental_sync 2021-02-13T19:14:53.169 INFO:tasks.rgw_multisite_tests:---------------------------------------------------------------------- 2021-02-13T19:14:53.169 INFO:tasks.rgw_multisite_tests:Traceback (most recent call last): 2021-02-13T19:14:53.169 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/git.ceph.com_git_teuthology_87d40f79d7da6caf6da06c190938773bf745140c/virtualenv/lib/python3.6/site-packages/nose/case.py", line 198, in runTest 2021-02-13T19:14:53.169 INFO:tasks.rgw_multisite_tests: self.test(*self.arg) 2021-02-13T19:14:53.169 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/github.com_ceph_ceph-c_7194982cc16a1fd51df59ee58e1c54797c4465d1/qa/tasks/rgw_multi/tests.py", line 732, in test_concurrent_versioned_object_incremental_sync 2021-02-13T19:14:53.169 INFO:tasks.rgw_multisite_tests: zonegroup_bucket_checkpoint(zonegroup_conns, bucket.name) 2021-02-13T19:14:53.169 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/github.com_ceph_ceph-c_7194982cc16a1fd51df59ee58e1c54797c4465d1/qa/tasks/rgw_multi/tests.py", line 409, in zonegroup_bucket_checkpoint 2021-02-13T19:14:53.169 INFO:tasks.rgw_multisite_tests: zone_bucket_checkpoint(target_conn.zone, source_conn.zone, bucket_name) 2021-02-13T19:14:53.169 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/github.com_ceph_ceph-c_7194982cc16a1fd51df59ee58e1c54797c4465d1/qa/tasks/rgw_multi/tests.py", line 401, in zone_bucket_checkpoint 2021-02-13T19:14:53.169 INFO:tasks.rgw_multisite_tests: (target_zone.name, source_zone.name, bucket_name) 2021-02-13T19:14:53.169 INFO:tasks.rgw_multisite_tests:AssertionError: failed bucket checkpoint for target_zone=test-zone4 source_zone=test-zone2 bucket=ejuwhf-19 2021-02-13T19:14:53.169 INFO:tasks.rgw_multisite_tests: 2021-02-13T19:14:53.170 INFO:tasks.rgw_multisite_tests:====================================================================== 2021-02-13T19:14:53.170 INFO:tasks.rgw_multisite_tests:FAIL: tasks.rgw_multi.tests.test_version_suspended_incremental_sync 2021-02-13T19:14:53.170 INFO:tasks.rgw_multisite_tests:---------------------------------------------------------------------- 2021-02-13T19:14:53.170 INFO:tasks.rgw_multisite_tests:Traceback (most recent call last): 2021-02-13T19:14:53.170 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/git.ceph.com_git_teuthology_87d40f79d7da6caf6da06c190938773bf745140c/virtualenv/lib/python3.6/site-packages/nose/case.py", line 198, in runTest 2021-02-13T19:14:53.170 INFO:tasks.rgw_multisite_tests: self.test(*self.arg) 2021-02-13T19:14:53.170 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/github.com_ceph_ceph-c_7194982cc16a1fd51df59ee58e1c54797c4465d1/qa/tasks/rgw_multi/tests.py", line 760, in test_version_suspended_incremental_sync 2021-02-13T19:14:53.170 INFO:tasks.rgw_multisite_tests: zonegroup_bucket_checkpoint(zonegroup_conns, bucket.name) 2021-02-13T19:14:53.170 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/github.com_ceph_ceph-c_7194982cc16a1fd51df59ee58e1c54797c4465d1/qa/tasks/rgw_multi/tests.py", line 409, in zonegroup_bucket_checkpoint 2021-02-13T19:14:53.170 INFO:tasks.rgw_multisite_tests: zone_bucket_checkpoint(target_conn.zone, source_conn.zone, bucket_name) 2021-02-13T19:14:53.170 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/github.com_ceph_ceph-c_7194982cc16a1fd51df59ee58e1c54797c4465d1/qa/tasks/rgw_multi/tests.py", line 401, in zone_bucket_checkpoint 2021-02-13T19:14:53.170 INFO:tasks.rgw_multisite_tests: (target_zone.name, source_zone.name, bucket_name) 2021-02-13T19:14:53.170 INFO:tasks.rgw_multisite_tests:AssertionError: failed bucket checkpoint for target_zone=test-zone4 source_zone=test-zone2 bucket=ejuwhf-20 2021-02-13T19:14:53.170 INFO:tasks.rgw_multisite_tests: 2021-02-13T19:14:53.171 INFO:tasks.rgw_multisite_tests:====================================================================== 2021-02-13T19:14:53.171 INFO:tasks.rgw_multisite_tests:FAIL: tasks.rgw_multi.tests.test_delete_marker_full_sync 2021-02-13T19:14:53.171 INFO:tasks.rgw_multisite_tests:---------------------------------------------------------------------- 2021-02-13T19:14:53.171 INFO:tasks.rgw_multisite_tests:Traceback (most recent call last): 2021-02-13T19:14:53.171 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/git.ceph.com_git_teuthology_87d40f79d7da6caf6da06c190938773bf745140c/virtualenv/lib/python3.6/site-packages/nose/case.py", line 198, in runTest 2021-02-13T19:14:53.171 INFO:tasks.rgw_multisite_tests: self.test(*self.arg) 2021-02-13T19:14:53.171 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/github.com_ceph_ceph-c_7194982cc16a1fd51df59ee58e1c54797c4465d1/qa/tasks/rgw_multi/tests.py", line 803, in test_delete_marker_full_sync 2021-02-13T19:14:53.171 INFO:tasks.rgw_multisite_tests: zonegroup_bucket_checkpoint(zonegroup_conns, bucket.name) 2021-02-13T19:14:53.171 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/github.com_ceph_ceph-c_7194982cc16a1fd51df59ee58e1c54797c4465d1/qa/tasks/rgw_multi/tests.py", line 409, in zonegroup_bucket_checkpoint 2021-02-13T19:14:53.171 INFO:tasks.rgw_multisite_tests: zone_bucket_checkpoint(target_conn.zone, source_conn.zone, bucket_name) 2021-02-13T19:14:53.171 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/github.com_ceph_ceph-c_7194982cc16a1fd51df59ee58e1c54797c4465d1/qa/tasks/rgw_multi/tests.py", line 401, in zone_bucket_checkpoint 2021-02-13T19:14:53.171 INFO:tasks.rgw_multisite_tests: (target_zone.name, source_zone.name, bucket_name) 2021-02-13T19:14:53.171 INFO:tasks.rgw_multisite_tests:AssertionError: failed bucket checkpoint for target_zone=test-zone4 source_zone=test-zone2 bucket=ejuwhf-21 2021-02-13T19:14:53.171 INFO:tasks.rgw_multisite_tests: 2021-02-13T19:14:53.171 INFO:tasks.rgw_multisite_tests:====================================================================== 2021-02-13T19:14:53.172 INFO:tasks.rgw_multisite_tests:FAIL: tasks.rgw_multi.tests.test_suspended_delete_marker_full_sync 2021-02-13T19:14:53.172 INFO:tasks.rgw_multisite_tests:---------------------------------------------------------------------- 2021-02-13T19:14:53.172 INFO:tasks.rgw_multisite_tests:Traceback (most recent call last): 2021-02-13T19:14:53.172 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/git.ceph.com_git_teuthology_87d40f79d7da6caf6da06c190938773bf745140c/virtualenv/lib/python3.6/site-packages/nose/case.py", line 198, in runTest 2021-02-13T19:14:53.172 INFO:tasks.rgw_multisite_tests: self.test(*self.arg) 2021-02-13T19:14:53.172 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/github.com_ceph_ceph-c_7194982cc16a1fd51df59ee58e1c54797c4465d1/qa/tasks/rgw_multi/tests.py", line 827, in test_suspended_delete_marker_full_sync 2021-02-13T19:14:53.172 INFO:tasks.rgw_multisite_tests: zonegroup_bucket_checkpoint(zonegroup_conns, bucket.name) 2021-02-13T19:14:53.172 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/github.com_ceph_ceph-c_7194982cc16a1fd51df59ee58e1c54797c4465d1/qa/tasks/rgw_multi/tests.py", line 409, in zonegroup_bucket_checkpoint 2021-02-13T19:14:53.172 INFO:tasks.rgw_multisite_tests: zone_bucket_checkpoint(target_conn.zone, source_conn.zone, bucket_name) 2021-02-13T19:14:53.172 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/github.com_ceph_ceph-c_7194982cc16a1fd51df59ee58e1c54797c4465d1/qa/tasks/rgw_multi/tests.py", line 401, in zone_bucket_checkpoint 2021-02-13T19:14:53.172 INFO:tasks.rgw_multisite_tests: (target_zone.name, source_zone.name, bucket_name) 2021-02-13T19:14:53.172 INFO:tasks.rgw_multisite_tests:AssertionError: failed bucket checkpoint for target_zone=test-zone4 source_zone=test-zone2 bucket=ejuwhf-24 2021-02-13T19:14:53.172 INFO:tasks.rgw_multisite_tests: 2021-02-13T19:14:53.172 INFO:tasks.rgw_multisite_tests:====================================================================== 2021-02-13T19:14:53.172 INFO:tasks.rgw_multisite_tests:FAIL: tasks.rgw_multi.tests.test_datalog_autotrim 2021-02-13T19:14:53.173 INFO:tasks.rgw_multisite_tests:---------------------------------------------------------------------- 2021-02-13T19:14:53.173 INFO:tasks.rgw_multisite_tests:Traceback (most recent call last): 2021-02-13T19:14:53.173 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/git.ceph.com_git_teuthology_87d40f79d7da6caf6da06c190938773bf745140c/virtualenv/lib/python3.6/site-packages/nose/case.py", line 198, in runTest 2021-02-13T19:14:53.173 INFO:tasks.rgw_multisite_tests: self.test(*self.arg) 2021-02-13T19:14:53.173 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/github.com_ceph_ceph-c_7194982cc16a1fd51df59ee58e1c54797c4465d1/qa/tasks/rgw_multi/tests.py", line 974, in test_datalog_autotrim 2021-02-13T19:14:53.173 INFO:tasks.rgw_multisite_tests: zonegroup_data_checkpoint(zonegroup_conns) 2021-02-13T19:14:53.173 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/github.com_ceph_ceph-c_7194982cc16a1fd51df59ee58e1c54797c4465d1/qa/tasks/rgw_multi/tests.py", line 379, in zonegroup_data_checkpoint 2021-02-13T19:14:53.173 INFO:tasks.rgw_multisite_tests: zone_data_checkpoint(target_conn.zone, source_conn.zone) 2021-02-13T19:14:53.173 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/github.com_ceph_ceph-c_7194982cc16a1fd51df59ee58e1c54797c4465d1/qa/tasks/rgw_multi/tests.py", line 371, in zone_data_checkpoint 2021-02-13T19:14:53.173 INFO:tasks.rgw_multisite_tests: (target_zone.name, source_zone.name) 2021-02-13T19:14:53.173 INFO:tasks.rgw_multisite_tests:AssertionError: failed data checkpoint for target_zone=test-zone4 source_zone=test-zone2 2021-02-13T19:14:53.173 INFO:tasks.rgw_multisite_tests: 2021-02-13T19:14:53.173 INFO:tasks.rgw_multisite_tests:====================================================================== 2021-02-13T19:14:53.173 INFO:tasks.rgw_multisite_tests:FAIL: tasks.rgw_multi.tests.test_bucket_sync_disable 2021-02-13T19:14:53.173 INFO:tasks.rgw_multisite_tests:---------------------------------------------------------------------- 2021-02-13T19:14:53.174 INFO:tasks.rgw_multisite_tests:Traceback (most recent call last): 2021-02-13T19:14:53.174 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/git.ceph.com_git_teuthology_87d40f79d7da6caf6da06c190938773bf745140c/virtualenv/lib/python3.6/site-packages/nose/case.py", line 198, in runTest 2021-02-13T19:14:53.174 INFO:tasks.rgw_multisite_tests: self.test(*self.arg) 2021-02-13T19:14:53.174 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/github.com_ceph_ceph-c_7194982cc16a1fd51df59ee58e1c54797c4465d1/qa/tasks/rgw_multi/tests.py", line 1122, in test_bucket_sync_disable 2021-02-13T19:14:53.174 INFO:tasks.rgw_multisite_tests: zonegroup_data_checkpoint(zonegroup_conns) 2021-02-13T19:14:53.174 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/github.com_ceph_ceph-c_7194982cc16a1fd51df59ee58e1c54797c4465d1/qa/tasks/rgw_multi/tests.py", line 379, in zonegroup_data_checkpoint 2021-02-13T19:14:53.174 INFO:tasks.rgw_multisite_tests: zone_data_checkpoint(target_conn.zone, source_conn.zone) 2021-02-13T19:14:53.174 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/github.com_ceph_ceph-c_7194982cc16a1fd51df59ee58e1c54797c4465d1/qa/tasks/rgw_multi/tests.py", line 371, in zone_data_checkpoint 2021-02-13T19:14:53.174 INFO:tasks.rgw_multisite_tests: (target_zone.name, source_zone.name) 2021-02-13T19:14:53.174 INFO:tasks.rgw_multisite_tests:AssertionError: failed data checkpoint for target_zone=test-zone4 source_zone=test-zone2 2021-02-13T19:14:53.174 INFO:tasks.rgw_multisite_tests: 2021-02-13T19:14:53.174 INFO:tasks.rgw_multisite_tests:====================================================================== 2021-02-13T19:14:53.174 INFO:tasks.rgw_multisite_tests:FAIL: tasks.rgw_multi.tests.test_bucket_sync_enable_right_after_disable 2021-02-13T19:14:53.175 INFO:tasks.rgw_multisite_tests:---------------------------------------------------------------------- 2021-02-13T19:14:53.175 INFO:tasks.rgw_multisite_tests:Traceback (most recent call last): 2021-02-13T19:14:53.175 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/git.ceph.com_git_teuthology_87d40f79d7da6caf6da06c190938773bf745140c/virtualenv/lib/python3.6/site-packages/nose/case.py", line 198, in runTest 2021-02-13T19:14:53.175 INFO:tasks.rgw_multisite_tests: self.test(*self.arg) 2021-02-13T19:14:53.175 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/github.com_ceph_ceph-c_7194982cc16a1fd51df59ee58e1c54797c4465d1/qa/tasks/rgw_multi/tests.py", line 1138, in test_bucket_sync_enable_right_after_disable 2021-02-13T19:14:53.175 INFO:tasks.rgw_multisite_tests: zonegroup_bucket_checkpoint(zonegroup_conns, bucket_name) 2021-02-13T19:14:53.175 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/github.com_ceph_ceph-c_7194982cc16a1fd51df59ee58e1c54797c4465d1/qa/tasks/rgw_multi/tests.py", line 409, in zonegroup_bucket_checkpoint 2021-02-13T19:14:53.175 INFO:tasks.rgw_multisite_tests: zone_bucket_checkpoint(target_conn.zone, source_conn.zone, bucket_name) 2021-02-13T19:14:53.175 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/github.com_ceph_ceph-c_7194982cc16a1fd51df59ee58e1c54797c4465d1/qa/tasks/rgw_multi/tests.py", line 401, in zone_bucket_checkpoint 2021-02-13T19:14:53.175 INFO:tasks.rgw_multisite_tests: (target_zone.name, source_zone.name, bucket_name) 2021-02-13T19:14:53.175 INFO:tasks.rgw_multisite_tests:AssertionError: failed bucket checkpoint for target_zone=test-zone4 source_zone=test-zone2 bucket=ejuwhf-59 2021-02-13T19:14:53.175 INFO:tasks.rgw_multisite_tests: 2021-02-13T19:14:53.175 INFO:tasks.rgw_multisite_tests:====================================================================== 2021-02-13T19:14:53.175 INFO:tasks.rgw_multisite_tests:FAIL: tasks.rgw_multi.tests.test_bucket_sync_disable_enable 2021-02-13T19:14:53.175 INFO:tasks.rgw_multisite_tests:---------------------------------------------------------------------- 2021-02-13T19:14:53.176 INFO:tasks.rgw_multisite_tests:Traceback (most recent call last): 2021-02-13T19:14:53.176 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/git.ceph.com_git_teuthology_87d40f79d7da6caf6da06c190938773bf745140c/virtualenv/lib/python3.6/site-packages/nose/case.py", line 198, in runTest 2021-02-13T19:14:53.176 INFO:tasks.rgw_multisite_tests: self.test(*self.arg) 2021-02-13T19:14:53.176 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/github.com_ceph_ceph-c_7194982cc16a1fd51df59ee58e1c54797c4465d1/qa/tasks/rgw_multi/tests.py", line 1172, in test_bucket_sync_disable_enable 2021-02-13T19:14:53.176 INFO:tasks.rgw_multisite_tests: zonegroup_bucket_checkpoint(zonegroup_conns, bucket_name) 2021-02-13T19:14:53.176 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/github.com_ceph_ceph-c_7194982cc16a1fd51df59ee58e1c54797c4465d1/qa/tasks/rgw_multi/tests.py", line 409, in zonegroup_bucket_checkpoint 2021-02-13T19:14:53.176 INFO:tasks.rgw_multisite_tests: zone_bucket_checkpoint(target_conn.zone, source_conn.zone, bucket_name) 2021-02-13T19:14:53.176 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/github.com_ceph_ceph-c_7194982cc16a1fd51df59ee58e1c54797c4465d1/qa/tasks/rgw_multi/tests.py", line 401, in zone_bucket_checkpoint 2021-02-13T19:14:53.176 INFO:tasks.rgw_multisite_tests: (target_zone.name, source_zone.name, bucket_name) 2021-02-13T19:14:53.176 INFO:tasks.rgw_multisite_tests:AssertionError: failed bucket checkpoint for target_zone=test-zone4 source_zone=test-zone2 bucket=ejuwhf-62 2021-02-13T19:14:53.176 INFO:tasks.rgw_multisite_tests: 2021-02-13T19:14:53.176 INFO:tasks.rgw_multisite_tests:====================================================================== 2021-02-13T19:14:53.176 INFO:tasks.rgw_multisite_tests:FAIL: tasks.rgw_multi.tests.test_multipart_object_sync 2021-02-13T19:14:53.176 INFO:tasks.rgw_multisite_tests:---------------------------------------------------------------------- 2021-02-13T19:14:53.176 INFO:tasks.rgw_multisite_tests:Traceback (most recent call last): 2021-02-13T19:14:53.177 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/git.ceph.com_git_teuthology_87d40f79d7da6caf6da06c190938773bf745140c/virtualenv/lib/python3.6/site-packages/nose/case.py", line 198, in runTest 2021-02-13T19:14:53.177 INFO:tasks.rgw_multisite_tests: self.test(*self.arg) 2021-02-13T19:14:53.177 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/github.com_ceph_ceph-c_7194982cc16a1fd51df59ee58e1c54797c4465d1/qa/tasks/rgw_multi/tests.py", line 1213, in test_multipart_object_sync 2021-02-13T19:14:53.177 INFO:tasks.rgw_multisite_tests: zonegroup_bucket_checkpoint(zonegroup_conns, bucket.name) 2021-02-13T19:14:53.177 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/github.com_ceph_ceph-c_7194982cc16a1fd51df59ee58e1c54797c4465d1/qa/tasks/rgw_multi/tests.py", line 409, in zonegroup_bucket_checkpoint 2021-02-13T19:14:53.177 INFO:tasks.rgw_multisite_tests: zone_bucket_checkpoint(target_conn.zone, source_conn.zone, bucket_name) 2021-02-13T19:14:53.177 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/github.com_ceph_ceph-c_7194982cc16a1fd51df59ee58e1c54797c4465d1/qa/tasks/rgw_multi/tests.py", line 401, in zone_bucket_checkpoint 2021-02-13T19:14:53.177 INFO:tasks.rgw_multisite_tests: (target_zone.name, source_zone.name, bucket_name) 2021-02-13T19:14:53.177 INFO:tasks.rgw_multisite_tests:AssertionError: failed bucket checkpoint for target_zone=test-zone4 source_zone=test-zone2 bucket=ejuwhf-65 2021-02-13T19:14:53.177 INFO:tasks.rgw_multisite_tests: 2021-02-13T19:14:53.177 INFO:tasks.rgw_multisite_tests:====================================================================== 2021-02-13T19:14:53.177 INFO:tasks.rgw_multisite_tests:FAIL: tasks.rgw_multi.tests.test_bucket_index_log_trim 2021-02-13T19:14:53.177 INFO:tasks.rgw_multisite_tests:---------------------------------------------------------------------- 2021-02-13T19:14:53.177 INFO:tasks.rgw_multisite_tests:Traceback (most recent call last): 2021-02-13T19:14:53.177 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/git.ceph.com_git_teuthology_87d40f79d7da6caf6da06c190938773bf745140c/virtualenv/lib/python3.6/site-packages/nose/case.py", line 198, in runTest 2021-02-13T19:14:53.177 INFO:tasks.rgw_multisite_tests: self.test(*self.arg) 2021-02-13T19:14:53.178 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/github.com_ceph_ceph-c_7194982cc16a1fd51df59ee58e1c54797c4465d1/qa/tasks/rgw_multi/tests.py", line 1279, in test_bucket_index_log_trim 2021-02-13T19:14:53.178 INFO:tasks.rgw_multisite_tests: cold_bucket = make_test_bucket() 2021-02-13T19:14:53.178 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/github.com_ceph_ceph-c_7194982cc16a1fd51df59ee58e1c54797c4465d1/qa/tasks/rgw_multi/tests.py", line 1275, in make_test_bucket 2021-02-13T19:14:53.178 INFO:tasks.rgw_multisite_tests: zonegroup_bucket_checkpoint(zonegroup_conns, name) 2021-02-13T19:14:53.178 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/github.com_ceph_ceph-c_7194982cc16a1fd51df59ee58e1c54797c4465d1/qa/tasks/rgw_multi/tests.py", line 409, in zonegroup_bucket_checkpoint 2021-02-13T19:14:53.178 INFO:tasks.rgw_multisite_tests: zone_bucket_checkpoint(target_conn.zone, source_conn.zone, bucket_name) 2021-02-13T19:14:53.178 INFO:tasks.rgw_multisite_tests: File "/home/teuthworker/src/github.com_ceph_ceph-c_7194982cc16a1fd51df59ee58e1c54797c4465d1/qa/tasks/rgw_multi/tests.py", line 401, in zone_bucket_checkpoint 2021-02-13T19:14:53.178 INFO:tasks.rgw_multisite_tests: (target_zone.name, source_zone.name, bucket_name) 2021-02-13T19:14:53.178 INFO:tasks.rgw_multisite_tests:AssertionError: failed bucket checkpoint for target_zone=test-zone4 source_zone=test-zone2 bucket=ejuwhf-69 2021-02-13T19:14:53.178 INFO:tasks.rgw_multisite_tests: 2021-02-13T19:14:53.178 INFO:tasks.rgw_multisite_tests:---------------------------------------------------------------------- 2021-02-13T19:14:53.178 INFO:tasks.rgw_multisite_tests:Ran 28 tests in 4738.688s 2021-02-13T19:14:53.178 INFO:tasks.rgw_multisite_tests: 2021-02-13T19:14:53.178 INFO:tasks.rgw_multisite_tests:FAILED (failures=13) 2021-02-13T19:14:53.183 INFO:tasks.rgw_multisite_tests:log information for manual testing ... ok 2021-02-13T19:14:53.184 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:14:53.184 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:14:53.184 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:14:53.291 INFO:teuthology.orchestra.run.gibba025.stderr:No --period given, using current period=c72c9bb6-7372-4355-b488-0f51f8a5cecb 2021-02-13T19:14:53.307 INFO:teuthology.orchestra.run.gibba025.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613243374.827809_537.1","last_update":"2021-02-13 19:09:34.827809Z"}] 2021-02-13T19:14:53.308 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-02-13T19:14:53.308 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:14:53.308 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:14:53.308 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:14:53.389 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243374.827809_537.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:09:34.827809Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:14:53.389 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-02-13T19:14:53.389 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-02-13T19:14:53.390 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:14:53.390 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:14:53.390 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:14:53.507 INFO:teuthology.orchestra.run.gibba025.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243374.827809_537.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:09:34.827809Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:14:53.508 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-02-13T19:14:53.508 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T19:14:53.508 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:14:53.508 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:14:53.509 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:14:53.692 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243374.827809_537.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:09:34.827809Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:14:53.693 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T19:14:53.693 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:14:53.693 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:14:53.693 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:14:53.804 INFO:teuthology.orchestra.run.gibba025.stderr:No --period given, using current period=c72c9bb6-7372-4355-b488-0f51f8a5cecb 2021-02-13T19:14:53.820 INFO:teuthology.orchestra.run.gibba025.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613243374.827809_537.1","last_update":"2021-02-13 19:09:34.827809Z"}] 2021-02-13T19:14:53.821 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T19:14:53.821 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:14:53.821 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:14:53.821 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:14:54.042 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243374.827809_537.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:09:34.827809Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:14:54.042 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T19:14:54.111 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:14:54.111 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:14:54.112 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:14:54.218 INFO:teuthology.orchestra.run.gibba025.stderr:No --period given, using current period=c72c9bb6-7372-4355-b488-0f51f8a5cecb 2021-02-13T19:14:54.234 INFO:teuthology.orchestra.run.gibba025.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613243694.099311_547.1","last_update":"2021-02-13 19:14:54.099311Z"}] 2021-02-13T19:14:54.235 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T19:14:54.235 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:14:54.235 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:14:54.235 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:14:54.414 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243374.827809_537.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:09:34.827809Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:14:54.414 WARNING:rgw_multi.tests:zone test-zone4 behind master: shard=3 master=1_1613243694.099311_547.1 target=1_1613243374.827809_537.1 2021-02-13T19:14:59.415 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:14:59.415 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:14:59.415 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:14:59.591 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243694.099311_547.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:14:54.099311Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:14:59.591 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T19:14:59.799 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:14:59.800 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:14:59.800 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:14:59.865 INFO:teuthology.orchestra.run.gibba025.stderr:No --period given, using current period=c72c9bb6-7372-4355-b488-0f51f8a5cecb 2021-02-13T19:14:59.884 INFO:teuthology.orchestra.run.gibba025.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613243694.099311_547.1","last_update":"2021-02-13 19:14:54.099311Z"}] 2021-02-13T19:14:59.885 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T19:14:59.885 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:14:59.885 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:14:59.885 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:15:00.070 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243694.099311_547.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:14:54.099311Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:15:00.071 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T19:15:01.088 INFO:tasks.rgw_multisite_tests:test low level implementation of s3 notifications ... ok 2021-02-13T19:15:01.088 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:01.088 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:01.088 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:15:01.200 INFO:teuthology.orchestra.run.gibba025.stderr:No --period given, using current period=c72c9bb6-7372-4355-b488-0f51f8a5cecb 2021-02-13T19:15:01.215 INFO:teuthology.orchestra.run.gibba025.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613243701.074927_549.1","last_update":"2021-02-13 19:15:01.074927Z"}] 2021-02-13T19:15:01.216 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-02-13T19:15:01.216 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:01.216 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:01.216 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:15:01.299 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243694.099311_547.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:14:54.099311Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:15:01.299 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=3 master=1_1613243701.074927_549.1 target=1_1613243694.099311_547.1 2021-02-13T19:15:06.300 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:06.300 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:06.300 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:15:06.384 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243701.074927_549.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:15:01.074927Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:15:06.384 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-02-13T19:15:06.385 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-02-13T19:15:06.385 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:06.385 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:06.385 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:15:06.471 INFO:teuthology.orchestra.run.gibba025.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243701.074927_549.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:15:01.074927Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:15:06.471 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-02-13T19:15:06.471 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T19:15:06.471 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:06.471 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:06.472 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:15:06.652 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243701.074927_549.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:15:01.074927Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:15:06.653 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T19:15:06.653 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:06.653 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:06.653 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:15:06.725 INFO:teuthology.orchestra.run.gibba025.stderr:No --period given, using current period=c72c9bb6-7372-4355-b488-0f51f8a5cecb 2021-02-13T19:15:06.739 INFO:teuthology.orchestra.run.gibba025.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613243701.074927_549.1","last_update":"2021-02-13 19:15:01.074927Z"}] 2021-02-13T19:15:06.739 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T19:15:06.739 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:06.739 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:06.740 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:15:06.931 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243701.074927_549.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:15:01.074927Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:15:06.931 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T19:15:07.142 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:07.142 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:07.142 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:15:07.204 INFO:teuthology.orchestra.run.gibba025.stderr:No --period given, using current period=c72c9bb6-7372-4355-b488-0f51f8a5cecb 2021-02-13T19:15:07.219 INFO:teuthology.orchestra.run.gibba025.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613243707.129675_553.1","last_update":"2021-02-13 19:15:07.129675Z"}] 2021-02-13T19:15:07.219 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T19:15:07.219 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:07.219 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:07.220 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:15:07.437 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243701.074927_549.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:15:01.074927Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:15:07.438 WARNING:rgw_multi.tests:zone test-zone4 behind master: shard=3 master=1_1613243707.129675_553.1 target=1_1613243701.074927_549.1 2021-02-13T19:15:12.439 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:12.439 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:12.439 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:15:12.616 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243707.129675_553.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:15:07.129675Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:15:12.616 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T19:15:12.644 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:12.644 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:12.644 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:15:12.709 INFO:teuthology.orchestra.run.gibba025.stderr:No --period given, using current period=c72c9bb6-7372-4355-b488-0f51f8a5cecb 2021-02-13T19:15:12.724 INFO:teuthology.orchestra.run.gibba025.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613243707.129675_553.1","last_update":"2021-02-13 19:15:07.129675Z"}] 2021-02-13T19:15:12.724 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T19:15:12.724 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:12.724 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:12.725 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:15:12.945 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243707.129675_553.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:15:07.129675Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:15:12.945 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T19:15:14.347 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-71', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:14.347 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-71', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:14.348 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ejuwhf-71 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:15:14.472 INFO:teuthology.orchestra.run.gibba025.stdout:{"markers":[{"key":0,"val":"00000000020.20.5"}]} 2021-02-13T19:15:14.473 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone4 source_zone=test-zone1 bucket=ejuwhf-71 2021-02-13T19:15:14.473 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-71', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:14.473 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-71', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:14.473 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ejuwhf-71 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:15:14.656 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:15:14.657 WARNING:rgw_multi.tests:bucket ejuwhf-71 zone test-zone4 behind zone test-zone1: shard=0 master=00000000020.20.5 target= 2021-02-13T19:15:19.658 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-71', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:19.658 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-71', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:19.659 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ejuwhf-71 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:15:19.846 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"9","instance":"","ns":""},"count":10},"inc_marker":{"position":"0#00000000020.20.5"}}}] 2021-02-13T19:15:19.846 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone4 source_zone=test-zone1 bucket=ejuwhf-71 2021-02-13T19:15:19.851 DEBUG:tasks.rgw_multi.tests_ps:{'eventVersion': '2.2', 'eventSource': 'ceph:s3', 'awsRegion': '', 'eventTime': '2021-02-13 19:15:14.159034Z', 'eventName': 's3:ObjectCreated:*', 'userIdentity': {'principalId': ''}, 'requestParameters': {'sourceIPAddress': ''}, 'responseElements': {'x-amz-request-id': '', 'x-amz-id-2': ''}, 's3': {'s3SchemaVersion': '1.0', 'configurationId': 'ejuwhf-71_notif', 'bucket': {'name': 'ejuwhf-71', 'ownerIdentity': {'principalId': 'rgw-multisite-test-user'}, 'arn': 'arn:aws:s3:::ejuwhf-71', 'id': '671230a8-4b04-4e98-83d8-0a04dcd55dc0.5112.22'}, 'object': {'key': '6', 'size': 0, 'etag': '3bad0d23', 'versionId': '', 'sequencer': '43252860F72D160B', 'metadata': [], 'tags': []}}, 'eventId': '1613243715.186002.3bad0d23', 'opaqueData': ''} 2021-02-13T19:15:19.851 DEBUG:tasks.rgw_multi.tests_ps:{'eventVersion': '2.2', 'eventSource': 'ceph:s3', 'awsRegion': '', 'eventTime': '2021-02-13 19:15:13.931489Z', 'eventName': 's3:ObjectCreated:*', 'userIdentity': {'principalId': ''}, 'requestParameters': {'sourceIPAddress': ''}, 'responseElements': {'x-amz-request-id': '', 'x-amz-id-2': ''}, 's3': {'s3SchemaVersion': '1.0', 'configurationId': 'ejuwhf-71_notif', 'bucket': {'name': 'ejuwhf-71', 'ownerIdentity': {'principalId': 'rgw-multisite-test-user'}, 'arn': 'arn:aws:s3:::ejuwhf-71', 'id': '671230a8-4b04-4e98-83d8-0a04dcd55dc0.5112.22'}, 'object': {'key': '1', 'size': 0, 'etag': '8ce3d234', 'versionId': '', 'sequencer': '432528600C501B0B', 'metadata': [], 'tags': []}}, 'eventId': '1613243715.186339.8ce3d234', 'opaqueData': ''} 2021-02-13T19:15:19.851 DEBUG:tasks.rgw_multi.tests_ps:{'eventVersion': '2.2', 'eventSource': 'ceph:s3', 'awsRegion': '', 'eventTime': '2021-02-13 19:15:14.066907Z', 'eventName': 's3:ObjectCreated:*', 'userIdentity': {'principalId': ''}, 'requestParameters': {'sourceIPAddress': ''}, 'responseElements': {'x-amz-request-id': '', 'x-amz-id-2': ''}, 's3': {'s3SchemaVersion': '1.0', 'configurationId': 'ejuwhf-71_notif', 'bucket': {'name': 'ejuwhf-71', 'ownerIdentity': {'principalId': 'rgw-multisite-test-user'}, 'arn': 'arn:aws:s3:::ejuwhf-71', 'id': '671230a8-4b04-4e98-83d8-0a04dcd55dc0.5112.22'}, 'object': {'key': '4', 'size': 0, 'etag': 'e160129c', 'versionId': '', 'sequencer': '43252860057A200B', 'metadata': [], 'tags': []}}, 'eventId': '1613243715.186677.e160129c', 'opaqueData': ''} 2021-02-13T19:15:19.851 DEBUG:tasks.rgw_multi.tests_ps:{'eventVersion': '2.2', 'eventSource': 'ceph:s3', 'awsRegion': '', 'eventTime': '2021-02-13 19:15:13.974916Z', 'eventName': 's3:ObjectCreated:*', 'userIdentity': {'principalId': ''}, 'requestParameters': {'sourceIPAddress': ''}, 'responseElements': {'x-amz-request-id': '', 'x-amz-id-2': ''}, 's3': {'s3SchemaVersion': '1.0', 'configurationId': 'ejuwhf-71_notif', 'bucket': {'name': 'ejuwhf-71', 'ownerIdentity': {'principalId': 'rgw-multisite-test-user'}, 'arn': 'arn:aws:s3:::ejuwhf-71', 'id': '671230a8-4b04-4e98-83d8-0a04dcd55dc0.5112.22'}, 'object': {'key': '2', 'size': 0, 'etag': '4035d488', 'versionId': '', 'sequencer': '43252860FE202D0B', 'metadata': [], 'tags': []}}, 'eventId': '1613243715.187506.4035d488', 'opaqueData': ''} 2021-02-13T19:15:19.851 DEBUG:tasks.rgw_multi.tests_ps:{'eventVersion': '2.2', 'eventSource': 'ceph:s3', 'awsRegion': '', 'eventTime': '2021-02-13 19:15:14.254986Z', 'eventName': 's3:ObjectCreated:*', 'userIdentity': {'principalId': ''}, 'requestParameters': {'sourceIPAddress': ''}, 'responseElements': {'x-amz-request-id': '', 'x-amz-id-2': ''}, 's3': {'s3SchemaVersion': '1.0', 'configurationId': 'ejuwhf-71_notif', 'bucket': {'name': 'ejuwhf-71', 'ownerIdentity': {'principalId': 'rgw-multisite-test-user'}, 'arn': 'arn:aws:s3:::ejuwhf-71', 'id': '671230a8-4b04-4e98-83d8-0a04dcd55dc0.5112.22'}, 'object': {'key': '8', 'size': 0, 'etag': 'fee09fcd', 'versionId': '', 'sequencer': '432528603094320B', 'metadata': [], 'tags': []}}, 'eventId': '1613243715.187864.fee09fcd', 'opaqueData': ''} 2021-02-13T19:15:19.852 DEBUG:tasks.rgw_multi.tests_ps:{'eventVersion': '2.2', 'eventSource': 'ceph:s3', 'awsRegion': '', 'eventTime': '2021-02-13 19:15:13.904417Z', 'eventName': 's3:ObjectCreated:*', 'userIdentity': {'principalId': ''}, 'requestParameters': {'sourceIPAddress': ''}, 'responseElements': {'x-amz-request-id': '', 'x-amz-id-2': ''}, 's3': {'s3SchemaVersion': '1.0', 'configurationId': 'ejuwhf-71_notif', 'bucket': {'name': 'ejuwhf-71', 'ownerIdentity': {'principalId': 'rgw-multisite-test-user'}, 'arn': 'arn:aws:s3:::ejuwhf-71', 'id': '671230a8-4b04-4e98-83d8-0a04dcd55dc0.5112.22'}, 'object': {'key': '0', 'size': 0, 'etag': 'b97e5655', 'versionId': '', 'sequencer': '432528606291390B', 'metadata': [], 'tags': []}}, 'eventId': '1613243715.188322.b97e5655', 'opaqueData': ''} 2021-02-13T19:15:19.852 DEBUG:tasks.rgw_multi.tests_ps:{'eventVersion': '2.2', 'eventSource': 'ceph:s3', 'awsRegion': '', 'eventTime': '2021-02-13 19:15:14.298991Z', 'eventName': 's3:ObjectCreated:*', 'userIdentity': {'principalId': ''}, 'requestParameters': {'sourceIPAddress': ''}, 'responseElements': {'x-amz-request-id': '', 'x-amz-id-2': ''}, 's3': {'s3SchemaVersion': '1.0', 'configurationId': 'ejuwhf-71_notif', 'bucket': {'name': 'ejuwhf-71', 'ownerIdentity': {'principalId': 'rgw-multisite-test-user'}, 'arn': 'arn:aws:s3:::ejuwhf-71', 'id': '671230a8-4b04-4e98-83d8-0a04dcd55dc0.5112.22'}, 'object': {'key': '9', 'size': 0, 'etag': '0962c83a', 'versionId': '', 'sequencer': '43252860F47F430B', 'metadata': [], 'tags': []}}, 'eventId': '1613243715.188973.0962c83a', 'opaqueData': ''} 2021-02-13T19:15:19.852 DEBUG:tasks.rgw_multi.tests_ps:{'eventVersion': '2.2', 'eventSource': 'ceph:s3', 'awsRegion': '', 'eventTime': '2021-02-13 19:15:14.111117Z', 'eventName': 's3:ObjectCreated:*', 'userIdentity': {'principalId': ''}, 'requestParameters': {'sourceIPAddress': ''}, 'responseElements': {'x-amz-request-id': '', 'x-amz-id-2': ''}, 's3': {'s3SchemaVersion': '1.0', 'configurationId': 'ejuwhf-71_notif', 'bucket': {'name': 'ejuwhf-71', 'ownerIdentity': {'principalId': 'rgw-multisite-test-user'}, 'arn': 'arn:aws:s3:::ejuwhf-71', 'id': '671230a8-4b04-4e98-83d8-0a04dcd55dc0.5112.22'}, 'object': {'key': '5', 'size': 0, 'etag': 'f8f1cc25', 'versionId': '', 'sequencer': '43252860D7C09B0B', 'metadata': [], 'tags': []}}, 'eventId': '1613243715.194756.f8f1cc25', 'opaqueData': ''} 2021-02-13T19:15:19.852 DEBUG:tasks.rgw_multi.tests_ps:{'eventVersion': '2.2', 'eventSource': 'ceph:s3', 'awsRegion': '', 'eventTime': '2021-02-13 19:15:14.207168Z', 'eventName': 's3:ObjectCreated:*', 'userIdentity': {'principalId': ''}, 'requestParameters': {'sourceIPAddress': ''}, 'responseElements': {'x-amz-request-id': '', 'x-amz-id-2': ''}, 's3': {'s3SchemaVersion': '1.0', 'configurationId': 'ejuwhf-71_notif', 'bucket': {'name': 'ejuwhf-71', 'ownerIdentity': {'principalId': 'rgw-multisite-test-user'}, 'arn': 'arn:aws:s3:::ejuwhf-71', 'id': '671230a8-4b04-4e98-83d8-0a04dcd55dc0.5112.22'}, 'object': {'key': '7', 'size': 0, 'etag': 'e957f5fb', 'versionId': '', 'sequencer': '43252860F7CAA20B', 'metadata': [], 'tags': []}}, 'eventId': '1613243715.195218.e957f5fb', 'opaqueData': ''} 2021-02-13T19:15:19.852 DEBUG:tasks.rgw_multi.tests_ps:{'eventVersion': '2.2', 'eventSource': 'ceph:s3', 'awsRegion': '', 'eventTime': '2021-02-13 19:15:14.018940Z', 'eventName': 's3:ObjectCreated:*', 'userIdentity': {'principalId': ''}, 'requestParameters': {'sourceIPAddress': ''}, 'responseElements': {'x-amz-request-id': '', 'x-amz-id-2': ''}, 's3': {'s3SchemaVersion': '1.0', 'configurationId': 'ejuwhf-71_notif', 'bucket': {'name': 'ejuwhf-71', 'ownerIdentity': {'principalId': 'rgw-multisite-test-user'}, 'arn': 'arn:aws:s3:::ejuwhf-71', 'id': '671230a8-4b04-4e98-83d8-0a04dcd55dc0.5112.22'}, 'object': {'key': '3', 'size': 0, 'etag': 'b944fff4', 'versionId': '', 'sequencer': '43252860B6A8A90B', 'metadata': [], 'tags': []}}, 'eventId': '1613243715.195668.b944fff4', 'opaqueData': ''} 2021-02-13T19:15:19.890 WARNING:tasks.rgw_multi.tests_ps:superfluous records are found 2021-02-13T19:15:20.183 INFO:tasks.rgw_multisite_tests:test s3 records fetching ... ok 2021-02-13T19:15:20.184 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:20.184 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:20.184 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:15:20.281 INFO:teuthology.orchestra.run.gibba025.stderr:No --period given, using current period=c72c9bb6-7372-4355-b488-0f51f8a5cecb 2021-02-13T19:15:20.297 INFO:teuthology.orchestra.run.gibba025.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613243720.171130_561.1","last_update":"2021-02-13 19:15:20.171130Z"}] 2021-02-13T19:15:20.297 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-02-13T19:15:20.297 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:20.297 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:20.297 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:15:20.381 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243707.129675_553.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:15:07.129675Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:15:20.381 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=3 master=1_1613243720.171130_561.1 target=1_1613243707.129675_553.1 2021-02-13T19:15:25.383 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:25.383 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:25.383 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:15:25.468 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243720.171130_561.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:15:20.171130Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:15:25.469 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-02-13T19:15:25.469 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-02-13T19:15:25.469 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:25.469 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:25.469 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:15:25.548 INFO:teuthology.orchestra.run.gibba025.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243720.171130_561.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:15:20.171130Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:15:25.548 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-02-13T19:15:25.548 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T19:15:25.549 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:25.549 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:25.549 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:15:25.736 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243720.171130_561.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:15:20.171130Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:15:25.736 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T19:15:25.736 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:25.737 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:25.737 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:15:25.800 INFO:teuthology.orchestra.run.gibba025.stderr:No --period given, using current period=c72c9bb6-7372-4355-b488-0f51f8a5cecb 2021-02-13T19:15:25.816 INFO:teuthology.orchestra.run.gibba025.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613243720.171130_561.1","last_update":"2021-02-13 19:15:20.171130Z"}] 2021-02-13T19:15:25.817 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T19:15:25.817 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:25.817 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:25.817 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:15:26.039 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243720.171130_561.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:15:20.171130Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:15:26.039 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T19:15:26.562 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:26.562 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:26.562 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:15:26.676 INFO:teuthology.orchestra.run.gibba025.stderr:No --period given, using current period=c72c9bb6-7372-4355-b488-0f51f8a5cecb 2021-02-13T19:15:26.691 INFO:teuthology.orchestra.run.gibba025.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613243726.549246_568.1","last_update":"2021-02-13 19:15:26.549246Z"}] 2021-02-13T19:15:26.691 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T19:15:26.691 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:26.691 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:26.692 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:15:26.877 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243720.171130_561.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:15:20.171130Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:15:26.877 WARNING:rgw_multi.tests:zone test-zone4 behind master: shard=3 master=1_1613243726.549246_568.1 target=1_1613243720.171130_561.1 2021-02-13T19:15:31.878 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:31.878 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:31.878 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:15:32.065 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243726.549246_568.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:15:26.549246Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:15:32.066 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T19:15:32.121 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:32.121 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:32.121 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:15:32.191 INFO:teuthology.orchestra.run.gibba025.stderr:No --period given, using current period=c72c9bb6-7372-4355-b488-0f51f8a5cecb 2021-02-13T19:15:32.207 INFO:teuthology.orchestra.run.gibba025.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613243726.549246_568.1","last_update":"2021-02-13 19:15:26.549246Z"}] 2021-02-13T19:15:32.207 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T19:15:32.207 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:32.207 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:32.207 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:15:32.430 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243726.549246_568.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:15:26.549246Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:15:32.431 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T19:15:33.056 INFO:tasks.rgw_multisite_tests:test s3 notification set/get/delete ... ok 2021-02-13T19:15:33.056 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:33.056 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:33.057 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:15:33.159 INFO:teuthology.orchestra.run.gibba025.stderr:No --period given, using current period=c72c9bb6-7372-4355-b488-0f51f8a5cecb 2021-02-13T19:15:33.175 INFO:teuthology.orchestra.run.gibba025.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613243733.043243_570.1","last_update":"2021-02-13 19:15:33.043243Z"}] 2021-02-13T19:15:33.175 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-02-13T19:15:33.175 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:33.175 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:33.176 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:15:33.265 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243726.549246_568.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:15:26.549246Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:15:33.266 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=3 master=1_1613243733.043243_570.1 target=1_1613243726.549246_568.1 2021-02-13T19:15:38.267 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:38.267 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:38.267 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:15:38.350 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243733.043243_570.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:15:33.043243Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:15:38.351 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-02-13T19:15:38.351 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-02-13T19:15:38.351 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:38.351 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:38.351 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:15:38.429 INFO:teuthology.orchestra.run.gibba025.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243733.043243_570.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:15:33.043243Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:15:38.429 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-02-13T19:15:38.429 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T19:15:38.429 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:38.429 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:38.430 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:15:38.787 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243733.043243_570.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:15:33.043243Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:15:38.788 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T19:15:38.788 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:38.788 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:38.788 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:15:38.854 INFO:teuthology.orchestra.run.gibba025.stderr:No --period given, using current period=c72c9bb6-7372-4355-b488-0f51f8a5cecb 2021-02-13T19:15:38.872 INFO:teuthology.orchestra.run.gibba025.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613243733.043243_570.1","last_update":"2021-02-13 19:15:33.043243Z"}] 2021-02-13T19:15:38.873 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T19:15:38.873 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:38.873 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:38.873 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:15:39.094 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243733.043243_570.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:15:33.043243Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:15:39.095 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T19:15:39.235 INFO:tasks.rgw_multisite_tests:test s3 topics set/get/delete on master ... ok 2021-02-13T19:15:39.235 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:39.235 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:39.236 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:15:39.335 INFO:teuthology.orchestra.run.gibba025.stderr:No --period given, using current period=c72c9bb6-7372-4355-b488-0f51f8a5cecb 2021-02-13T19:15:39.350 INFO:teuthology.orchestra.run.gibba025.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613243733.043243_570.1","last_update":"2021-02-13 19:15:33.043243Z"}] 2021-02-13T19:15:39.350 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-02-13T19:15:39.351 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:39.351 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:39.351 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:15:39.439 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243733.043243_570.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:15:33.043243Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:15:39.440 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-02-13T19:15:39.440 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-02-13T19:15:39.440 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:39.440 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:39.440 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:15:39.562 INFO:teuthology.orchestra.run.gibba025.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243733.043243_570.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:15:33.043243Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:15:39.562 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-02-13T19:15:39.562 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T19:15:39.562 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:39.562 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:39.563 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:15:39.744 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243733.043243_570.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:15:33.043243Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:15:39.745 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T19:15:39.745 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:39.745 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:39.745 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:15:39.815 INFO:teuthology.orchestra.run.gibba025.stderr:No --period given, using current period=c72c9bb6-7372-4355-b488-0f51f8a5cecb 2021-02-13T19:15:39.830 INFO:teuthology.orchestra.run.gibba025.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613243733.043243_570.1","last_update":"2021-02-13 19:15:33.043243Z"}] 2021-02-13T19:15:39.830 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T19:15:39.830 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:39.830 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:39.830 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:15:40.007 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243733.043243_570.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:15:33.043243Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:15:40.007 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T19:15:40.007 INFO:tasks.rgw_multisite_tests:test s3 topics with secret set/get/delete on master ... ok 2021-02-13T19:15:40.008 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:40.008 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:40.008 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:15:40.069 INFO:teuthology.orchestra.run.gibba025.stderr:No --period given, using current period=c72c9bb6-7372-4355-b488-0f51f8a5cecb 2021-02-13T19:15:40.088 INFO:teuthology.orchestra.run.gibba025.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613243733.043243_570.1","last_update":"2021-02-13 19:15:33.043243Z"}] 2021-02-13T19:15:40.088 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-02-13T19:15:40.088 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:40.088 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:40.088 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:15:40.167 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243733.043243_570.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:15:33.043243Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:15:40.168 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-02-13T19:15:40.168 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-02-13T19:15:40.168 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:40.168 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:40.168 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:15:40.288 INFO:teuthology.orchestra.run.gibba025.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243733.043243_570.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:15:33.043243Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:15:40.289 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-02-13T19:15:40.289 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T19:15:40.289 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:40.289 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:40.289 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:15:40.470 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243733.043243_570.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:15:33.043243Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:15:40.470 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T19:15:40.471 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:40.471 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:40.471 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:15:40.535 INFO:teuthology.orchestra.run.gibba025.stderr:No --period given, using current period=c72c9bb6-7372-4355-b488-0f51f8a5cecb 2021-02-13T19:15:40.551 INFO:teuthology.orchestra.run.gibba025.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613243733.043243_570.1","last_update":"2021-02-13 19:15:33.043243Z"}] 2021-02-13T19:15:40.552 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T19:15:40.552 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:40.553 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:40.553 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:15:40.739 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243733.043243_570.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:15:33.043243Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:15:40.740 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T19:15:41.995 INFO:tasks.rgw_multisite_tests:test s3 notification set/get/delete on master ... ok 2021-02-13T19:15:41.995 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.tests_ps.test_ps_s3_notification_filter_on_master ... ok 2021-02-13T19:15:41.996 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.tests_ps.test_ps_s3_notification_filter ... ok 2021-02-13T19:15:41.996 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:41.996 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:41.996 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:15:42.096 INFO:teuthology.orchestra.run.gibba025.stderr:No --period given, using current period=c72c9bb6-7372-4355-b488-0f51f8a5cecb 2021-02-13T19:15:42.112 INFO:teuthology.orchestra.run.gibba025.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613243741.982635_593.1","last_update":"2021-02-13 19:15:41.982635Z"}] 2021-02-13T19:15:42.112 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-02-13T19:15:42.112 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:42.113 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:42.113 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:15:42.198 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243741.664607_579.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:15:41.664607Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:15:42.198 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=3 master=1_1613243741.982635_593.1 target=1_1613243741.664607_579.1 2021-02-13T19:15:47.199 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:47.200 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:47.200 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:15:47.280 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243741.982635_593.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:15:41.982635Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:15:47.281 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-02-13T19:15:47.281 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-02-13T19:15:47.281 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:47.281 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:47.282 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:15:47.365 INFO:teuthology.orchestra.run.gibba025.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243741.982635_593.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:15:41.982635Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:15:47.365 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-02-13T19:15:47.366 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T19:15:47.366 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:47.366 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:47.366 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:15:47.586 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243741.982635_593.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:15:41.982635Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:15:47.586 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T19:15:47.586 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:47.586 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:47.587 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:15:47.652 INFO:teuthology.orchestra.run.gibba025.stderr:No --period given, using current period=c72c9bb6-7372-4355-b488-0f51f8a5cecb 2021-02-13T19:15:47.667 INFO:teuthology.orchestra.run.gibba025.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613243741.982635_593.1","last_update":"2021-02-13 19:15:41.982635Z"}] 2021-02-13T19:15:47.667 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T19:15:47.667 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:47.667 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:47.668 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:15:47.851 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243741.982635_593.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:15:41.982635Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:15:47.851 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T19:15:48.627 INFO:tasks.rgw_multisite_tests:test s3 notification set/get/delete on master ... ok 2021-02-13T19:15:48.627 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.tests_ps.test_objcet_timing ... ok 2021-02-13T19:15:48.628 INFO:tasks.rgw_multisite_tests:test pushing amqp s3 notification on master ... ok 2021-02-13T19:15:48.628 INFO:tasks.rgw_multisite_tests:test pushing kafka s3 notification on master ... ok 2021-02-13T19:15:48.628 INFO:tasks.rgw_multisite_tests:test pushing kafka s3 notification on master ... ok 2021-02-13T19:15:48.628 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.tests_ps.test_ps_s3_notification_push_kafka_security_ssl ... ok 2021-02-13T19:15:48.628 INFO:tasks.rgw_multisite_tests:tasks.rgw_multi.tests_ps.test_ps_s3_notification_push_kafka_security_ssl_sasl ... ok 2021-02-13T19:15:48.629 INFO:tasks.rgw_multisite_tests:test deletion of multiple keys on master ... ok 2021-02-13T19:15:48.629 INFO:tasks.rgw_multisite_tests:test pushing http s3 notification on master ... ok 2021-02-13T19:15:48.629 INFO:tasks.rgw_multisite_tests:test that opaque id set in topic, is sent in notification ... ok 2021-02-13T19:15:48.629 INFO:tasks.rgw_multisite_tests:test that opaque id set in topic, is sent in notification on master ... ok 2021-02-13T19:15:48.629 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:48.630 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:48.630 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:15:48.736 INFO:teuthology.orchestra.run.gibba025.stderr:No --period given, using current period=c72c9bb6-7372-4355-b488-0f51f8a5cecb 2021-02-13T19:15:48.752 INFO:teuthology.orchestra.run.gibba025.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613243748.614782_603.1","last_update":"2021-02-13 19:15:48.614782Z"}] 2021-02-13T19:15:48.752 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-02-13T19:15:48.752 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:48.752 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:48.752 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:15:48.868 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243748.614782_603.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:15:48.614782Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:15:48.869 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-02-13T19:15:48.869 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-02-13T19:15:48.869 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:48.869 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:48.869 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:15:48.991 INFO:teuthology.orchestra.run.gibba025.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243741.982635_593.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:15:41.982635Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:15:48.992 WARNING:rgw_multi.tests:zone test-zone3 behind master: shard=3 master=1_1613243748.614782_603.1 target=1_1613243741.982635_593.1 2021-02-13T19:15:53.993 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:53.993 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:53.993 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:15:54.078 INFO:teuthology.orchestra.run.gibba025.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243748.614782_603.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:15:48.614782Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:15:54.078 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-02-13T19:15:54.079 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T19:15:54.079 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:54.079 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:54.079 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:15:54.264 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243748.614782_603.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:15:48.614782Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:15:54.265 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T19:15:54.265 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:54.265 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:54.265 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:15:54.331 INFO:teuthology.orchestra.run.gibba025.stderr:No --period given, using current period=c72c9bb6-7372-4355-b488-0f51f8a5cecb 2021-02-13T19:15:54.347 INFO:teuthology.orchestra.run.gibba025.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613243748.614782_603.1","last_update":"2021-02-13 19:15:48.614782Z"}] 2021-02-13T19:15:54.348 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T19:15:54.348 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:54.348 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:54.348 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:15:54.568 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243748.614782_603.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:15:48.614782Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:15:54.568 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T19:15:54.597 INFO:tasks.rgw_multisite_tests:test set/get/delete of topic ... ok 2021-02-13T19:15:54.598 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:54.598 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:54.598 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:15:54.707 INFO:teuthology.orchestra.run.gibba025.stderr:No --period given, using current period=c72c9bb6-7372-4355-b488-0f51f8a5cecb 2021-02-13T19:15:54.724 INFO:teuthology.orchestra.run.gibba025.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613243748.614782_603.1","last_update":"2021-02-13 19:15:48.614782Z"}] 2021-02-13T19:15:54.725 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-02-13T19:15:54.725 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:54.725 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:54.725 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:15:54.813 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243748.614782_603.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:15:48.614782Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:15:54.813 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-02-13T19:15:54.813 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-02-13T19:15:54.813 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:54.813 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:54.814 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:15:54.896 INFO:teuthology.orchestra.run.gibba025.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243748.614782_603.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:15:48.614782Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:15:54.897 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-02-13T19:15:54.897 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T19:15:54.897 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:54.897 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:54.898 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:15:55.117 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243748.614782_603.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:15:48.614782Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:15:55.117 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T19:15:55.118 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:55.118 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:55.118 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:15:55.221 INFO:teuthology.orchestra.run.gibba025.stderr:No --period given, using current period=c72c9bb6-7372-4355-b488-0f51f8a5cecb 2021-02-13T19:15:55.235 INFO:teuthology.orchestra.run.gibba025.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613243748.614782_603.1","last_update":"2021-02-13 19:15:48.614782Z"}] 2021-02-13T19:15:55.236 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T19:15:55.236 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:55.236 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:55.236 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:15:55.413 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243748.614782_603.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:15:48.614782Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:15:55.413 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T19:15:55.424 INFO:tasks.rgw_multisite_tests:test set topic with endpoint ... ok 2021-02-13T19:15:55.425 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:55.425 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:55.425 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:15:55.528 INFO:teuthology.orchestra.run.gibba025.stderr:No --period given, using current period=c72c9bb6-7372-4355-b488-0f51f8a5cecb 2021-02-13T19:15:55.544 INFO:teuthology.orchestra.run.gibba025.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613243748.614782_603.1","last_update":"2021-02-13 19:15:48.614782Z"}] 2021-02-13T19:15:55.544 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-02-13T19:15:55.544 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:55.544 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:55.544 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:15:55.665 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243748.614782_603.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:15:48.614782Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:15:55.666 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-02-13T19:15:55.666 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-02-13T19:15:55.666 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:55.666 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:55.666 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:15:55.787 INFO:teuthology.orchestra.run.gibba025.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243748.614782_603.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:15:48.614782Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:15:55.788 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-02-13T19:15:55.788 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T19:15:55.788 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:55.788 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:55.788 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:15:56.009 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243748.614782_603.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:15:48.614782Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:15:56.010 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T19:15:56.010 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:56.010 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:56.010 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:15:56.092 INFO:teuthology.orchestra.run.gibba025.stderr:No --period given, using current period=c72c9bb6-7372-4355-b488-0f51f8a5cecb 2021-02-13T19:15:56.107 INFO:teuthology.orchestra.run.gibba025.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613243748.614782_603.1","last_update":"2021-02-13 19:15:48.614782Z"}] 2021-02-13T19:15:56.107 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T19:15:56.107 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:56.107 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:56.108 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:15:56.291 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243748.614782_603.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:15:48.614782Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:15:56.291 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T19:15:57.075 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:57.266 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:57.266 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:15:57.372 INFO:teuthology.orchestra.run.gibba025.stderr:No --period given, using current period=c72c9bb6-7372-4355-b488-0f51f8a5cecb 2021-02-13T19:15:57.387 INFO:teuthology.orchestra.run.gibba025.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613243757.063176_607.1","last_update":"2021-02-13 19:15:57.063176Z"}] 2021-02-13T19:15:57.387 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T19:15:57.388 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:57.388 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:15:57.388 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:15:57.574 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243748.614782_603.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:15:48.614782Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:15:57.574 WARNING:rgw_multi.tests:zone test-zone4 behind master: shard=3 master=1_1613243757.063176_607.1 target=1_1613243748.614782_603.1 2021-02-13T19:16:02.576 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:16:02.576 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:16:02.576 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:16:02.761 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243757.063176_607.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:15:57.063176Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:16:02.761 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T19:16:03.262 INFO:tasks.rgw_multisite_tests:test set/get/delete of notification ... ok 2021-02-13T19:16:03.262 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:16:03.263 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:16:03.263 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:16:03.335 INFO:teuthology.orchestra.run.gibba025.stderr:No --period given, using current period=c72c9bb6-7372-4355-b488-0f51f8a5cecb 2021-02-13T19:16:03.354 INFO:teuthology.orchestra.run.gibba025.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613243763.249586_609.1","last_update":"2021-02-13 19:16:03.249586Z"}] 2021-02-13T19:16:03.354 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-02-13T19:16:03.354 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:16:03.354 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:16:03.355 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:16:03.438 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243757.063176_607.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:15:57.063176Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:16:03.438 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=3 master=1_1613243763.249586_609.1 target=1_1613243757.063176_607.1 2021-02-13T19:16:08.439 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:16:08.440 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:16:08.440 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:16:08.528 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243763.249586_609.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:16:03.249586Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:16:08.528 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-02-13T19:16:08.529 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-02-13T19:16:08.529 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:16:08.529 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:16:08.529 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:16:08.608 INFO:teuthology.orchestra.run.gibba025.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243763.249586_609.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:16:03.249586Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:16:08.609 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-02-13T19:16:08.609 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T19:16:08.609 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:16:08.609 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:16:08.609 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:16:08.791 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243763.249586_609.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:16:03.249586Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:16:08.791 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T19:16:08.792 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:16:08.792 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:16:08.792 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:16:08.857 INFO:teuthology.orchestra.run.gibba025.stderr:No --period given, using current period=c72c9bb6-7372-4355-b488-0f51f8a5cecb 2021-02-13T19:16:08.881 INFO:teuthology.orchestra.run.gibba025.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613243763.249586_609.1","last_update":"2021-02-13 19:16:03.249586Z"}] 2021-02-13T19:16:08.881 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T19:16:08.881 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:16:08.882 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:16:08.882 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:16:09.060 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243763.249586_609.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:16:03.249586Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:16:09.060 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T19:16:09.990 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:16:09.990 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:16:09.990 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:16:10.088 INFO:teuthology.orchestra.run.gibba025.stderr:No --period given, using current period=c72c9bb6-7372-4355-b488-0f51f8a5cecb 2021-02-13T19:16:10.103 INFO:teuthology.orchestra.run.gibba025.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613243769.977817_613.1","last_update":"2021-02-13 19:16:09.977817Z"}] 2021-02-13T19:16:10.104 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T19:16:10.104 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:16:10.104 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:16:10.104 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:16:10.289 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243763.249586_609.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:16:03.249586Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:16:10.289 WARNING:rgw_multi.tests:zone test-zone4 behind master: shard=3 master=1_1613243769.977817_613.1 target=1_1613243763.249586_609.1 2021-02-13T19:16:15.290 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:16:15.291 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:16:15.291 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:16:15.475 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243769.977817_613.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:16:09.977817Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:16:15.475 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T19:16:16.415 INFO:tasks.rgw_multisite_tests:test set/get/delete of notification on specific events ... ok 2021-02-13T19:16:16.415 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:16:16.415 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:16:16.415 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:16:16.514 INFO:teuthology.orchestra.run.gibba025.stderr:No --period given, using current period=c72c9bb6-7372-4355-b488-0f51f8a5cecb 2021-02-13T19:16:16.530 INFO:teuthology.orchestra.run.gibba025.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613243776.402766_615.1","last_update":"2021-02-13 19:16:16.402766Z"}] 2021-02-13T19:16:16.531 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-02-13T19:16:16.531 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:16:16.531 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:16:16.531 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:16:16.613 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243769.977817_613.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:16:09.977817Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:16:16.613 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=3 master=1_1613243776.402766_615.1 target=1_1613243769.977817_613.1 2021-02-13T19:16:21.615 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:16:21.615 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:16:21.615 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:16:21.705 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243776.402766_615.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:16:16.402766Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:16:21.705 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-02-13T19:16:21.706 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-02-13T19:16:21.706 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:16:21.706 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:16:21.706 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:16:21.907 INFO:teuthology.orchestra.run.gibba025.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243776.402766_615.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:16:16.402766Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:16:21.908 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-02-13T19:16:21.908 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T19:16:21.908 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:16:21.908 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:16:21.908 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:16:22.128 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243776.402766_615.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:16:16.402766Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:16:22.128 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T19:16:22.129 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:16:22.129 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:16:22.129 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:16:22.236 INFO:teuthology.orchestra.run.gibba025.stderr:No --period given, using current period=c72c9bb6-7372-4355-b488-0f51f8a5cecb 2021-02-13T19:16:22.251 INFO:teuthology.orchestra.run.gibba025.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613243776.402766_615.1","last_update":"2021-02-13 19:16:16.402766Z"}] 2021-02-13T19:16:22.251 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T19:16:22.252 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:16:22.252 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:16:22.252 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:16:22.469 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243776.402766_615.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:16:16.402766Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:16:22.469 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T19:16:23.188 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:16:23.188 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:16:23.188 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:16:23.294 INFO:teuthology.orchestra.run.gibba025.stderr:No --period given, using current period=c72c9bb6-7372-4355-b488-0f51f8a5cecb 2021-02-13T19:16:23.310 INFO:teuthology.orchestra.run.gibba025.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613243783.176121_621.1","last_update":"2021-02-13 19:16:23.176121Z"}] 2021-02-13T19:16:23.310 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T19:16:23.310 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:16:23.311 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:16:23.311 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:16:23.492 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243776.402766_615.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:16:16.402766Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:16:23.493 WARNING:rgw_multi.tests:zone test-zone4 behind master: shard=3 master=1_1613243783.176121_621.1 target=1_1613243776.402766_615.1 2021-02-13T19:16:28.494 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:16:28.494 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:16:28.495 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:16:28.670 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243783.176121_621.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:16:23.176121Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:16:28.671 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T19:16:29.399 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-80', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:16:29.399 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-80', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:16:29.399 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ejuwhf-80 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:16:29.520 INFO:teuthology.orchestra.run.gibba025.stdout:{"markers":[{"key":0,"val":"00000000020.61.5"}]} 2021-02-13T19:16:29.521 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone4 source_zone=test-zone1 bucket=ejuwhf-80 2021-02-13T19:16:29.521 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-80', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:16:29.521 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-80', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:16:29.521 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ejuwhf-80 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:16:29.705 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:16:29.706 WARNING:rgw_multi.tests:bucket ejuwhf-80 zone test-zone4 behind zone test-zone1: shard=0 master=00000000020.61.5 target= 2021-02-13T19:16:34.706 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-80', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:16:34.707 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-80', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:16:34.707 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ejuwhf-80 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:16:34.890 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"9","instance":"","ns":""},"count":10},"inc_marker":{"position":"0#00000000020.61.5"}}}] 2021-02-13T19:16:34.890 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone4 source_zone=test-zone1 bucket=ejuwhf-80 2021-02-13T19:16:34.895 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "6" type: "OBJECT_CREATE" 2021-02-13T19:16:34.895 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "9" type: "OBJECT_CREATE" 2021-02-13T19:16:34.895 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "7" type: "OBJECT_CREATE" 2021-02-13T19:16:34.895 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "2" type: "OBJECT_CREATE" 2021-02-13T19:16:34.895 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "8" type: "OBJECT_CREATE" 2021-02-13T19:16:34.895 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "5" type: "OBJECT_CREATE" 2021-02-13T19:16:34.895 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "4" type: "OBJECT_CREATE" 2021-02-13T19:16:34.895 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "3" type: "OBJECT_CREATE" 2021-02-13T19:16:34.895 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "0" type: "OBJECT_CREATE" 2021-02-13T19:16:34.896 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "1" type: "OBJECT_CREATE" 2021-02-13T19:16:35.723 DEBUG:tasks.rgw_multi.tests_ps:superfluous events are found 2021-02-13T19:16:35.914 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:16:35.915 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:16:35.915 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:16:36.007 INFO:teuthology.orchestra.run.gibba025.stderr:No --period given, using current period=c72c9bb6-7372-4355-b488-0f51f8a5cecb 2021-02-13T19:16:36.021 INFO:teuthology.orchestra.run.gibba025.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613243783.176121_621.1","last_update":"2021-02-13 19:16:23.176121Z"}] 2021-02-13T19:16:36.021 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T19:16:36.021 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:16:36.021 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:16:36.021 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:16:36.199 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243783.176121_621.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:16:23.176121Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:16:36.199 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T19:16:36.199 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-80', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:16:36.200 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-80', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:16:36.200 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ejuwhf-80 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:16:36.322 INFO:teuthology.orchestra.run.gibba025.stdout:{"markers":[{"key":0,"val":"00000000040.81.5"}]} 2021-02-13T19:16:36.322 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone4 source_zone=test-zone1 bucket=ejuwhf-80 2021-02-13T19:16:36.322 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-80', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:16:36.322 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-80', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:16:36.323 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ejuwhf-80 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:16:36.544 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"9","instance":"","ns":""},"count":10},"inc_marker":{"position":"00000000040.81.5"}}}] 2021-02-13T19:16:36.544 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone4 source_zone=test-zone1 bucket=ejuwhf-80 2021-02-13T19:16:36.556 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "6" type: "OBJECT_CREATE" 2021-02-13T19:16:36.556 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "9" type: "OBJECT_CREATE" 2021-02-13T19:16:36.556 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "7" type: "OBJECT_CREATE" 2021-02-13T19:16:36.557 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "2" type: "OBJECT_CREATE" 2021-02-13T19:16:36.557 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "8" type: "OBJECT_CREATE" 2021-02-13T19:16:36.557 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "5" type: "OBJECT_CREATE" 2021-02-13T19:16:36.557 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "4" type: "OBJECT_CREATE" 2021-02-13T19:16:36.557 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "3" type: "OBJECT_CREATE" 2021-02-13T19:16:36.557 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "0" type: "OBJECT_CREATE" 2021-02-13T19:16:36.557 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "1" type: "OBJECT_CREATE" 2021-02-13T19:16:36.653 INFO:tasks.rgw_multisite_tests:test set/get/delete of subscription ... ok 2021-02-13T19:16:36.654 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:16:36.654 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:16:36.654 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:16:36.756 INFO:teuthology.orchestra.run.gibba025.stderr:No --period given, using current period=c72c9bb6-7372-4355-b488-0f51f8a5cecb 2021-02-13T19:16:36.772 INFO:teuthology.orchestra.run.gibba025.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613243796.641230_623.1","last_update":"2021-02-13 19:16:36.641230Z"}] 2021-02-13T19:16:36.773 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-02-13T19:16:36.773 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:16:36.773 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:16:36.774 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:16:36.856 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243783.176121_621.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:16:23.176121Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:16:36.857 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=3 master=1_1613243796.641230_623.1 target=1_1613243783.176121_621.1 2021-02-13T19:16:41.858 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:16:41.858 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:16:41.858 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:16:41.945 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243796.641230_623.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:16:36.641230Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:16:41.945 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-02-13T19:16:41.945 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-02-13T19:16:41.945 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:16:41.945 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:16:41.946 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:16:42.031 INFO:teuthology.orchestra.run.gibba025.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243796.641230_623.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:16:36.641230Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:16:42.031 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-02-13T19:16:42.032 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T19:16:42.032 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:16:42.032 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:16:42.032 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:16:42.247 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243796.641230_623.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:16:36.641230Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:16:42.247 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T19:16:42.248 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:16:42.248 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:16:42.248 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:16:42.317 INFO:teuthology.orchestra.run.gibba025.stderr:No --period given, using current period=c72c9bb6-7372-4355-b488-0f51f8a5cecb 2021-02-13T19:16:42.331 INFO:teuthology.orchestra.run.gibba025.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613243796.641230_623.1","last_update":"2021-02-13 19:16:36.641230Z"}] 2021-02-13T19:16:42.331 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T19:16:42.331 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:16:42.332 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:16:42.332 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:16:42.550 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243796.641230_623.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:16:36.641230Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:16:42.551 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T19:16:43.140 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:16:43.140 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:16:43.141 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:16:43.205 INFO:teuthology.orchestra.run.gibba025.stderr:No --period given, using current period=c72c9bb6-7372-4355-b488-0f51f8a5cecb 2021-02-13T19:16:43.219 INFO:teuthology.orchestra.run.gibba025.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613243803.128216_627.1","last_update":"2021-02-13 19:16:43.128216Z"}] 2021-02-13T19:16:43.220 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T19:16:43.220 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:16:43.220 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:16:43.220 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:16:43.406 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243796.641230_623.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:16:36.641230Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:16:43.407 WARNING:rgw_multi.tests:zone test-zone4 behind master: shard=3 master=1_1613243803.128216_627.1 target=1_1613243796.641230_623.1 2021-02-13T19:16:48.407 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:16:48.408 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:16:48.408 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:16:48.625 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243803.128216_627.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:16:43.128216Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:16:48.625 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T19:16:48.625 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-81', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:16:48.626 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-81', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:16:48.626 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ejuwhf-81 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:16:48.713 INFO:teuthology.orchestra.run.gibba025.stdout:{"markers":[{"key":0,"val":""}]} 2021-02-13T19:16:48.713 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone4 source_zone=test-zone1 bucket=ejuwhf-81 2021-02-13T19:16:48.714 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-81', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:16:48.714 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-81', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:16:48.714 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ejuwhf-81 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:16:48.936 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:16:48.936 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone4 source_zone=test-zone1 bucket=ejuwhf-81 2021-02-13T19:16:50.119 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-81', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:16:50.119 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-81', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:16:50.119 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ejuwhf-81 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:16:50.207 INFO:teuthology.orchestra.run.gibba025.stdout:{"markers":[{"key":0,"val":"00000000020.25.5"}]} 2021-02-13T19:16:50.207 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone4 source_zone=test-zone1 bucket=ejuwhf-81 2021-02-13T19:16:50.207 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-81', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:16:50.207 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-81', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:16:50.208 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ejuwhf-81 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:16:50.426 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"8","instance":"","ns":""},"count":9},"inc_marker":{"position":"00000000020.25.5"}}}] 2021-02-13T19:16:50.426 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone4 source_zone=test-zone1 bucket=ejuwhf-81 2021-02-13T19:16:50.437 DEBUG:tasks.rgw_multi.tests_ps:Event (OBJECT_CREATE): objname: "4" type: "OBJECT_CREATE" 2021-02-13T19:16:50.437 DEBUG:tasks.rgw_multi.tests_ps:Event (OBJECT_CREATE): objname: "6" type: "OBJECT_CREATE" 2021-02-13T19:16:50.437 DEBUG:tasks.rgw_multi.tests_ps:Event (OBJECT_CREATE): objname: "3" type: "OBJECT_CREATE" 2021-02-13T19:16:50.437 DEBUG:tasks.rgw_multi.tests_ps:Event (OBJECT_CREATE): objname: "0" type: "OBJECT_CREATE" 2021-02-13T19:16:50.437 DEBUG:tasks.rgw_multi.tests_ps:Event (OBJECT_CREATE): objname: "8" type: "OBJECT_CREATE" 2021-02-13T19:16:50.437 DEBUG:tasks.rgw_multi.tests_ps:Event (OBJECT_CREATE): objname: "7" type: "OBJECT_CREATE" 2021-02-13T19:16:50.437 DEBUG:tasks.rgw_multi.tests_ps:Event (OBJECT_CREATE): objname: "5" type: "OBJECT_CREATE" 2021-02-13T19:16:50.437 DEBUG:tasks.rgw_multi.tests_ps:Event (OBJECT_CREATE): objname: "1" type: "OBJECT_CREATE" 2021-02-13T19:16:50.437 DEBUG:tasks.rgw_multi.tests_ps:Event (OBJECT_CREATE): objname: "2" type: "OBJECT_CREATE" 2021-02-13T19:16:50.437 DEBUG:tasks.rgw_multi.tests_ps:Event (OBJECT_CREATE): objname: "9" type: "OBJECT_CREATE" 2021-02-13T19:16:50.437 DEBUG:tasks.rgw_multi.tests_ps:Event (OBJECT_CREATE): objname: "8" type: "OBJECT_CREATE" 2021-02-13T19:16:50.447 DEBUG:tasks.rgw_multi.tests_ps:superfluous events are found 2021-02-13T19:16:50.461 DEBUG:tasks.rgw_multi.tests_ps:Event (OBJECT_CREATE,OBJECT_DELETE): objname: "4" type: "OBJECT_CREATE" 2021-02-13T19:16:50.461 DEBUG:tasks.rgw_multi.tests_ps:Event (OBJECT_CREATE,OBJECT_DELETE): objname: "6" type: "OBJECT_CREATE" 2021-02-13T19:16:50.461 DEBUG:tasks.rgw_multi.tests_ps:Event (OBJECT_CREATE,OBJECT_DELETE): objname: "3" type: "OBJECT_CREATE" 2021-02-13T19:16:50.461 DEBUG:tasks.rgw_multi.tests_ps:Event (OBJECT_CREATE,OBJECT_DELETE): objname: "0" type: "OBJECT_CREATE" 2021-02-13T19:16:50.461 DEBUG:tasks.rgw_multi.tests_ps:Event (OBJECT_CREATE,OBJECT_DELETE): objname: "8" type: "OBJECT_CREATE" 2021-02-13T19:16:50.461 DEBUG:tasks.rgw_multi.tests_ps:Event (OBJECT_CREATE,OBJECT_DELETE): objname: "7" type: "OBJECT_CREATE" 2021-02-13T19:16:50.461 DEBUG:tasks.rgw_multi.tests_ps:Event (OBJECT_CREATE,OBJECT_DELETE): objname: "5" type: "OBJECT_CREATE" 2021-02-13T19:16:50.461 DEBUG:tasks.rgw_multi.tests_ps:Event (OBJECT_CREATE,OBJECT_DELETE): objname: "1" type: "OBJECT_CREATE" 2021-02-13T19:16:50.461 DEBUG:tasks.rgw_multi.tests_ps:Event (OBJECT_CREATE,OBJECT_DELETE): objname: "2" type: "OBJECT_CREATE" 2021-02-13T19:16:50.461 DEBUG:tasks.rgw_multi.tests_ps:Event (OBJECT_CREATE,OBJECT_DELETE): objname: "9" type: "OBJECT_CREATE" 2021-02-13T19:16:50.461 DEBUG:tasks.rgw_multi.tests_ps:Event (OBJECT_CREATE,OBJECT_DELETE): objname: "8" type: "OBJECT_CREATE" 2021-02-13T19:16:50.461 DEBUG:tasks.rgw_multi.tests_ps:superfluous events are found 2021-02-13T19:16:50.654 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-81', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:16:50.655 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-81', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:16:50.655 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ejuwhf-81 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:16:50.774 INFO:teuthology.orchestra.run.gibba025.stdout:{"markers":[{"key":0,"val":"00000000040.45.5"}]} 2021-02-13T19:16:50.774 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone4 source_zone=test-zone1 bucket=ejuwhf-81 2021-02-13T19:16:50.774 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-81', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:16:50.775 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-81', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:16:50.775 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ejuwhf-81 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:16:50.958 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"8","instance":"","ns":""},"count":9},"inc_marker":{"position":"00000000020.25.5"}}}] 2021-02-13T19:16:50.958 WARNING:rgw_multi.tests:bucket ejuwhf-81 zone test-zone4 behind zone test-zone1: shard=0 master=00000000040.45.5 target=00000000020.25.5 2021-02-13T19:16:55.959 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-81', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:16:55.959 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-81', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:16:55.959 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ejuwhf-81 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:16:56.147 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"8","instance":"","ns":""},"count":9},"inc_marker":{"position":"00000000040.45.5"}}}] 2021-02-13T19:16:56.147 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone4 source_zone=test-zone1 bucket=ejuwhf-81 2021-02-13T19:16:56.148 DEBUG:tasks.rgw_multi.tests_ps:Event (OBJECT_DELETE) synced 2021-02-13T19:16:56.151 DEBUG:tasks.rgw_multi.tests_ps:Event (OBJECT_CREATE): objname: "4" type: "OBJECT_CREATE" 2021-02-13T19:16:56.152 DEBUG:tasks.rgw_multi.tests_ps:Event (OBJECT_CREATE): objname: "6" type: "OBJECT_CREATE" 2021-02-13T19:16:56.152 DEBUG:tasks.rgw_multi.tests_ps:Event (OBJECT_CREATE): objname: "3" type: "OBJECT_CREATE" 2021-02-13T19:16:56.152 DEBUG:tasks.rgw_multi.tests_ps:Event (OBJECT_CREATE): objname: "0" type: "OBJECT_CREATE" 2021-02-13T19:16:56.152 DEBUG:tasks.rgw_multi.tests_ps:Event (OBJECT_CREATE): objname: "8" type: "OBJECT_CREATE" 2021-02-13T19:16:56.152 DEBUG:tasks.rgw_multi.tests_ps:Event (OBJECT_CREATE): objname: "7" type: "OBJECT_CREATE" 2021-02-13T19:16:56.152 DEBUG:tasks.rgw_multi.tests_ps:Event (OBJECT_CREATE): objname: "5" type: "OBJECT_CREATE" 2021-02-13T19:16:56.152 DEBUG:tasks.rgw_multi.tests_ps:Event (OBJECT_CREATE): objname: "1" type: "OBJECT_CREATE" 2021-02-13T19:16:56.152 DEBUG:tasks.rgw_multi.tests_ps:Event (OBJECT_CREATE): objname: "2" type: "OBJECT_CREATE" 2021-02-13T19:16:56.152 DEBUG:tasks.rgw_multi.tests_ps:Event (OBJECT_CREATE): objname: "9" type: "OBJECT_CREATE" 2021-02-13T19:16:56.152 DEBUG:tasks.rgw_multi.tests_ps:Event (OBJECT_CREATE): objname: "8" type: "OBJECT_CREATE" 2021-02-13T19:16:56.152 DEBUG:tasks.rgw_multi.tests_ps:superfluous events are found 2021-02-13T19:16:56.156 DEBUG:tasks.rgw_multi.tests_ps:Event (OBJECT_DELETE): objname: "0" type: "OBJECT_DELETE" 2021-02-13T19:16:56.156 DEBUG:tasks.rgw_multi.tests_ps:Event (OBJECT_DELETE): objname: "1" type: "OBJECT_DELETE" 2021-02-13T19:16:56.156 DEBUG:tasks.rgw_multi.tests_ps:Event (OBJECT_DELETE): objname: "2" type: "OBJECT_DELETE" 2021-02-13T19:16:56.156 DEBUG:tasks.rgw_multi.tests_ps:Event (OBJECT_DELETE): objname: "3" type: "OBJECT_DELETE" 2021-02-13T19:16:56.157 DEBUG:tasks.rgw_multi.tests_ps:Event (OBJECT_DELETE): objname: "4" type: "OBJECT_DELETE" 2021-02-13T19:16:56.157 DEBUG:tasks.rgw_multi.tests_ps:Event (OBJECT_DELETE): objname: "5" type: "OBJECT_DELETE" 2021-02-13T19:16:56.157 DEBUG:tasks.rgw_multi.tests_ps:Event (OBJECT_DELETE): objname: "6" type: "OBJECT_DELETE" 2021-02-13T19:16:56.157 DEBUG:tasks.rgw_multi.tests_ps:Event (OBJECT_DELETE): objname: "7" type: "OBJECT_DELETE" 2021-02-13T19:16:56.157 DEBUG:tasks.rgw_multi.tests_ps:Event (OBJECT_DELETE): objname: "8" type: "OBJECT_DELETE" 2021-02-13T19:16:56.157 DEBUG:tasks.rgw_multi.tests_ps:Event (OBJECT_DELETE): objname: "9" type: "OBJECT_DELETE" 2021-02-13T19:16:56.157 DEBUG:tasks.rgw_multi.tests_ps:superfluous events are found 2021-02-13T19:16:56.161 DEBUG:tasks.rgw_multi.tests_ps:Event (OBJECT_CREATE,OBJECT_DELETE): objname: "4" type: "OBJECT_CREATE" 2021-02-13T19:16:56.161 DEBUG:tasks.rgw_multi.tests_ps:Event (OBJECT_CREATE,OBJECT_DELETE): objname: "6" type: "OBJECT_CREATE" 2021-02-13T19:16:56.161 DEBUG:tasks.rgw_multi.tests_ps:Event (OBJECT_CREATE,OBJECT_DELETE): objname: "3" type: "OBJECT_CREATE" 2021-02-13T19:16:56.161 DEBUG:tasks.rgw_multi.tests_ps:Event (OBJECT_CREATE,OBJECT_DELETE): objname: "0" type: "OBJECT_CREATE" 2021-02-13T19:16:56.161 DEBUG:tasks.rgw_multi.tests_ps:Event (OBJECT_CREATE,OBJECT_DELETE): objname: "8" type: "OBJECT_CREATE" 2021-02-13T19:16:56.161 DEBUG:tasks.rgw_multi.tests_ps:Event (OBJECT_CREATE,OBJECT_DELETE): objname: "7" type: "OBJECT_CREATE" 2021-02-13T19:16:56.161 DEBUG:tasks.rgw_multi.tests_ps:Event (OBJECT_CREATE,OBJECT_DELETE): objname: "5" type: "OBJECT_CREATE" 2021-02-13T19:16:56.161 DEBUG:tasks.rgw_multi.tests_ps:Event (OBJECT_CREATE,OBJECT_DELETE): objname: "1" type: "OBJECT_CREATE" 2021-02-13T19:16:56.161 DEBUG:tasks.rgw_multi.tests_ps:Event (OBJECT_CREATE,OBJECT_DELETE): objname: "2" type: "OBJECT_CREATE" 2021-02-13T19:16:56.161 DEBUG:tasks.rgw_multi.tests_ps:Event (OBJECT_CREATE,OBJECT_DELETE): objname: "9" type: "OBJECT_CREATE" 2021-02-13T19:16:56.161 DEBUG:tasks.rgw_multi.tests_ps:Event (OBJECT_CREATE,OBJECT_DELETE): objname: "8" type: "OBJECT_CREATE" 2021-02-13T19:16:56.161 DEBUG:tasks.rgw_multi.tests_ps:superfluous events are found 2021-02-13T19:16:57.160 INFO:tasks.rgw_multisite_tests:test subscriptions for different events ... ok 2021-02-13T19:16:57.160 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:16:57.161 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:16:57.161 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:16:57.225 INFO:teuthology.orchestra.run.gibba025.stderr:No --period given, using current period=c72c9bb6-7372-4355-b488-0f51f8a5cecb 2021-02-13T19:16:57.241 INFO:teuthology.orchestra.run.gibba025.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613243817.147998_630.1","last_update":"2021-02-13 19:16:57.147998Z"}] 2021-02-13T19:16:57.241 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-02-13T19:16:57.241 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:16:57.241 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:16:57.241 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:16:57.366 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243803.128216_627.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:16:43.128216Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:16:57.367 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=3 master=1_1613243817.147998_630.1 target=1_1613243803.128216_627.1 2021-02-13T19:17:02.368 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:02.369 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:02.369 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:17:02.456 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243817.147998_630.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:16:57.147998Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:17:02.456 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-02-13T19:17:02.457 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-02-13T19:17:02.457 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:02.457 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:02.457 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:17:02.539 INFO:teuthology.orchestra.run.gibba025.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243817.147998_630.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:16:57.147998Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:17:02.540 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-02-13T19:17:02.540 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T19:17:02.540 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:02.540 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:02.540 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:17:02.760 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243817.147998_630.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:16:57.147998Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:17:02.761 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T19:17:02.761 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:02.761 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:02.761 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:17:02.848 INFO:teuthology.orchestra.run.gibba025.stderr:No --period given, using current period=c72c9bb6-7372-4355-b488-0f51f8a5cecb 2021-02-13T19:17:02.864 INFO:teuthology.orchestra.run.gibba025.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613243817.147998_630.1","last_update":"2021-02-13 19:16:57.147998Z"}] 2021-02-13T19:17:02.865 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T19:17:02.865 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:02.865 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:02.865 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:17:03.085 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243817.147998_630.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:16:57.147998Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:17:03.086 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T19:17:03.740 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:03.740 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:03.740 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:17:03.809 INFO:teuthology.orchestra.run.gibba025.stderr:No --period given, using current period=c72c9bb6-7372-4355-b488-0f51f8a5cecb 2021-02-13T19:17:03.826 INFO:teuthology.orchestra.run.gibba025.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613243823.726896_634.1","last_update":"2021-02-13 19:17:03.726896Z"}] 2021-02-13T19:17:03.826 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T19:17:03.826 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:03.826 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:03.827 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:17:04.042 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243823.726896_634.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:17:03.726896Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:17:04.043 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T19:17:08.599 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-82', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:08.599 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-82', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:08.599 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ejuwhf-82 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:17:08.699 INFO:teuthology.orchestra.run.gibba025.stdout:{"markers":[{"key":0,"val":"00000000202.217.5"}]} 2021-02-13T19:17:08.699 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone4 source_zone=test-zone1 bucket=ejuwhf-82 2021-02-13T19:17:08.700 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-82', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:08.700 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-82', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:08.700 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ejuwhf-82 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:17:08.923 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"9","instance":"","ns":""},"count":29},"inc_marker":{"position":"00000000202.217.5"}}}] 2021-02-13T19:17:08.923 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone4 source_zone=test-zone1 bucket=ejuwhf-82 2021-02-13T19:17:08.941 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "20" type: "OBJECT_CREATE" 2021-02-13T19:17:08.941 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "25" type: "OBJECT_CREATE" 2021-02-13T19:17:08.941 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "14" type: "OBJECT_CREATE" 2021-02-13T19:17:08.941 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "12" type: "OBJECT_CREATE" 2021-02-13T19:17:08.941 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "11" type: "OBJECT_CREATE" 2021-02-13T19:17:08.942 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "21" type: "OBJECT_CREATE" 2021-02-13T19:17:08.942 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "17" type: "OBJECT_CREATE" 2021-02-13T19:17:08.942 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "18" type: "OBJECT_CREATE" 2021-02-13T19:17:08.942 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "13" type: "OBJECT_CREATE" 2021-02-13T19:17:08.942 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "10" type: "OBJECT_CREATE" 2021-02-13T19:17:08.942 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "23" type: "OBJECT_CREATE" 2021-02-13T19:17:08.942 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "1" type: "OBJECT_CREATE" 2021-02-13T19:17:08.942 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "0" type: "OBJECT_CREATE" 2021-02-13T19:17:08.942 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "24" type: "OBJECT_CREATE" 2021-02-13T19:17:08.942 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "26" type: "OBJECT_CREATE" 2021-02-13T19:17:08.955 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "22" type: "OBJECT_CREATE" 2021-02-13T19:17:08.955 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "27" type: "OBJECT_CREATE" 2021-02-13T19:17:08.956 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "15" type: "OBJECT_CREATE" 2021-02-13T19:17:08.956 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "16" type: "OBJECT_CREATE" 2021-02-13T19:17:08.956 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "2" type: "OBJECT_CREATE" 2021-02-13T19:17:08.956 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "19" type: "OBJECT_CREATE" 2021-02-13T19:17:08.956 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "6" type: "OBJECT_CREATE" 2021-02-13T19:17:08.956 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "3" type: "OBJECT_CREATE" 2021-02-13T19:17:08.956 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "4" type: "OBJECT_CREATE" 2021-02-13T19:17:08.956 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "28" type: "OBJECT_CREATE" 2021-02-13T19:17:08.956 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "5" type: "OBJECT_CREATE" 2021-02-13T19:17:08.956 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "8" type: "OBJECT_CREATE" 2021-02-13T19:17:08.956 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "9" type: "OBJECT_CREATE" 2021-02-13T19:17:08.956 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "7" type: "OBJECT_CREATE" 2021-02-13T19:17:08.956 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "28" type: "OBJECT_CREATE" 2021-02-13T19:17:08.969 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "27" type: "OBJECT_CREATE" 2021-02-13T19:17:08.969 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "28" type: "OBJECT_CREATE" 2021-02-13T19:17:08.969 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "30" type: "OBJECT_CREATE" 2021-02-13T19:17:08.969 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "29" type: "OBJECT_CREATE" 2021-02-13T19:17:08.969 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "32" type: "OBJECT_CREATE" 2021-02-13T19:17:08.969 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "28" type: "OBJECT_CREATE" 2021-02-13T19:17:08.969 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "31" type: "OBJECT_CREATE" 2021-02-13T19:17:08.969 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "33" type: "OBJECT_CREATE" 2021-02-13T19:17:08.969 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "37" type: "OBJECT_CREATE" 2021-02-13T19:17:08.969 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "40" type: "OBJECT_CREATE" 2021-02-13T19:17:08.970 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "34" type: "OBJECT_CREATE" 2021-02-13T19:17:08.970 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "44" type: "OBJECT_CREATE" 2021-02-13T19:17:08.970 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "38" type: "OBJECT_CREATE" 2021-02-13T19:17:08.970 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "41" type: "OBJECT_CREATE" 2021-02-13T19:17:08.970 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "43" type: "OBJECT_CREATE" 2021-02-13T19:17:08.981 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "35" type: "OBJECT_CREATE" 2021-02-13T19:17:08.981 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "36" type: "OBJECT_CREATE" 2021-02-13T19:17:08.981 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "45" type: "OBJECT_CREATE" 2021-02-13T19:17:08.981 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "48" type: "OBJECT_CREATE" 2021-02-13T19:17:08.982 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "42" type: "OBJECT_CREATE" 2021-02-13T19:17:08.982 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "46" type: "OBJECT_CREATE" 2021-02-13T19:17:08.982 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "47" type: "OBJECT_CREATE" 2021-02-13T19:17:08.982 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "39" type: "OBJECT_CREATE" 2021-02-13T19:17:08.982 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "55" type: "OBJECT_CREATE" 2021-02-13T19:17:08.982 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "56" type: "OBJECT_CREATE" 2021-02-13T19:17:08.982 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "68" type: "OBJECT_CREATE" 2021-02-13T19:17:08.982 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "60" type: "OBJECT_CREATE" 2021-02-13T19:17:08.982 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "53" type: "OBJECT_CREATE" 2021-02-13T19:17:08.982 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "65" type: "OBJECT_CREATE" 2021-02-13T19:17:08.983 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "58" type: "OBJECT_CREATE" 2021-02-13T19:17:08.993 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "59" type: "OBJECT_CREATE" 2021-02-13T19:17:08.993 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "64" type: "OBJECT_CREATE" 2021-02-13T19:17:08.994 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "57" type: "OBJECT_CREATE" 2021-02-13T19:17:08.994 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "63" type: "OBJECT_CREATE" 2021-02-13T19:17:08.994 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "50" type: "OBJECT_CREATE" 2021-02-13T19:17:08.994 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "61" type: "OBJECT_CREATE" 2021-02-13T19:17:08.994 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "69" type: "OBJECT_CREATE" 2021-02-13T19:17:08.994 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "62" type: "OBJECT_CREATE" 2021-02-13T19:17:08.994 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "54" type: "OBJECT_CREATE" 2021-02-13T19:17:08.994 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "49" type: "OBJECT_CREATE" 2021-02-13T19:17:08.994 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "66" type: "OBJECT_CREATE" 2021-02-13T19:17:08.994 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "51" type: "OBJECT_CREATE" 2021-02-13T19:17:08.994 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "67" type: "OBJECT_CREATE" 2021-02-13T19:17:08.994 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "52" type: "OBJECT_CREATE" 2021-02-13T19:17:08.994 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "71" type: "OBJECT_CREATE" 2021-02-13T19:17:09.004 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "70" type: "OBJECT_CREATE" 2021-02-13T19:17:09.005 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "72" type: "OBJECT_CREATE" 2021-02-13T19:17:09.005 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "73" type: "OBJECT_CREATE" 2021-02-13T19:17:09.005 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "74" type: "OBJECT_CREATE" 2021-02-13T19:17:09.005 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "75" type: "OBJECT_CREATE" 2021-02-13T19:17:09.005 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "76" type: "OBJECT_CREATE" 2021-02-13T19:17:09.005 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "77" type: "OBJECT_CREATE" 2021-02-13T19:17:09.005 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "78" type: "OBJECT_CREATE" 2021-02-13T19:17:09.005 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "79" type: "OBJECT_CREATE" 2021-02-13T19:17:09.005 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "80" type: "OBJECT_CREATE" 2021-02-13T19:17:09.005 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "81" type: "OBJECT_CREATE" 2021-02-13T19:17:09.005 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "82" type: "OBJECT_CREATE" 2021-02-13T19:17:09.006 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "83" type: "OBJECT_CREATE" 2021-02-13T19:17:09.006 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "84" type: "OBJECT_CREATE" 2021-02-13T19:17:09.006 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "85" type: "OBJECT_CREATE" 2021-02-13T19:17:09.015 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "86" type: "OBJECT_CREATE" 2021-02-13T19:17:09.016 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "88" type: "OBJECT_CREATE" 2021-02-13T19:17:09.016 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "87" type: "OBJECT_CREATE" 2021-02-13T19:17:09.016 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "89" type: "OBJECT_CREATE" 2021-02-13T19:17:09.016 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "90" type: "OBJECT_CREATE" 2021-02-13T19:17:09.016 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "91" type: "OBJECT_CREATE" 2021-02-13T19:17:09.016 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "92" type: "OBJECT_CREATE" 2021-02-13T19:17:09.016 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "93" type: "OBJECT_CREATE" 2021-02-13T19:17:09.016 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "94" type: "OBJECT_CREATE" 2021-02-13T19:17:09.017 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "95" type: "OBJECT_CREATE" 2021-02-13T19:17:09.017 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "96" type: "OBJECT_CREATE" 2021-02-13T19:17:09.017 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "97" type: "OBJECT_CREATE" 2021-02-13T19:17:09.017 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "98" type: "OBJECT_CREATE" 2021-02-13T19:17:09.017 DEBUG:tasks.rgw_multi.tests_ps:Event: objname: "99" type: "OBJECT_CREATE" 2021-02-13T19:17:09.036 DEBUG:tasks.rgw_multi.tests_ps:superfluous events are found 2021-02-13T19:17:09.647 INFO:tasks.rgw_multisite_tests:test incremental fetching of events from a subscription ... ok 2021-02-13T19:17:09.648 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:09.648 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:09.648 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:17:09.706 INFO:teuthology.orchestra.run.gibba025.stderr:No --period given, using current period=c72c9bb6-7372-4355-b488-0f51f8a5cecb 2021-02-13T19:17:09.720 INFO:teuthology.orchestra.run.gibba025.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613243829.645048_636.1","last_update":"2021-02-13 19:17:09.645048Z"}] 2021-02-13T19:17:09.720 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-02-13T19:17:09.720 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:09.720 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:09.720 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:17:09.841 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243829.645048_636.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:17:09.645048Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:17:09.841 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-02-13T19:17:09.841 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-02-13T19:17:09.841 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:09.842 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:09.842 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:17:09.962 INFO:teuthology.orchestra.run.gibba025.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243829.645048_636.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:17:09.645048Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:17:09.962 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-02-13T19:17:09.962 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T19:17:09.962 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:09.963 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:09.963 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:17:10.171 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243829.645048_636.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:17:09.645048Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:17:10.171 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T19:17:10.171 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:10.172 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:10.172 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:17:10.235 INFO:teuthology.orchestra.run.gibba025.stderr:No --period given, using current period=c72c9bb6-7372-4355-b488-0f51f8a5cecb 2021-02-13T19:17:10.252 INFO:teuthology.orchestra.run.gibba025.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613243829.645048_636.1","last_update":"2021-02-13 19:17:09.645048Z"}] 2021-02-13T19:17:10.252 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T19:17:10.252 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:10.252 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:10.253 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:17:10.426 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243829.645048_636.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:17:09.645048Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:17:10.427 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T19:17:10.501 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:10.501 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:10.501 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:17:10.595 INFO:teuthology.orchestra.run.gibba025.stderr:No --period given, using current period=c72c9bb6-7372-4355-b488-0f51f8a5cecb 2021-02-13T19:17:10.610 INFO:teuthology.orchestra.run.gibba025.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613243830.488995_640.1","last_update":"2021-02-13 19:17:10.488995Z"}] 2021-02-13T19:17:10.610 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T19:17:10.611 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:10.611 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:10.611 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:17:10.825 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243830.488995_640.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:17:10.488995Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:17:10.826 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T19:17:11.295 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-83', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:11.295 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-83', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:11.295 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ejuwhf-83 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:17:11.416 INFO:teuthology.orchestra.run.gibba025.stdout:{"markers":[{"key":0,"val":"00000000020.27.5"}]} 2021-02-13T19:17:11.417 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone4 source_zone=test-zone1 bucket=ejuwhf-83 2021-02-13T19:17:11.417 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-83', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:11.417 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-83', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:11.417 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ejuwhf-83 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:17:11.633 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"4","instance":"","ns":""},"count":5},"inc_marker":{"position":"00000000014.21.5"}}}] 2021-02-13T19:17:11.634 WARNING:rgw_multi.tests:bucket ejuwhf-83 zone test-zone4 behind zone test-zone1: shard=0 master=00000000020.27.5 target=00000000014.21.5 2021-02-13T19:17:16.635 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-83', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:16.635 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-83', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:16.636 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ejuwhf-83 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:17:16.825 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"4","instance":"","ns":""},"count":5},"inc_marker":{"position":"00000000020.27.5"}}}] 2021-02-13T19:17:16.825 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone4 source_zone=test-zone1 bucket=ejuwhf-83 2021-02-13T19:17:16.837 DEBUG:tasks.rgw_multi.tests_ps:Event (before ack) id: "1613243831.088800.6f11c1eb" 2021-02-13T19:17:16.837 DEBUG:tasks.rgw_multi.tests_ps:Event (before ack) id: "1613243831.089345.37e95e4f" 2021-02-13T19:17:16.837 DEBUG:tasks.rgw_multi.tests_ps:Event (before ack) id: "1613243831.090202.26e94b0f" 2021-02-13T19:17:16.837 DEBUG:tasks.rgw_multi.tests_ps:Event (before ack) id: "1613243831.090478.66f38232" 2021-02-13T19:17:16.837 DEBUG:tasks.rgw_multi.tests_ps:Event (before ack) id: "1613243831.091948.77c90773" 2021-02-13T19:17:16.837 DEBUG:tasks.rgw_multi.tests_ps:Event (before ack) id: "1613243831.165533.e651ba20" 2021-02-13T19:17:16.837 DEBUG:tasks.rgw_multi.tests_ps:Event (before ack) id: "1613243831.166076.77c90773" 2021-02-13T19:17:16.837 DEBUG:tasks.rgw_multi.tests_ps:Event (before ack) id: "1613243831.166165.9b8f6c64" 2021-02-13T19:17:16.837 DEBUG:tasks.rgw_multi.tests_ps:Event (before ack) id: "1613243832.291220.feba77db" 2021-02-13T19:17:16.837 DEBUG:tasks.rgw_multi.tests_ps:Event (before ack) id: "1613243832.291510.974f388b" 2021-02-13T19:17:16.837 DEBUG:tasks.rgw_multi.tests_ps:Event (before ack) id: "1613243832.293349.66782dc8" 2021-02-13T19:17:17.263 DEBUG:tasks.rgw_multi.tests_ps:superfluous events are found 2021-02-13T19:17:17.360 DEBUG:tasks.rgw_multi.tests_ps:Event (after ack) id: "1613243831.165533.e651ba20" 2021-02-13T19:17:17.361 DEBUG:tasks.rgw_multi.tests_ps:Event (after ack) id: "1613243831.166076.77c90773" 2021-02-13T19:17:17.361 DEBUG:tasks.rgw_multi.tests_ps:Event (after ack) id: "1613243831.166165.9b8f6c64" 2021-02-13T19:17:17.361 DEBUG:tasks.rgw_multi.tests_ps:Event (after ack) id: "1613243832.291220.feba77db" 2021-02-13T19:17:17.361 DEBUG:tasks.rgw_multi.tests_ps:Event (after ack) id: "1613243832.291510.974f388b" 2021-02-13T19:17:17.361 DEBUG:tasks.rgw_multi.tests_ps:Event (after ack) id: "1613243832.293349.66782dc8" 2021-02-13T19:17:17.520 INFO:tasks.rgw_multisite_tests:test acking of some events in a subscription ... ok 2021-02-13T19:17:17.520 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:17.521 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:17.521 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:17:17.620 INFO:teuthology.orchestra.run.gibba025.stderr:No --period given, using current period=c72c9bb6-7372-4355-b488-0f51f8a5cecb 2021-02-13T19:17:17.640 INFO:teuthology.orchestra.run.gibba025.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613243837.514878_648.1","last_update":"2021-02-13 19:17:17.514878Z"}] 2021-02-13T19:17:17.640 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-02-13T19:17:17.640 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:17.640 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:17.640 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:17:17.724 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243837.507650_647.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:17:17.507650Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:17:17.724 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=3 master=1_1613243837.514878_648.1 target=1_1613243837.507650_647.1 2021-02-13T19:17:22.725 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:22.725 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:22.726 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:17:22.810 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243837.514878_648.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:17:17.514878Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:17:22.811 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-02-13T19:17:22.811 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-02-13T19:17:22.811 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:22.811 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:22.811 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:17:22.900 INFO:teuthology.orchestra.run.gibba025.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243837.514878_648.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:17:17.514878Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:17:22.900 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-02-13T19:17:22.900 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T19:17:22.900 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:22.900 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:22.901 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:17:23.085 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243837.514878_648.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:17:17.514878Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:17:23.085 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T19:17:23.085 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:23.086 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:23.086 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:17:23.159 INFO:teuthology.orchestra.run.gibba025.stderr:No --period given, using current period=c72c9bb6-7372-4355-b488-0f51f8a5cecb 2021-02-13T19:17:23.176 INFO:teuthology.orchestra.run.gibba025.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613243837.514878_648.1","last_update":"2021-02-13 19:17:17.514878Z"}] 2021-02-13T19:17:23.177 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T19:17:23.177 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:23.177 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:23.177 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:17:23.392 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243837.514878_648.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:17:17.514878Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:17:23.393 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T19:17:24.231 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:24.231 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:24.231 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:17:24.332 INFO:teuthology.orchestra.run.gibba025.stderr:No --period given, using current period=c72c9bb6-7372-4355-b488-0f51f8a5cecb 2021-02-13T19:17:24.347 INFO:teuthology.orchestra.run.gibba025.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613243844.218010_658.1","last_update":"2021-02-13 19:17:24.218010Z"}] 2021-02-13T19:17:24.347 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T19:17:24.347 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:24.347 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:24.348 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:17:24.558 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243844.218010_658.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:17:24.218010Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:17:24.558 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T19:17:24.939 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-84', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:24.939 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-84', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:24.939 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ejuwhf-84 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:17:25.065 INFO:teuthology.orchestra.run.gibba025.stdout:{"markers":[{"key":0,"val":"00000000013.38.5"}]} 2021-02-13T19:17:25.065 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone4 source_zone=test-zone1 bucket=ejuwhf-84 2021-02-13T19:17:25.065 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-84', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:25.065 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-84', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:25.066 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ejuwhf-84 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:17:25.251 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:17:25.251 WARNING:rgw_multi.tests:bucket ejuwhf-84 zone test-zone4 behind zone test-zone1: shard=0 master=00000000013.38.5 target= 2021-02-13T19:17:30.252 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-84', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:30.253 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-84', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:30.253 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ejuwhf-84 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:17:30.440 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"put","instance":"","ns":""},"count":3},"inc_marker":{"position":"0#00000000013.38.5"}}}] 2021-02-13T19:17:30.441 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone4 source_zone=test-zone1 bucket=ejuwhf-84 2021-02-13T19:17:30.450 DEBUG:tasks.rgw_multi.tests_ps:Event key: "multipart" type: "OBJECT_CREATE" 2021-02-13T19:17:30.450 DEBUG:tasks.rgw_multi.tests_ps:Event key: "copy" type: "OBJECT_CREATE" 2021-02-13T19:17:30.450 DEBUG:tasks.rgw_multi.tests_ps:Event key: "put" type: "OBJECT_CREATE" 2021-02-13T19:17:31.421 INFO:tasks.rgw_multisite_tests:test object creation notifications in using put/copy/post ... ok 2021-02-13T19:17:31.421 INFO:tasks.rgw_multisite_tests:test object creation s3 notifications in using put/copy/post on master ... ok 2021-02-13T19:17:31.422 INFO:tasks.rgw_multisite_tests:test multipart object upload on master ... ok 2021-02-13T19:17:31.422 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:31.422 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:31.422 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:17:31.524 INFO:teuthology.orchestra.run.gibba025.stderr:No --period given, using current period=c72c9bb6-7372-4355-b488-0f51f8a5cecb 2021-02-13T19:17:31.540 INFO:teuthology.orchestra.run.gibba025.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613243851.407877_660.1","last_update":"2021-02-13 19:17:31.407877Z"}] 2021-02-13T19:17:31.541 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-02-13T19:17:31.541 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:31.541 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:31.541 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:17:31.662 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243851.407877_660.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:17:31.407877Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:17:31.663 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-02-13T19:17:31.663 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-02-13T19:17:31.663 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:31.663 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:31.663 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:17:31.784 INFO:teuthology.orchestra.run.gibba025.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243851.407877_660.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:17:31.407877Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:17:31.784 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-02-13T19:17:31.784 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T19:17:31.784 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:31.784 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:31.785 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:17:31.966 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243851.407877_660.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:17:31.407877Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:17:31.967 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T19:17:31.967 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:31.967 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:31.967 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:17:32.078 INFO:teuthology.orchestra.run.gibba025.stderr:No --period given, using current period=c72c9bb6-7372-4355-b488-0f51f8a5cecb 2021-02-13T19:17:32.097 INFO:teuthology.orchestra.run.gibba025.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613243851.407877_660.1","last_update":"2021-02-13 19:17:31.407877Z"}] 2021-02-13T19:17:32.098 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T19:17:32.098 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:32.098 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:32.098 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:17:32.285 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243851.407877_660.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:17:31.407877Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:17:32.285 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T19:17:32.408 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:32.408 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:32.409 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:17:32.501 INFO:teuthology.orchestra.run.gibba025.stderr:No --period given, using current period=c72c9bb6-7372-4355-b488-0f51f8a5cecb 2021-02-13T19:17:32.517 INFO:teuthology.orchestra.run.gibba025.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613243852.401879_666.1","last_update":"2021-02-13 19:17:32.401879Z"}] 2021-02-13T19:17:32.517 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T19:17:32.517 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:32.517 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:32.518 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:17:32.732 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243852.401879_666.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:17:32.401879Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:17:32.732 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T19:17:32.958 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-85', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:32.958 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-85', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:32.958 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ejuwhf-85 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:17:33.075 INFO:teuthology.orchestra.run.gibba025.stdout:{"markers":[{"key":0,"val":"00000000007.28.11"}]} 2021-02-13T19:17:33.076 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone4 source_zone=test-zone1 bucket=ejuwhf-85 2021-02-13T19:17:33.076 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:33.076 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:33.076 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ejuwhf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:17:33.297 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:17:33.297 WARNING:rgw_multi.tests:bucket ejuwhf-85 zone test-zone4 behind zone test-zone1: shard=0 master=00000000007.28.11 target= 2021-02-13T19:17:38.298 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:38.298 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:38.298 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ejuwhf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:17:38.522 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"foo","instance":"oFQ3MuAOVcFgf57Ekvd0mEuvhefPQcH","ns":""},"count":2},"inc_marker":{"position":"0#00000000007.28.11"}}}] 2021-02-13T19:17:38.522 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone4 source_zone=test-zone1 bucket=ejuwhf-85 2021-02-13T19:17:38.727 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-85', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:38.727 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-85', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:38.727 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ejuwhf-85 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:17:38.844 INFO:teuthology.orchestra.run.gibba025.stdout:{"markers":[{"key":0,"val":"00000000014.44.5"}]} 2021-02-13T19:17:38.844 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone4 source_zone=test-zone1 bucket=ejuwhf-85 2021-02-13T19:17:38.845 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:38.845 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:38.845 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ejuwhf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:17:39.030 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"foo","instance":"oFQ3MuAOVcFgf57Ekvd0mEuvhefPQcH","ns":""},"count":2},"inc_marker":{"position":"0#00000000007.28.11"}}}] 2021-02-13T19:17:39.030 WARNING:rgw_multi.tests:bucket ejuwhf-85 zone test-zone4 behind zone test-zone1: shard=0 master=00000000014.44.5 target=00000000007.28.11 2021-02-13T19:17:44.032 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:44.032 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:44.032 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ejuwhf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:17:44.217 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"foo","instance":"oFQ3MuAOVcFgf57Ekvd0mEuvhefPQcH","ns":""},"count":2},"inc_marker":{"position":"00000000014.44.5"}}}] 2021-02-13T19:17:44.217 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone4 source_zone=test-zone1 bucket=ejuwhf-85 2021-02-13T19:17:44.227 DEBUG:tasks.rgw_multi.tests_ps:Event key: "foo" type: "OBJECT_DELETE" 2021-02-13T19:17:44.227 DEBUG:tasks.rgw_multi.tests_ps:Event key: "foo" type: "OBJECT_DELETE" 2021-02-13T19:17:44.227 DEBUG:tasks.rgw_multi.tests_ps:Event key: "foo" type: "OBJECT_DELETE" 2021-02-13T19:17:44.235 DEBUG:tasks.rgw_multi.tests_ps:Event key: "foo" type: "DELETE_MARKER_CREATE" 2021-02-13T19:17:44.235 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-85', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:44.235 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-85', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:44.236 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ejuwhf-85 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:17:44.326 INFO:teuthology.orchestra.run.gibba025.stdout:{"markers":[{"key":0,"val":"00000000014.44.5"}]} 2021-02-13T19:17:44.326 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=ejuwhf-85 2021-02-13T19:17:44.327 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:44.327 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:44.327 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ejuwhf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:17:44.454 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"foo","instance":"oFQ3MuAOVcFgf57Ekvd0mEuvhefPQcH","ns":""},"count":2},"inc_marker":{"position":"00000000014.44.5"}}}] 2021-02-13T19:17:44.454 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=ejuwhf-85 2021-02-13T19:17:44.455 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-85', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:44.455 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-85', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:44.455 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ejuwhf-85 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:17:44.581 INFO:teuthology.orchestra.run.gibba025.stdout:{"markers":[{"key":0,"val":"00000000014.44.5"}]} 2021-02-13T19:17:44.581 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=ejuwhf-85 2021-02-13T19:17:44.581 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-85', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:44.582 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-85', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:44.582 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ejuwhf-85 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:17:44.670 INFO:teuthology.orchestra.run.gibba025.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"foo","instance":"oFQ3MuAOVcFgf57Ekvd0mEuvhefPQcH","ns":""},"count":2},"inc_marker":{"position":"00000000014.44.5"}}}] 2021-02-13T19:17:44.670 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=ejuwhf-85 2021-02-13T19:17:44.670 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-85', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:44.670 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-85', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:44.671 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ejuwhf-85 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:17:44.766 INFO:teuthology.orchestra.run.gibba025.stdout:{"markers":[{"key":0,"val":"00000000014.44.5"}]} 2021-02-13T19:17:44.767 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone4 source_zone=test-zone1 bucket=ejuwhf-85 2021-02-13T19:17:44.767 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:44.767 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:44.767 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ejuwhf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:17:44.955 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"foo","instance":"oFQ3MuAOVcFgf57Ekvd0mEuvhefPQcH","ns":""},"count":2},"inc_marker":{"position":"00000000014.44.5"}}}] 2021-02-13T19:17:44.955 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone4 source_zone=test-zone1 bucket=ejuwhf-85 2021-02-13T19:17:44.955 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:44.956 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:44.956 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ejuwhf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:17:45.037 INFO:teuthology.orchestra.run.gibba036.stdout:{"markers":[{"key":0,"val":"00000000012.39.5"}]} 2021-02-13T19:17:45.037 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=ejuwhf-85 2021-02-13T19:17:45.037 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:45.037 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:45.038 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-85 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:17:45.177 INFO:teuthology.orchestra.run.gibba025.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"foo","instance":"oFQ3MuAOVcFgf57Ekvd0mEuvhefPQcH","ns":""},"count":2},"inc_marker":{"position":"00000000012.39.5"}}}] 2021-02-13T19:17:45.177 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=ejuwhf-85 2021-02-13T19:17:45.177 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:45.177 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:45.178 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ejuwhf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:17:45.301 INFO:teuthology.orchestra.run.gibba036.stdout:{"markers":[{"key":0,"val":"00000000012.39.5"}]} 2021-02-13T19:17:45.301 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone2 bucket=ejuwhf-85 2021-02-13T19:17:45.301 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:45.301 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:45.301 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-85 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:17:45.431 INFO:teuthology.orchestra.run.gibba025.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"foo","instance":"oFQ3MuAOVcFgf57Ekvd0mEuvhefPQcH","ns":""},"count":2},"inc_marker":{"position":"00000000012.39.5"}}}] 2021-02-13T19:17:45.431 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone2 bucket=ejuwhf-85 2021-02-13T19:17:45.432 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:45.432 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:45.432 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ejuwhf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:17:45.554 INFO:teuthology.orchestra.run.gibba036.stdout:{"markers":[{"key":0,"val":"00000000012.39.5"}]} 2021-02-13T19:17:45.554 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone4 source_zone=test-zone2 bucket=ejuwhf-85 2021-02-13T19:17:45.554 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:45.554 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:45.554 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:17:45.739 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:17:45.739 WARNING:rgw_multi.tests:bucket ejuwhf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.39.5 target= 2021-02-13T19:17:50.740 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:50.741 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:50.741 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:17:50.921 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:17:50.921 WARNING:rgw_multi.tests:bucket ejuwhf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.39.5 target= 2021-02-13T19:17:55.923 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:55.923 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:17:55.923 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:17:56.101 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:17:56.102 WARNING:rgw_multi.tests:bucket ejuwhf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.39.5 target= 2021-02-13T19:18:01.103 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:18:01.103 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:18:01.103 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:18:01.294 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:18:01.294 WARNING:rgw_multi.tests:bucket ejuwhf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.39.5 target= 2021-02-13T19:18:06.296 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:18:06.296 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:18:06.296 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:18:06.485 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:18:06.485 WARNING:rgw_multi.tests:bucket ejuwhf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.39.5 target= 2021-02-13T19:18:11.486 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:18:11.487 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:18:11.487 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:18:11.670 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:18:11.670 WARNING:rgw_multi.tests:bucket ejuwhf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.39.5 target= 2021-02-13T19:18:16.672 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:18:16.672 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:18:16.672 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:18:16.861 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:18:16.861 WARNING:rgw_multi.tests:bucket ejuwhf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.39.5 target= 2021-02-13T19:18:21.862 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:18:21.862 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:18:21.863 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:18:22.051 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:18:22.051 WARNING:rgw_multi.tests:bucket ejuwhf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.39.5 target= 2021-02-13T19:18:27.053 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:18:27.053 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:18:27.053 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:18:27.233 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:18:27.233 WARNING:rgw_multi.tests:bucket ejuwhf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.39.5 target= 2021-02-13T19:18:32.234 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:18:32.235 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:18:32.235 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:18:32.424 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:18:32.424 WARNING:rgw_multi.tests:bucket ejuwhf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.39.5 target= 2021-02-13T19:18:37.425 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:18:37.425 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:18:37.425 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:18:37.615 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:18:37.615 WARNING:rgw_multi.tests:bucket ejuwhf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.39.5 target= 2021-02-13T19:18:42.615 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:18:42.616 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:18:42.616 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:18:42.797 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:18:42.797 WARNING:rgw_multi.tests:bucket ejuwhf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.39.5 target= 2021-02-13T19:18:47.798 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:18:47.798 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:18:47.799 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:18:47.984 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:18:47.984 WARNING:rgw_multi.tests:bucket ejuwhf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.39.5 target= 2021-02-13T19:18:52.985 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:18:52.986 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:18:52.986 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:18:53.171 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:18:53.171 WARNING:rgw_multi.tests:bucket ejuwhf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.39.5 target= 2021-02-13T19:18:58.172 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:18:58.172 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:18:58.172 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:18:58.394 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:18:58.395 WARNING:rgw_multi.tests:bucket ejuwhf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.39.5 target= 2021-02-13T19:19:03.396 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:19:03.396 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:19:03.396 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:19:03.577 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:19:03.578 WARNING:rgw_multi.tests:bucket ejuwhf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.39.5 target= 2021-02-13T19:19:08.579 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:19:08.579 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:19:08.579 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:19:08.805 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:19:08.806 WARNING:rgw_multi.tests:bucket ejuwhf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.39.5 target= 2021-02-13T19:19:13.806 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:19:13.806 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:19:13.807 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:19:13.985 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:19:13.985 WARNING:rgw_multi.tests:bucket ejuwhf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.39.5 target= 2021-02-13T19:19:18.986 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:19:18.986 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:19:18.987 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:19:19.177 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:19:19.178 WARNING:rgw_multi.tests:bucket ejuwhf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.39.5 target= 2021-02-13T19:19:24.178 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:19:24.179 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:19:24.179 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:19:24.359 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:19:24.360 WARNING:rgw_multi.tests:bucket ejuwhf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.39.5 target= 2021-02-13T19:19:29.361 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:19:29.361 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:19:29.361 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:19:29.549 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:19:29.549 WARNING:rgw_multi.tests:bucket ejuwhf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.39.5 target= 2021-02-13T19:19:34.550 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:19:34.550 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:19:34.550 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:19:34.737 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:19:34.737 WARNING:rgw_multi.tests:bucket ejuwhf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.39.5 target= 2021-02-13T19:19:39.739 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:19:39.739 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:19:39.739 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:19:39.926 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:19:39.926 WARNING:rgw_multi.tests:bucket ejuwhf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.39.5 target= 2021-02-13T19:19:44.927 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:19:44.927 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:19:44.927 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:19:45.117 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:19:45.117 WARNING:rgw_multi.tests:bucket ejuwhf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.39.5 target= 2021-02-13T19:19:50.119 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:19:50.119 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:19:50.119 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:19:50.302 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:19:50.303 WARNING:rgw_multi.tests:bucket ejuwhf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.39.5 target= 2021-02-13T19:19:55.303 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:19:55.304 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:19:55.304 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:19:55.491 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:19:55.491 WARNING:rgw_multi.tests:bucket ejuwhf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.39.5 target= 2021-02-13T19:20:00.493 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:20:00.493 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:20:00.493 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:20:00.678 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:20:00.678 WARNING:rgw_multi.tests:bucket ejuwhf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.39.5 target= 2021-02-13T19:20:05.679 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:20:05.680 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:20:05.680 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:20:05.867 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:20:05.867 WARNING:rgw_multi.tests:bucket ejuwhf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.39.5 target= 2021-02-13T19:20:10.868 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:20:10.868 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:20:10.869 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:20:11.052 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:20:11.052 WARNING:rgw_multi.tests:bucket ejuwhf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.39.5 target= 2021-02-13T19:20:16.053 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:20:16.054 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:20:16.054 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:20:16.234 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:20:16.235 WARNING:rgw_multi.tests:bucket ejuwhf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.39.5 target= 2021-02-13T19:20:21.235 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:20:21.236 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:20:21.236 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:20:21.418 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:20:21.418 WARNING:rgw_multi.tests:bucket ejuwhf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.39.5 target= 2021-02-13T19:20:26.419 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:20:26.420 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:20:26.420 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:20:26.598 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:20:26.599 WARNING:rgw_multi.tests:bucket ejuwhf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.39.5 target= 2021-02-13T19:20:31.599 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:20:31.600 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:20:31.600 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:20:31.781 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:20:31.782 WARNING:rgw_multi.tests:bucket ejuwhf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.39.5 target= 2021-02-13T19:20:36.783 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:20:36.783 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:20:36.784 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:20:36.962 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:20:36.962 WARNING:rgw_multi.tests:bucket ejuwhf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.39.5 target= 2021-02-13T19:20:41.964 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:20:41.964 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:20:41.964 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:20:42.155 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:20:42.155 WARNING:rgw_multi.tests:bucket ejuwhf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.39.5 target= 2021-02-13T19:20:47.156 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:20:47.157 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:20:47.157 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:20:47.343 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:20:47.344 WARNING:rgw_multi.tests:bucket ejuwhf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.39.5 target= 2021-02-13T19:20:52.345 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:20:52.345 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:20:52.345 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:20:52.530 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:20:52.530 WARNING:rgw_multi.tests:bucket ejuwhf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.39.5 target= 2021-02-13T19:20:57.531 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:20:57.531 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:20:57.532 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:20:57.720 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:20:57.721 WARNING:rgw_multi.tests:bucket ejuwhf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.39.5 target= 2021-02-13T19:21:02.721 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:21:02.721 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:21:02.722 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:21:02.911 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:21:02.911 WARNING:rgw_multi.tests:bucket ejuwhf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.39.5 target= 2021-02-13T19:21:07.913 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:21:07.913 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:21:07.913 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:21:08.101 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:21:08.101 WARNING:rgw_multi.tests:bucket ejuwhf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.39.5 target= 2021-02-13T19:21:13.102 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:21:13.102 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:21:13.102 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:21:13.285 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:21:13.286 WARNING:rgw_multi.tests:bucket ejuwhf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.39.5 target= 2021-02-13T19:21:18.287 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:21:18.287 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:21:18.287 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:21:18.509 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:21:18.510 WARNING:rgw_multi.tests:bucket ejuwhf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.39.5 target= 2021-02-13T19:21:23.511 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:21:23.511 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:21:23.511 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:21:23.703 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:21:23.703 WARNING:rgw_multi.tests:bucket ejuwhf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.39.5 target= 2021-02-13T19:21:28.704 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:21:28.704 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:21:28.705 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:21:28.885 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:21:28.886 WARNING:rgw_multi.tests:bucket ejuwhf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.39.5 target= 2021-02-13T19:21:33.886 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:21:33.887 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:21:33.887 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:21:34.076 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:21:34.077 WARNING:rgw_multi.tests:bucket ejuwhf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.39.5 target= 2021-02-13T19:21:39.078 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:21:39.078 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:21:39.078 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:21:39.259 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:21:39.260 WARNING:rgw_multi.tests:bucket ejuwhf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.39.5 target= 2021-02-13T19:21:44.261 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:21:44.261 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:21:44.261 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:21:44.451 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:21:44.452 WARNING:rgw_multi.tests:bucket ejuwhf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.39.5 target= 2021-02-13T19:21:49.453 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:21:49.453 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:21:49.453 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:21:49.642 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:21:49.642 WARNING:rgw_multi.tests:bucket ejuwhf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.39.5 target= 2021-02-13T19:21:54.643 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:21:54.643 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:21:54.644 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:21:54.832 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:21:54.832 WARNING:rgw_multi.tests:bucket ejuwhf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.39.5 target= 2021-02-13T19:21:59.834 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:21:59.834 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:21:59.834 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:22:00.015 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:22:00.015 WARNING:rgw_multi.tests:bucket ejuwhf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.39.5 target= 2021-02-13T19:22:05.016 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:22:05.016 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:22:05.016 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:22:05.199 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:22:05.199 WARNING:rgw_multi.tests:bucket ejuwhf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.39.5 target= 2021-02-13T19:22:10.200 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:22:10.200 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:22:10.200 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:22:10.383 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:22:10.383 WARNING:rgw_multi.tests:bucket ejuwhf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.39.5 target= 2021-02-13T19:22:15.384 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:22:15.385 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:22:15.385 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:22:15.570 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:22:15.570 WARNING:rgw_multi.tests:bucket ejuwhf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.39.5 target= 2021-02-13T19:22:20.571 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:22:20.572 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:22:20.572 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:22:20.762 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:22:20.763 WARNING:rgw_multi.tests:bucket ejuwhf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.39.5 target= 2021-02-13T19:22:25.767 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:22:25.767 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:22:25.768 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:22:25.950 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:22:25.950 WARNING:rgw_multi.tests:bucket ejuwhf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.39.5 target= 2021-02-13T19:22:30.951 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:22:30.951 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:22:30.951 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:22:31.141 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:22:31.141 WARNING:rgw_multi.tests:bucket ejuwhf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.39.5 target= 2021-02-13T19:22:36.142 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:22:36.143 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:22:36.143 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:22:36.325 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:22:36.325 WARNING:rgw_multi.tests:bucket ejuwhf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.39.5 target= 2021-02-13T19:22:41.326 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:22:41.326 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:22:41.327 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:22:41.514 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:22:41.515 WARNING:rgw_multi.tests:bucket ejuwhf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.39.5 target= 2021-02-13T19:22:46.515 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:22:46.516 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:22:46.516 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:22:46.699 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:22:46.699 WARNING:rgw_multi.tests:bucket ejuwhf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.39.5 target= 2021-02-13T19:22:51.700 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:22:51.700 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ejuwhf-85', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:22:51.701 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ejuwhf-85 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:22:51.887 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:22:51.888 WARNING:rgw_multi.tests:bucket ejuwhf-85 zone test-zone4 behind zone test-zone2: shard=0 master=00000000012.39.5 target= 2021-02-13T19:22:56.888 DEBUG:tasks.rgw_multi.tests_ps:zonegroup_bucket_checkpoint failed, cannot delete bucket 2021-02-13T19:22:56.989 INFO:tasks.rgw_multisite_tests:test notification of deletion markers ... ok 2021-02-13T19:22:56.990 INFO:tasks.rgw_multisite_tests:test s3 notification of metadata on master ... ok 2021-02-13T19:22:56.990 INFO:tasks.rgw_multisite_tests:test s3 notification of tags on master ... ok 2021-02-13T19:22:56.990 INFO:tasks.rgw_multisite_tests:test s3 notification of object versions ... ok 2021-02-13T19:22:56.990 INFO:tasks.rgw_multisite_tests:test s3 notification of deletion markers on master ... ok 2021-02-13T19:22:56.990 INFO:tasks.rgw_multisite_tests:test pushing to http endpoint ... ok 2021-02-13T19:22:56.991 INFO:tasks.rgw_multisite_tests:test pushing to http endpoint s3 record format ... ok 2021-02-13T19:22:56.991 INFO:tasks.rgw_multisite_tests:test pushing to amqp endpoint ... ok 2021-02-13T19:22:56.991 INFO:tasks.rgw_multisite_tests:test pushing to amqp endpoint s3 record format ... ok 2021-02-13T19:22:56.991 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:22:56.992 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:22:56.992 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:22:57.065 INFO:teuthology.orchestra.run.gibba025.stderr:No --period given, using current period=c72c9bb6-7372-4355-b488-0f51f8a5cecb 2021-02-13T19:22:57.080 INFO:teuthology.orchestra.run.gibba025.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613243852.401879_666.1","last_update":"2021-02-13 19:17:32.401879Z"}] 2021-02-13T19:22:57.081 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-02-13T19:22:57.081 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:22:57.081 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:22:57.081 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:22:57.199 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243852.401879_666.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:17:32.401879Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:22:57.200 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-02-13T19:22:57.200 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-02-13T19:22:57.200 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:22:57.200 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:22:57.200 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:22:57.290 INFO:teuthology.orchestra.run.gibba025.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243852.401879_666.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:17:32.401879Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:22:57.291 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-02-13T19:22:57.291 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T19:22:57.291 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:22:57.291 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:22:57.291 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:22:57.513 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243852.401879_666.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:17:32.401879Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:22:57.513 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T19:22:57.513 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:22:57.513 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:22:57.514 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:22:57.620 INFO:teuthology.orchestra.run.gibba025.stderr:No --period given, using current period=c72c9bb6-7372-4355-b488-0f51f8a5cecb 2021-02-13T19:22:57.636 INFO:teuthology.orchestra.run.gibba025.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613243852.401879_666.1","last_update":"2021-02-13 19:17:32.401879Z"}] 2021-02-13T19:22:57.637 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T19:22:57.637 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:22:57.637 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:22:57.637 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:22:57.824 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613243852.401879_666.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:17:32.401879Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:22:57.825 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T19:22:57.918 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:22:57.918 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:22:57.918 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:22:58.027 INFO:teuthology.orchestra.run.gibba025.stderr:No --period given, using current period=c72c9bb6-7372-4355-b488-0f51f8a5cecb 2021-02-13T19:22:58.043 INFO:teuthology.orchestra.run.gibba025.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613244177.897618_676.1","last_update":"2021-02-13 19:22:57.897618Z"}] 2021-02-13T19:22:58.044 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T19:22:58.044 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:22:58.044 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:22:58.044 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:22:58.258 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613244177.897618_676.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:22:57.897618Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:22:58.258 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T19:22:58.799 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-86', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:22:58.799 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-86', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:22:58.799 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ejuwhf-86 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:22:58.920 INFO:teuthology.orchestra.run.gibba025.stdout:{"markers":[{"key":0,"val":"00000000020.35.5"}]} 2021-02-13T19:22:58.920 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone4 source_zone=test-zone1 bucket=ejuwhf-86 2021-02-13T19:22:58.920 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-86', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:22:58.920 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-86', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:22:58.921 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ejuwhf-86 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:22:59.107 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-02-13T19:22:59.108 WARNING:rgw_multi.tests:bucket ejuwhf-86 zone test-zone4 behind zone test-zone1: shard=0 master=00000000020.35.5 target= 2021-02-13T19:23:04.109 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-86', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:23:04.109 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-86', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:23:04.109 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ejuwhf-86 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:23:04.298 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"9","instance":"","ns":""},"count":10},"inc_marker":{"position":"0#00000000020.35.5"}}}] 2021-02-13T19:23:04.298 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone4 source_zone=test-zone1 bucket=ejuwhf-86 2021-02-13T19:23:05.283 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-86', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:23:05.284 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ejuwhf-86', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:23:05.284 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ejuwhf-86 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:23:05.395 INFO:teuthology.orchestra.run.gibba025.stdout:{"markers":[{"key":0,"val":"00000000040.55.5"}]} 2021-02-13T19:23:05.396 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone4 source_zone=test-zone1 bucket=ejuwhf-86 2021-02-13T19:23:05.396 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-86', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:23:05.396 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-86', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:23:05.396 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ejuwhf-86 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:23:05.583 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"9","instance":"","ns":""},"count":10},"inc_marker":{"position":"0#00000000020.35.5"}}}] 2021-02-13T19:23:05.583 WARNING:rgw_multi.tests:bucket ejuwhf-86 zone test-zone4 behind zone test-zone1: shard=0 master=00000000040.55.5 target=00000000020.35.5 2021-02-13T19:23:10.584 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-86', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:23:10.584 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ejuwhf-86', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:23:10.585 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ejuwhf-86 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:23:10.774 INFO:teuthology.orchestra.run.gibba036.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"9","instance":"","ns":""},"count":10},"inc_marker":{"position":"00000000040.55.5"}}}] 2021-02-13T19:23:10.775 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone4 source_zone=test-zone1 bucket=ejuwhf-86 2021-02-13T19:23:11.026 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:23:11.026 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:23:11.026 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:23:11.125 INFO:teuthology.orchestra.run.gibba025.stderr:No --period given, using current period=c72c9bb6-7372-4355-b488-0f51f8a5cecb 2021-02-13T19:23:11.141 INFO:teuthology.orchestra.run.gibba025.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613244191.013875_678.1","last_update":"2021-02-13 19:23:11.013875Z"}] 2021-02-13T19:23:11.141 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T19:23:11.141 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:23:11.141 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:23:11.141 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:23:11.320 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613244177.897618_676.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:22:57.897618Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:23:11.320 WARNING:rgw_multi.tests:zone test-zone4 behind master: shard=3 master=1_1613244191.013875_678.1 target=1_1613244177.897618_676.1 2021-02-13T19:23:16.321 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:23:16.321 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:23:16.321 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:23:16.509 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613244191.013875_678.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:23:11.013875Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:23:16.509 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T19:23:16.520 WARNING:tasks.rgw_multi.tests_ps:superfluous records are found 2021-02-13T19:23:16.563 INFO:tasks.rgw_multisite_tests:test notification status upon bucket deletion ... ok 2021-02-13T19:23:16.564 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:23:16.564 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:23:16.564 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:23:16.634 INFO:teuthology.orchestra.run.gibba025.stderr:No --period given, using current period=c72c9bb6-7372-4355-b488-0f51f8a5cecb 2021-02-13T19:23:16.650 INFO:teuthology.orchestra.run.gibba025.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613244191.013875_678.1","last_update":"2021-02-13 19:23:11.013875Z"}] 2021-02-13T19:23:16.650 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-02-13T19:23:16.650 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:23:16.651 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:23:16.651 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:23:16.770 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613244191.013875_678.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:23:11.013875Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:23:16.771 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-02-13T19:23:16.771 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-02-13T19:23:16.771 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:23:16.771 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:23:16.771 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:23:16.859 INFO:teuthology.orchestra.run.gibba025.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613244191.013875_678.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:23:11.013875Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:23:16.860 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-02-13T19:23:16.860 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T19:23:16.860 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:23:16.860 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:23:16.860 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:23:17.083 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613244191.013875_678.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:23:11.013875Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:23:17.083 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T19:23:17.084 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:23:17.084 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:23:17.084 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:23:17.193 INFO:teuthology.orchestra.run.gibba025.stderr:No --period given, using current period=c72c9bb6-7372-4355-b488-0f51f8a5cecb 2021-02-13T19:23:17.206 INFO:teuthology.orchestra.run.gibba025.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613244191.013875_678.1","last_update":"2021-02-13 19:23:11.013875Z"}] 2021-02-13T19:23:17.206 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T19:23:17.206 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:23:17.207 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:23:17.207 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:23:17.426 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613244191.013875_678.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:23:11.013875Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:23:17.427 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T19:23:18.447 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:23:18.447 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:23:18.447 DEBUG:teuthology.orchestra.run.gibba025:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:23:18.548 INFO:teuthology.orchestra.run.gibba025.stderr:No --period given, using current period=c72c9bb6-7372-4355-b488-0f51f8a5cecb 2021-02-13T19:23:18.565 INFO:teuthology.orchestra.run.gibba025.stdout:[{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"1_1613244198.434178_682.1","last_update":"2021-02-13 19:23:18.434178Z"}] 2021-02-13T19:23:18.565 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone4 2021-02-13T19:23:18.565 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:23:18.565 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone4', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-02-13T19:23:18.565 DEBUG:teuthology.orchestra.run.gibba036:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-02-13T19:23:18.785 INFO:teuthology.orchestra.run.gibba036.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"c72c9bb6-7372-4355-b488-0f51f8a5cecb","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1613238836.394578_31.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:53:56.394578Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"1_1613238989.770436_129.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 17:56:29.770436Z","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"1_1613244198.434178_682.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-02-13 19:23:18.434178Z","realm_epoch":4}}]},"full_sync":{"total":1,"complete":1}} 2021-02-13T19:23:18.785 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone4 2021-02-13T19:23:18.798 INFO:tasks.rgw_multi.tests_ps:missing topic is expected 2021-02-13T19:23:18.842 INFO:tasks.rgw_multisite_tests:test creating a subscription when no topic info exists ... ok 2021-02-13T19:23:18.843 INFO:tasks.rgw_multisite_tests:test updating topic associated with a notification ... ok 2021-02-13T19:23:18.843 INFO:tasks.rgw_multisite_tests:test updating the topic of a notification ... ok 2021-02-13T19:23:18.843 INFO:tasks.rgw_multisite_tests:test notification creation with multiple topics ... ok 2021-02-13T19:23:18.844 INFO:tasks.rgw_multisite_tests: 2021-02-13T19:23:18.844 INFO:tasks.rgw_multisite_tests:---------------------------------------------------------------------- 2021-02-13T19:23:18.844 INFO:tasks.rgw_multisite_tests:Ran 45 tests in 505.660s 2021-02-13T19:23:18.844 INFO:tasks.rgw_multisite_tests: 2021-02-13T19:23:18.845 INFO:tasks.rgw_multisite_tests:OK 2021-02-13T19:23:18.845 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_87d40f79d7da6caf6da06c190938773bf745140c/teuthology/run_tasks.py", line 94, in run_tasks manager.__enter__() File "/home/teuthworker/src/git.ceph.com_git_teuthology_87d40f79d7da6caf6da06c190938773bf745140c/teuthology/task/__init__.py", line 123, in __enter__ self.begin() File "/home/teuthworker/src/github.com_ceph_ceph-c_7194982cc16a1fd51df59ee58e1c54797c4465d1/qa/tasks/rgw_multisite_tests.py", line 74, in begin raise RuntimeError(error_msg + 'test failures') RuntimeError: rgw multisite, test failures 2021-02-13T19:23:18.935 ERROR:teuthology.run_tasks: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=b80cc54b08534d5b9249f14b3b5e0b9f Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_87d40f79d7da6caf6da06c190938773bf745140c/teuthology/run_tasks.py", line 94, in run_tasks manager.__enter__() File "/home/teuthworker/src/git.ceph.com_git_teuthology_87d40f79d7da6caf6da06c190938773bf745140c/teuthology/task/__init__.py", line 123, in __enter__ self.begin() File "/home/teuthworker/src/github.com_ceph_ceph-c_7194982cc16a1fd51df59ee58e1c54797c4465d1/qa/tasks/rgw_multisite_tests.py", line 74, in begin raise RuntimeError(error_msg + 'test failures') RuntimeError: rgw multisite, test failures 2021-02-13T19:23:18.936 DEBUG:teuthology.run_tasks:Unwinding manager rgw-multisite-tests 2021-02-13T19:23:18.943 DEBUG:teuthology.run_tasks:Unwinding manager rgw-multisite 2021-02-13T19:23:18.985 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2021-02-13T19:23:19.001 DEBUG:tasks.rgw.c1.client.0:waiting for process to exit 2021-02-13T19:23:19.002 INFO:teuthology.orchestra.run:waiting for 300 2021-02-13T19:23:19.022 INFO:tasks.rgw.c1.client.0.gibba025.stdout:2021-02-13 19:23:18.995 7f695648f700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term radosgw --rgw-frontends civetweb port=8000 -n client.0 --cluster c1 -k /etc/ceph/c1.client.0.keyring --log-file /var/log/ceph/rgw.c1.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c1.client.0.sock --foreground --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm (PID: 17178) UID: 0 2021-02-13T19:23:19.022 INFO:tasks.rgw.c1.client.0.gibba025.stdout:2021-02-13 19:23:18.995 7f696cdd6980 -1 shutting down 2021-02-13T19:23:25.104 INFO:tasks.rgw.c1.client.0:Stopped 2021-02-13T19:23:25.104 DEBUG:teuthology.orchestra.run.gibba025:> rm -f /home/ubuntu/cephtest/rgw.opslog.c1.client.0.sock 2021-02-13T19:23:25.113 DEBUG:tasks.rgw.c1.client.1:waiting for process to exit 2021-02-13T19:23:25.113 INFO:teuthology.orchestra.run:waiting for 300 2021-02-13T19:23:25.156 INFO:tasks.rgw.c1.client.1.gibba025.stdout:2021-02-13 19:23:25.151 7f514bbe1700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term radosgw --rgw-frontends civetweb port=8001 -n client.1 --cluster c1 -k /etc/ceph/c1.client.1.keyring --log-file /var/log/ceph/rgw.c1.client.1.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c1.client.1.sock --foreground --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm (PID: 26160) UID: 0 2021-02-13T19:23:25.156 INFO:tasks.rgw.c1.client.1.gibba025.stdout:2021-02-13 19:23:25.151 7f5162528980 -1 shutting down 2021-02-13T19:23:31.215 INFO:tasks.rgw.c1.client.1:Stopped 2021-02-13T19:23:31.215 DEBUG:teuthology.orchestra.run.gibba025:> rm -f /home/ubuntu/cephtest/rgw.opslog.c1.client.1.sock 2021-02-13T19:23:31.223 DEBUG:tasks.rgw.c2.client.0:waiting for process to exit 2021-02-13T19:23:31.224 INFO:teuthology.orchestra.run:waiting for 300 2021-02-13T19:23:31.225 INFO:tasks.rgw.c2.client.0.gibba036.stdout:2021-02-13 19:23:31.223 7f35683e5700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term radosgw --rgw-frontends civetweb port=8000 -n client.0 --cluster c2 -k /etc/ceph/c2.client.0.keyring --log-file /var/log/ceph/rgw.c2.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.0.sock --foreground --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm (PID: 17158) UID: 0 2021-02-13T19:23:31.225 INFO:tasks.rgw.c2.client.0.gibba036.stdout:2021-02-13 19:23:31.223 7f357ed2c980 -1 shutting down 2021-02-13T19:23:37.326 INFO:tasks.rgw.c2.client.0:Stopped 2021-02-13T19:23:37.326 DEBUG:teuthology.orchestra.run.gibba036:> rm -f /home/ubuntu/cephtest/rgw.opslog.c2.client.0.sock 2021-02-13T19:23:37.334 DEBUG:tasks.rgw.c2.client.1:waiting for process to exit 2021-02-13T19:23:37.334 INFO:teuthology.orchestra.run:waiting for 300 2021-02-13T19:23:37.377 INFO:tasks.rgw.c2.client.1.gibba036.stdout:2021-02-13 19:23:37.375 7fa42ee04700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term radosgw --rgw-frontends civetweb port=8001 -n client.1 --cluster c2 -k /etc/ceph/c2.client.1.keyring --log-file /var/log/ceph/rgw.c2.client.1.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.1.sock --foreground --rgw-zone test-zone4 --rgw-zonegroup test-zonegroup --rgw-realm test-realm (PID: 18220) UID: 0 2021-02-13T19:23:37.378 INFO:tasks.rgw.c2.client.1.gibba036.stdout:2021-02-13 19:23:37.375 7fa44574b980 -1 shutting down 2021-02-13T19:23:43.435 INFO:tasks.rgw.c2.client.1:Stopped 2021-02-13T19:23:43.436 DEBUG:teuthology.orchestra.run.gibba036:> rm -f /home/ubuntu/cephtest/rgw.opslog.c2.client.1.sock 2021-02-13T19:23:43.443 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2021-02-13T19:23:43.455 INFO:tasks.ceph.ceph_manager.c2:Canceling any pending splits or merges... 2021-02-13T19:23:43.455 DEBUG:teuthology.orchestra.run.gibba036:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster c2 osd dump --format=json 2021-02-13T19:23:43.638 INFO:teuthology.orchestra.run.gibba036.stdout: 2021-02-13T19:23:43.639 INFO:teuthology.orchestra.run.gibba036.stdout:{"epoch":55,"fsid":"554ed120-a4b0-4e13-b48c-53832c6f02bd","created":"2021-02-13 17:52:17.785547","modified":"2021-02-13 18:47:13.948210","last_up_change":"2021-02-13 17:52:22.801340","last_in_change":"2021-02-13 17:52:22.801340","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":20,"max_osd":3,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-02-13 17:52:26.067802","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"default.rgw.buckets.data","create_time":"2021-02-13 17:52:37.209781","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":3,"pool_name":"default.rgw.buckets.index","create_time":"2021-02-13 17:52:38.471146","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":4,"pool_name":".rgw.root","create_time":"2021-02-13 17:52:49.894515","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":5,"pool_name":"default.rgw.control","create_time":"2021-02-13 17:52:51.861835","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":6,"pool_name":"default.rgw.meta","create_time":"2021-02-13 17:52:53.863611","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":7,"pool_name":"default.rgw.log","create_time":"2021-02-13 17:52:55.861839","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":8,"pool_name":"test-zone2.rgw.buckets.data","create_time":"2021-02-13 17:53:15.073998","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":9,"pool_name":"test-zone2.rgw.control","create_time":"2021-02-13 17:53:16.337371","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":10,"pool_name":"test-zone2.rgw.meta","create_time":"2021-02-13 17:53:18.175875","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":11,"pool_name":"test-zone2.rgw.log","create_time":"2021-02-13 17:53:20.176695","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":12,"pool_name":"test-zone4.rgw.buckets.data","create_time":"2021-02-13 17:53:40.313858","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":13,"pool_name":"test-zone4.rgw.control","create_time":"2021-02-13 17:53:42.043719","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":14,"pool_name":"test-zone4.rgw.meta","create_time":"2021-02-13 17:53:43.902662","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":15,"pool_name":"test-zone4.rgw.log","create_time":"2021-02-13 17:53:45.894732","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":16,"pool_name":"test-zone2.rgw.buckets.index","create_time":"2021-02-13 17:55:55.612912","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":17,"pool_name":"test-zone4.rgw.buckets.index","create_time":"2021-02-13 17:55:55.844963","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":18,"pool_name":"remove.rgw.control","create_time":"2021-02-13 18:47:07.854894","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":19,"pool_name":"remove.rgw.meta","create_time":"2021-02-13 18:47:08.940965","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":20,"pool_name":"remove.rgw.log","create_time":"2021-02-13 18:47:10.933662","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}}],"osds":[{"osd":0,"uuid":"88d3b0c3-c325-4362-8390-1b1f41e1cdfb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.136:6800","nonce":14263},{"type":"v1","addr":"172.21.2.136:6801","nonce":14263}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.136:6802","nonce":14263},{"type":"v1","addr":"172.21.2.136:6803","nonce":14263}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.136:6806","nonce":14263},{"type":"v1","addr":"172.21.2.136:6807","nonce":14263}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.136:6804","nonce":14263},{"type":"v1","addr":"172.21.2.136:6805","nonce":14263}]},"public_addr":"172.21.2.136:6801/14263","cluster_addr":"172.21.2.136:6803/14263","heartbeat_back_addr":"172.21.2.136:6807/14263","heartbeat_front_addr":"172.21.2.136:6805/14263","state":["exists","up"]},{"osd":1,"uuid":"6b4337f3-1315-4cc8-9bda-d80cdb51f923","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.136:6808","nonce":14264},{"type":"v1","addr":"172.21.2.136:6809","nonce":14264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.136:6810","nonce":14264},{"type":"v1","addr":"172.21.2.136:6811","nonce":14264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.136:6814","nonce":14264},{"type":"v1","addr":"172.21.2.136:6815","nonce":14264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.136:6812","nonce":14264},{"type":"v1","addr":"172.21.2.136:6813","nonce":14264}]},"public_addr":"172.21.2.136:6809/14264","cluster_addr":"172.21.2.136:6811/14264","heartbeat_back_addr":"172.21.2.136:6815/14264","heartbeat_front_addr":"172.21.2.136:6813/14264","state":["exists","up"]},{"osd":2,"uuid":"87510b9f-ea18-4193-9b73-d4972bfc5777","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.136:6816","nonce":14265},{"type":"v1","addr":"172.21.2.136:6817","nonce":14265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.136:6818","nonce":14265},{"type":"v1","addr":"172.21.2.136:6819","nonce":14265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.136:6822","nonce":14265},{"type":"v1","addr":"172.21.2.136:6823","nonce":14265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.136:6820","nonce":14265},{"type":"v1","addr":"172.21.2.136:6821","nonce":14265}]},"public_addr":"172.21.2.136:6817/14265","cluster_addr":"172.21.2.136:6819/14265","heartbeat_back_addr":"172.21.2.136:6823/14265","heartbeat_front_addr":"172.21.2.136:6821/14265","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-13T19:23:43.647 DEBUG:teuthology.orchestra.run.gibba036:> sudo ceph --cluster c2 --mon-client-directed-command-retry 5 tell mon.* injectargs -- --no-mon-health-to-clog 2021-02-13T19:23:43.802 INFO:teuthology.orchestra.run.gibba036.stderr:injectargs:mon_health_to_clog = 'false' 2021-02-13T19:23:43.810 INFO:teuthology.misc:Shutting down mds daemons... 2021-02-13T19:23:43.811 INFO:teuthology.misc:Shutting down osd daemons... 2021-02-13T19:23:43.811 DEBUG:tasks.ceph.c2.osd.0:waiting for process to exit 2021-02-13T19:23:43.811 INFO:teuthology.orchestra.run:waiting for 300 2021-02-13T19:23:43.883 INFO:tasks.ceph.c2.osd.0:Stopped 2021-02-13T19:23:43.883 DEBUG:tasks.ceph.c2.osd.1:waiting for process to exit 2021-02-13T19:23:43.884 INFO:teuthology.orchestra.run:waiting for 300 2021-02-13T19:23:49.986 INFO:tasks.ceph.c2.osd.1:Stopped 2021-02-13T19:23:49.987 DEBUG:tasks.ceph.c2.osd.2:waiting for process to exit 2021-02-13T19:23:49.987 INFO:teuthology.orchestra.run:waiting for 300 2021-02-13T19:23:50.049 INFO:tasks.ceph.c2.osd.2:Stopped 2021-02-13T19:23:50.049 INFO:teuthology.misc:Shutting down mgr daemons... 2021-02-13T19:23:50.049 DEBUG:tasks.ceph.c2.mgr.x:waiting for process to exit 2021-02-13T19:23:50.049 INFO:teuthology.orchestra.run:waiting for 300 2021-02-13T19:23:50.059 INFO:tasks.ceph.c2.mgr.x:Stopped 2021-02-13T19:23:50.059 INFO:teuthology.misc:Shutting down mon daemons... 2021-02-13T19:23:50.059 DEBUG:tasks.ceph.c2.mon.a:waiting for process to exit 2021-02-13T19:23:50.059 INFO:teuthology.orchestra.run:waiting for 300 2021-02-13T19:23:50.111 INFO:tasks.ceph.c2.mon.a:Stopped 2021-02-13T19:23:50.112 INFO:tasks.ceph:Checking cluster log for badness... 2021-02-13T19:23:50.112 DEBUG:teuthology.orchestra.run.gibba036:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/c2.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | head -n 1 2021-02-13T19:23:50.164 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/c2-0 on ubuntu@gibba036.front.sepia.ceph.com 2021-02-13T19:23:50.164 DEBUG:teuthology.orchestra.run.gibba036:> sync && sudo umount -f /var/lib/ceph/osd/c2-0 2021-02-13T19:23:50.527 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/c2-1 on ubuntu@gibba036.front.sepia.ceph.com 2021-02-13T19:23:50.527 DEBUG:teuthology.orchestra.run.gibba036:> sync && sudo umount -f /var/lib/ceph/osd/c2-1 2021-02-13T19:23:50.661 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/c2-2 on ubuntu@gibba036.front.sepia.ceph.com 2021-02-13T19:23:50.661 DEBUG:teuthology.orchestra.run.gibba036:> sync && sudo umount -f /var/lib/ceph/osd/c2-2 2021-02-13T19:23:50.775 INFO:tasks.ceph:Archiving mon data... 2021-02-13T19:23:50.776 DEBUG:teuthology.misc:Transferring archived files from gibba036:/var/lib/ceph/mon/c2-a to /home/teuthworker/archive/yuriw-2021-02-12_17:45:41-rgw-wip-yuri3-testing-2021-02-12-0757-nautilus-distro-basic-gibba/5877924/data/c2.mon.a.tgz 2021-02-13T19:23:50.777 DEBUG:teuthology.orchestra.run.gibba036:> mktemp 2021-02-13T19:23:50.784 INFO:teuthology.orchestra.run.gibba036.stdout:/tmp/tmp.TS1Zyphuqv 2021-02-13T19:23:50.784 DEBUG:teuthology.orchestra.run.gibba036:> sudo tar cz -f - -C /var/lib/ceph/mon/c2-a -- . > /tmp/tmp.TS1Zyphuqv 2021-02-13T19:23:51.084 DEBUG:teuthology.orchestra.run.gibba036:> sudo chmod 0666 /tmp/tmp.TS1Zyphuqv 2021-02-13T19:23:51.137 DEBUG:teuthology.orchestra.remote:gibba036:/tmp/tmp.TS1Zyphuqv is 1MB 2021-02-13T19:23:51.263 DEBUG:teuthology.orchestra.run.gibba036:> rm -fr /tmp/tmp.TS1Zyphuqv 2021-02-13T19:23:51.271 INFO:tasks.ceph:Cleaning ceph cluster... 2021-02-13T19:23:51.271 DEBUG:teuthology.orchestra.run.gibba025:> sudo rm -rf -- /etc/ceph/c2.conf /etc/ceph/c2.keyring /home/ubuntu/cephtest/c2.data /home/ubuntu/cephtest/c2.monmap /home/ubuntu/cephtest/../*.pid 2021-02-13T19:23:51.274 DEBUG:teuthology.orchestra.run.gibba036:> sudo rm -rf -- /etc/ceph/c2.conf /etc/ceph/c2.keyring /home/ubuntu/cephtest/c2.data /home/ubuntu/cephtest/c2.monmap /home/ubuntu/cephtest/../*.pid 2021-02-13T19:23:51.330 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2021-02-13T19:23:51.340 INFO:tasks.ceph.ceph_manager.c1:Canceling any pending splits or merges... 2021-02-13T19:23:51.340 DEBUG:teuthology.orchestra.run.gibba025:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster c1 osd dump --format=json 2021-02-13T19:23:51.497 INFO:teuthology.orchestra.run.gibba025.stdout: 2021-02-13T19:23:51.497 INFO:teuthology.orchestra.run.gibba025.stdout:{"epoch":53,"fsid":"bed73c08-798c-4f38-a3f3-1bfc03039602","created":"2021-02-13 17:51:52.784152","modified":"2021-02-13 19:04:11.454514","last_up_change":"2021-02-13 17:51:57.899067","last_in_change":"2021-02-13 17:51:57.899067","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":3,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"nautilus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-02-13 17:52:01.057885","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"default.rgw.buckets.data","create_time":"2021-02-13 17:52:31.921393","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":3,"pool_name":"default.rgw.buckets.index","create_time":"2021-02-13 17:52:33.224562","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":4,"pool_name":".rgw.root","create_time":"2021-02-13 17:52:42.393407","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":5,"pool_name":"default.rgw.control","create_time":"2021-02-13 17:52:43.495083","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":6,"pool_name":"default.rgw.meta","create_time":"2021-02-13 17:52:45.490765","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":7,"pool_name":"default.rgw.log","create_time":"2021-02-13 17:52:47.489207","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":8,"pool_name":"test-zone1.rgw.buckets.data","create_time":"2021-02-13 17:53:00.179769","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":9,"pool_name":"test-zone1.rgw.control","create_time":"2021-02-13 17:53:01.445108","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":10,"pool_name":"test-zone1.rgw.meta","create_time":"2021-02-13 17:53:03.283010","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":11,"pool_name":"test-zone1.rgw.log","create_time":"2021-02-13 17:53:05.273772","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":12,"pool_name":"test-zone3.rgw.buckets.data","create_time":"2021-02-13 17:53:30.658405","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":13,"pool_name":"test-zone3.rgw.control","create_time":"2021-02-13 17:53:31.906478","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":14,"pool_name":"test-zone3.rgw.meta","create_time":"2021-02-13 17:53:33.765845","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":15,"pool_name":"test-zone3.rgw.log","create_time":"2021-02-13 17:53:35.753983","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":16,"pool_name":"test-zone1.rgw.buckets.index","create_time":"2021-02-13 17:55:54.491718","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":17,"pool_name":"test-zone3.rgw.buckets.index","create_time":"2021-02-13 17:55:56.611325","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":18,"pool_name":"test-zone1.rgw.buckets.non-ec","create_time":"2021-02-13 19:04:09.273053","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"warn","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}}],"osds":[{"osd":0,"uuid":"05649d51-bb49-4b5d-b6e6-56ccca9a8461","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.125:6809","nonce":14219},{"type":"v1","addr":"172.21.2.125:6811","nonce":14219}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.125:6813","nonce":14219},{"type":"v1","addr":"172.21.2.125:6815","nonce":14219}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.125:6822","nonce":14219},{"type":"v1","addr":"172.21.2.125:6823","nonce":14219}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.125:6817","nonce":14219},{"type":"v1","addr":"172.21.2.125:6819","nonce":14219}]},"public_addr":"172.21.2.125:6811/14219","cluster_addr":"172.21.2.125:6815/14219","heartbeat_back_addr":"172.21.2.125:6823/14219","heartbeat_front_addr":"172.21.2.125:6819/14219","state":["exists","up"]},{"osd":1,"uuid":"137be351-8eee-42cf-bb75-2b693f4157a6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.125:6808","nonce":14220},{"type":"v1","addr":"172.21.2.125:6810","nonce":14220}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.125:6812","nonce":14220},{"type":"v1","addr":"172.21.2.125:6814","nonce":14220}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.125:6820","nonce":14220},{"type":"v1","addr":"172.21.2.125:6821","nonce":14220}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.125:6816","nonce":14220},{"type":"v1","addr":"172.21.2.125:6818","nonce":14220}]},"public_addr":"172.21.2.125:6810/14220","cluster_addr":"172.21.2.125:6814/14220","heartbeat_back_addr":"172.21.2.125:6821/14220","heartbeat_front_addr":"172.21.2.125:6818/14220","state":["exists","up"]},{"osd":2,"uuid":"81558964-ae9d-41d2-8b54-fabf971685c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.125:6800","nonce":14221},{"type":"v1","addr":"172.21.2.125:6801","nonce":14221}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.125:6802","nonce":14221},{"type":"v1","addr":"172.21.2.125:6803","nonce":14221}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.125:6806","nonce":14221},{"type":"v1","addr":"172.21.2.125:6807","nonce":14221}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.125:6804","nonce":14221},{"type":"v1","addr":"172.21.2.125:6805","nonce":14221}]},"public_addr":"172.21.2.125:6801/14221","cluster_addr":"172.21.2.125:6803/14221","heartbeat_back_addr":"172.21.2.125:6807/14221","heartbeat_front_addr":"172.21.2.125:6805/14221","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4611087854035861503,"old_weight":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-02-13T19:23:51.506 DEBUG:teuthology.orchestra.run.gibba025:> sudo ceph --cluster c1 --mon-client-directed-command-retry 5 tell mon.* injectargs -- --no-mon-health-to-clog 2021-02-13T19:23:51.662 INFO:teuthology.orchestra.run.gibba025.stderr:injectargs:mon_health_to_clog = 'false' 2021-02-13T19:23:51.671 INFO:teuthology.misc:Shutting down mds daemons... 2021-02-13T19:23:51.671 INFO:teuthology.misc:Shutting down osd daemons... 2021-02-13T19:23:51.671 DEBUG:tasks.ceph.c1.osd.0:waiting for process to exit 2021-02-13T19:23:51.671 INFO:teuthology.orchestra.run:waiting for 300 2021-02-13T19:23:57.773 INFO:tasks.ceph.c1.osd.0:Stopped 2021-02-13T19:23:57.773 DEBUG:tasks.ceph.c1.osd.1:waiting for process to exit 2021-02-13T19:23:57.774 INFO:teuthology.orchestra.run:waiting for 300 2021-02-13T19:23:57.862 INFO:tasks.ceph.c1.osd.1:Stopped 2021-02-13T19:23:57.862 DEBUG:tasks.ceph.c1.osd.2:waiting for process to exit 2021-02-13T19:23:57.862 INFO:teuthology.orchestra.run:waiting for 300 2021-02-13T19:23:57.947 INFO:tasks.ceph.c1.osd.2:Stopped 2021-02-13T19:23:57.947 INFO:teuthology.misc:Shutting down mgr daemons... 2021-02-13T19:23:57.947 DEBUG:tasks.ceph.c1.mgr.x:waiting for process to exit 2021-02-13T19:23:57.947 INFO:teuthology.orchestra.run:waiting for 300 2021-02-13T19:23:57.958 INFO:tasks.ceph.c1.mgr.x:Stopped 2021-02-13T19:23:57.958 INFO:teuthology.misc:Shutting down mon daemons... 2021-02-13T19:23:57.958 DEBUG:tasks.ceph.c1.mon.a:waiting for process to exit 2021-02-13T19:23:57.958 INFO:teuthology.orchestra.run:waiting for 300 2021-02-13T19:23:58.011 INFO:tasks.ceph.c1.mon.a:Stopped 2021-02-13T19:23:58.011 INFO:tasks.ceph:Checking cluster log for badness... 2021-02-13T19:23:58.011 DEBUG:teuthology.orchestra.run.gibba025:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/c1.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | head -n 1 2021-02-13T19:23:58.064 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/c1-0 on ubuntu@gibba025.front.sepia.ceph.com 2021-02-13T19:23:58.065 DEBUG:teuthology.orchestra.run.gibba025:> sync && sudo umount -f /var/lib/ceph/osd/c1-0 2021-02-13T19:23:58.508 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/c1-1 on ubuntu@gibba025.front.sepia.ceph.com 2021-02-13T19:23:58.509 DEBUG:teuthology.orchestra.run.gibba025:> sync && sudo umount -f /var/lib/ceph/osd/c1-1 2021-02-13T19:23:58.662 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/c1-2 on ubuntu@gibba025.front.sepia.ceph.com 2021-02-13T19:23:58.662 DEBUG:teuthology.orchestra.run.gibba025:> sync && sudo umount -f /var/lib/ceph/osd/c1-2 2021-02-13T19:23:58.794 INFO:tasks.ceph:Archiving mon data... 2021-02-13T19:23:58.794 DEBUG:teuthology.misc:Transferring archived files from gibba025:/var/lib/ceph/mon/c1-a to /home/teuthworker/archive/yuriw-2021-02-12_17:45:41-rgw-wip-yuri3-testing-2021-02-12-0757-nautilus-distro-basic-gibba/5877924/data/c1.mon.a.tgz 2021-02-13T19:23:58.794 DEBUG:teuthology.orchestra.run.gibba025:> mktemp 2021-02-13T19:23:58.797 INFO:teuthology.orchestra.run.gibba025.stdout:/tmp/tmp.81H43XcATF 2021-02-13T19:23:58.798 DEBUG:teuthology.orchestra.run.gibba025:> sudo tar cz -f - -C /var/lib/ceph/mon/c1-a -- . > /tmp/tmp.81H43XcATF 2021-02-13T19:23:59.095 DEBUG:teuthology.orchestra.run.gibba025:> sudo chmod 0666 /tmp/tmp.81H43XcATF 2021-02-13T19:23:59.148 DEBUG:teuthology.orchestra.remote:gibba025:/tmp/tmp.81H43XcATF is 1MB 2021-02-13T19:23:59.268 DEBUG:teuthology.orchestra.run.gibba025:> rm -fr /tmp/tmp.81H43XcATF 2021-02-13T19:23:59.276 INFO:tasks.ceph:Cleaning ceph cluster... 2021-02-13T19:23:59.277 DEBUG:teuthology.orchestra.run.gibba025:> sudo rm -rf -- /etc/ceph/c1.conf /etc/ceph/c1.keyring /home/ubuntu/cephtest/c1.data /home/ubuntu/cephtest/c1.monmap /home/ubuntu/cephtest/../*.pid 2021-02-13T19:23:59.320 DEBUG:teuthology.orchestra.run.gibba036:> sudo rm -rf -- /etc/ceph/c1.conf /etc/ceph/c1.keyring /home/ubuntu/cephtest/c1.data /home/ubuntu/cephtest/c1.monmap /home/ubuntu/cephtest/../*.pid 2021-02-13T19:23:59.331 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2021-02-13T19:23:59.332 DEBUG:teuthology.orchestra.run.gibba025:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2021-02-13T19:23:59.369 DEBUG:teuthology.orchestra.run.gibba036:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2021-02-13T19:23:59.389 INFO:teuthology.orchestra.run.gibba036.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2021-02-13T19:23:59.390 INFO:teuthology.orchestra.run.gibba025.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2021-02-13T19:23:59.401 INFO:tasks.ceph:Archiving crash dumps... 2021-02-13T19:23:59.403 DEBUG:teuthology.misc:Transferring archived files from gibba025:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2021-02-12_17:45:41-rgw-wip-yuri3-testing-2021-02-12-0757-nautilus-distro-basic-gibba/5877924/remote/gibba025/crash 2021-02-13T19:23:59.404 DEBUG:teuthology.orchestra.run.gibba025:> sudo tar cz -f - -C /var/lib/ceph/crash -- . 2021-02-13T19:23:59.468 DEBUG:teuthology.misc:Transferring archived files from gibba036:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2021-02-12_17:45:41-rgw-wip-yuri3-testing-2021-02-12-0757-nautilus-distro-basic-gibba/5877924/remote/gibba036/crash 2021-02-13T19:23:59.469 DEBUG:teuthology.orchestra.run.gibba036:> sudo tar cz -f - -C /var/lib/ceph/crash -- . 2021-02-13T19:23:59.480 INFO:tasks.ceph:Compressing logs... 2021-02-13T19:23:59.480 DEBUG:teuthology.orchestra.run.gibba025:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2021-02-13T19:23:59.509 DEBUG:teuthology.orchestra.run.gibba036:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2021-02-13T19:24:41.028 INFO:tasks.ceph:Archiving logs... 2021-02-13T19:24:41.029 DEBUG:teuthology.misc:Transferring archived files from gibba025:/var/log/ceph to /home/teuthworker/archive/yuriw-2021-02-12_17:45:41-rgw-wip-yuri3-testing-2021-02-12-0757-nautilus-distro-basic-gibba/5877924/remote/gibba025/log 2021-02-13T19:24:41.030 DEBUG:teuthology.orchestra.run.gibba025:> sudo tar cz -f - -C /var/log/ceph -- . 2021-02-13T19:24:47.128 DEBUG:teuthology.misc:Transferring archived files from gibba036:/var/log/ceph to /home/teuthworker/archive/yuriw-2021-02-12_17:45:41-rgw-wip-yuri3-testing-2021-02-12-0757-nautilus-distro-basic-gibba/5877924/remote/gibba036/log 2021-02-13T19:24:47.129 DEBUG:teuthology.orchestra.run.gibba036:> sudo tar cz -f - -C /var/log/ceph -- . 2021-02-13T19:24:55.900 DEBUG:teuthology.run_tasks:Unwinding manager install 2021-02-13T19:24:55.913 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits... 2021-02-13T19:24:55.913 DEBUG:teuthology.orchestra.run.gibba025:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits 2021-02-13T19:24:55.917 DEBUG:teuthology.orchestra.run.gibba036:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits 2021-02-13T19:24:55.963 DEBUG:teuthology.run_tasks:Unwinding manager clock 2021-02-13T19:24:56.033 INFO:teuthology.task.clock:Checking final clock skew... 2021-02-13T19:24:56.034 DEBUG:teuthology.orchestra.run.gibba025:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-02-13T19:24:56.056 INFO:teuthology.orchestra.run.gibba025.stdout: remote refid st t when poll reach delay offset jitter 2021-02-13T19:24:56.056 INFO:teuthology.orchestra.run.gibba025.stdout:============================================================================== 2021-02-13T19:24:56.056 INFO:teuthology.orchestra.run.gibba025.stdout:-hv01.front.sepi 216.240.36.24 3 u 179 256 377 0.185 5.038 0.827 2021-02-13T19:24:56.056 INFO:teuthology.orchestra.run.gibba025.stdout:*hv02.front.sepi 163.237.218.18 2 u 171 256 377 0.199 0.864 0.546 2021-02-13T19:24:56.056 INFO:teuthology.orchestra.run.gibba025.stdout:+hv03.front.sepi 74.6.168.72 3 u 144 256 377 0.204 0.506 0.257 2021-02-13T19:24:56.057 INFO:teuthology.orchestra.run.gibba025.stdout:+hv04.front.sepi 144.172.126.201 3 u 145 256 377 0.189 0.523 0.173 2021-02-13T19:24:56.057 DEBUG:teuthology.orchestra.run.gibba036:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-02-13T19:24:56.077 INFO:teuthology.orchestra.run.gibba036.stdout: remote refid st t when poll reach delay offset jitter 2021-02-13T19:24:56.078 INFO:teuthology.orchestra.run.gibba036.stdout:============================================================================== 2021-02-13T19:24:56.078 INFO:teuthology.orchestra.run.gibba036.stdout:-hv01.front.sepi 216.240.36.24 3 u 52 256 377 0.179 4.452 0.350 2021-02-13T19:24:56.078 INFO:teuthology.orchestra.run.gibba036.stdout:*hv02.front.sepi 163.237.218.18 2 u 80 256 377 0.246 -0.117 0.032 2021-02-13T19:24:56.078 INFO:teuthology.orchestra.run.gibba036.stdout:+hv03.front.sepi 74.6.168.72 3 u 18 256 377 0.152 -0.360 0.231 2021-02-13T19:24:56.078 INFO:teuthology.orchestra.run.gibba036.stdout:+hv04.front.sepi 144.172.126.201 3 u 26 256 377 0.142 0.073 0.073 2021-02-13T19:24:56.079 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2021-02-13T19:24:56.092 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2021-02-13T19:24:56.092 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2021-02-13T19:24:56.164 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2021-02-13T19:24:56.231 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2021-02-13T19:24:56.290 INFO:teuthology.task.internal:Duration was 5827.994107 seconds 2021-02-13T19:24:56.292 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2021-02-13T19:24:56.348 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2021-02-13T19:24:56.348 DEBUG:teuthology.orchestra.run.gibba025:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2021-02-13T19:24:56.351 DEBUG:teuthology.orchestra.run.gibba036:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2021-02-13T19:24:56.384 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2021-02-13T19:24:56.385 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@gibba025.front.sepia.ceph.com 2021-02-13T19:24:56.385 DEBUG:teuthology.orchestra.run.gibba025:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/*.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2021-02-13T19:24:56.436 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@gibba036.front.sepia.ceph.com 2021-02-13T19:24:56.436 DEBUG:teuthology.orchestra.run.gibba036:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/*.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2021-02-13T19:24:56.448 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2021-02-13T19:24:56.448 DEBUG:teuthology.orchestra.run.gibba025:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2021-02-13T19:24:56.482 DEBUG:teuthology.orchestra.run.gibba036:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2021-02-13T19:24:56.507 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2021-02-13T19:24:56.520 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2021-02-13T19:24:56.520 DEBUG:teuthology.orchestra.run.gibba025:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2021-02-13T19:24:56.551 DEBUG:teuthology.orchestra.run.gibba036:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2021-02-13T19:24:56.560 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2021-02-13T19:24:56.604 DEBUG:teuthology.orchestra.run.gibba025:> sudo sysctl -w kernel.core_pattern=core && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2021-02-13T19:24:56.607 DEBUG:teuthology.orchestra.run.gibba036:> sudo sysctl -w kernel.core_pattern=core && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2021-02-13T19:24:56.617 INFO:teuthology.orchestra.run.gibba025.stdout:kernel.core_pattern = core 2021-02-13T19:24:56.620 INFO:teuthology.orchestra.run.gibba036.stdout:kernel.core_pattern = core 2021-02-13T19:24:56.637 DEBUG:teuthology.orchestra.run.gibba025:> test -e /home/ubuntu/cephtest/archive/coredump 2021-02-13T19:24:56.674 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-13T19:24:56.674 DEBUG:teuthology.orchestra.run.gibba036:> test -e /home/ubuntu/cephtest/archive/coredump 2021-02-13T19:24:56.686 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-13T19:24:56.687 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2021-02-13T19:24:56.707 INFO:teuthology.task.internal:Transferring archived files... 2021-02-13T19:24:56.708 DEBUG:teuthology.misc:Transferring archived files from gibba025:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2021-02-12_17:45:41-rgw-wip-yuri3-testing-2021-02-12-0757-nautilus-distro-basic-gibba/5877924/remote/gibba025 2021-02-13T19:24:56.708 DEBUG:teuthology.orchestra.run.gibba025:> sudo tar cz -f - -C /home/ubuntu/cephtest/archive -- . 2021-02-13T19:24:56.745 DEBUG:teuthology.misc:Transferring archived files from gibba036:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2021-02-12_17:45:41-rgw-wip-yuri3-testing-2021-02-12-0757-nautilus-distro-basic-gibba/5877924/remote/gibba036 2021-02-13T19:24:56.745 DEBUG:teuthology.orchestra.run.gibba036:> sudo tar cz -f - -C /home/ubuntu/cephtest/archive -- . 2021-02-13T19:24:56.773 INFO:teuthology.task.internal:Removing archive directory... 2021-02-13T19:24:56.774 DEBUG:teuthology.orchestra.run.gibba025:> rm -rf -- /home/ubuntu/cephtest/archive 2021-02-13T19:24:56.785 DEBUG:teuthology.orchestra.run.gibba036:> rm -rf -- /home/ubuntu/cephtest/archive 2021-02-13T19:24:56.824 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2021-02-13T19:24:56.857 INFO:teuthology.task.internal:Not uploading archives. 2021-02-13T19:24:56.857 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2021-02-13T19:24:57.026 INFO:teuthology.task.internal:Tidying up after the test... 2021-02-13T19:24:57.026 DEBUG:teuthology.orchestra.run.gibba025:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2021-02-13T19:24:57.029 DEBUG:teuthology.orchestra.run.gibba036:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2021-02-13T19:24:57.036 INFO:teuthology.orchestra.run.gibba025.stdout: 524339 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 13 19:24 /home/ubuntu/cephtest 2021-02-13T19:24:57.038 INFO:teuthology.orchestra.run.gibba036.stdout: 524339 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 13 19:24 /home/ubuntu/cephtest 2021-02-13T19:24:57.041 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2021-02-13T19:24:57.135 INFO:teuthology.nuke:Checking targets against current locks 2021-02-13T19:24:57.279 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_87d40f79d7da6caf6da06c190938773bf745140c/virtualenv/bin/teuthology", line 33, in sys.exit(load_entry_point('teuthology', 'console_scripts', 'teuthology')()) File "/home/teuthworker/src/git.ceph.com_git_teuthology_87d40f79d7da6caf6da06c190938773bf745140c/scripts/run.py", line 38, in main teuthology.run.main(args) File "/home/teuthworker/src/git.ceph.com_git_teuthology_87d40f79d7da6caf6da06c190938773bf745140c/teuthology/run.py", line 412, in main report_outcome(config, archive, fake_ctx.summary, fake_ctx) File "/home/teuthworker/src/git.ceph.com_git_teuthology_87d40f79d7da6caf6da06c190938773bf745140c/teuthology/run.py", line 269, in report_outcome nuke(fake_ctx, fake_ctx.lock) File "/home/teuthworker/src/git.ceph.com_git_teuthology_87d40f79d7da6caf6da06c190938773bf745140c/teuthology/nuke/__init__.py", line 266, in nuke for unnuked in p: File "/home/teuthworker/src/git.ceph.com_git_teuthology_87d40f79d7da6caf6da06c190938773bf745140c/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_git_teuthology_87d40f79d7da6caf6da06c190938773bf745140c/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_git_teuthology_87d40f79d7da6caf6da06c190938773bf745140c/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_git_teuthology_87d40f79d7da6caf6da06c190938773bf745140c/teuthology/nuke/__init__.py", line 280, in nuke_one keep_logs = ctx.keep_logs File "/home/teuthworker/src/git.ceph.com_git_teuthology_87d40f79d7da6caf6da06c190938773bf745140c/teuthology/config.py", line 255, in __getattr__ raise AttributeError(name) AttributeError: keep_logs